2024-08-17T02:12:39.388 INFO:root:teuthology version: 1.2.0 2024-08-17T02:12:39.412 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:12:39.518 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268 branch: wip-mchangir-mgr-volumes-print-thread-name-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} email: mchangir@redhat.com first_in_suite: false job_id: '7858268' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - filesystem is online with fewer MDS than max_mds - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: enable_coprs: - ceph/el9 flavor: default sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-mgr-volumes-print-thread-name-quincy sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e owner: scheduled_mchangir@teuthology priority: 25 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5995 sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e sleep_before_teardown: 0 suite: fs suite_branch: wip-mchangir-mgr-volumes-print-thread-name-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLz9RCEh/bsN+pEcKUQOerEsgLcSD7s3S/zpEdJ0YQFhtsauGONRkiqxQy7YBCc6TbO3dPUhCT0tWVA4Xpk/UYc= smithi169.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMni5gCZZEhIlfOlqqNn1Vjukk8Nfk6fr3HOB/a89TM+IUxiog+jiPkev+P1+pSOnHss090MmNGiqYFgsO2qF4k= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 67db276914d29505c9707d04f3a3b8fb9d8aee4b timestamp: 2024-08-17_01:02:08 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-08-17T02:12:39.519 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa; will attempt to use it 2024-08-17T02:12:39.520 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks 2024-08-17T02:12:39.520 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-17T02:12:39.522 INFO:teuthology.task.internal:Checking packages... 2024-08-17T02:12:39.549 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2577e8139c6b8786f9d6d6ea21b8da9244b9260e' 2024-08-17T02:12:39.549 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-17T02:12:39.549 INFO:teuthology.packaging:ref: None 2024-08-17T02:12:39.549 INFO:teuthology.packaging:tag: None 2024-08-17T02:12:39.549 INFO:teuthology.packaging:branch: wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:12:39.549 INFO:teuthology.packaging:sha1: 2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:12:39.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-mchangir-mgr-volumes-print-thread-name-quincy 2024-08-17T02:12:39.687 INFO:teuthology.task.internal:Found packages for ceph version 17.2.7-1375.g2577e813 2024-08-17T02:12:39.689 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-17T02:12:39.696 INFO:teuthology.task.internal:no buildpackages task found 2024-08-17T02:12:39.696 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-17T02:12:39.702 INFO:teuthology.task.internal:Saving configuration 2024-08-17T02:12:39.719 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-17T02:12:39.727 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-17T02:12:39.747 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:55.447445', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLz9RCEh/bsN+pEcKUQOerEsgLcSD7s3S/zpEdJ0YQFhtsauGONRkiqxQy7YBCc6TbO3dPUhCT0tWVA4Xpk/UYc='} 2024-08-17T02:12:39.766 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi169.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-17 02:03:55.449408', 'locked_by': 'scheduled_mchangir@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMni5gCZZEhIlfOlqqNn1Vjukk8Nfk6fr3HOB/a89TM+IUxiog+jiPkev+P1+pSOnHss090MmNGiqYFgsO2qF4k='} 2024-08-17T02:12:39.766 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-17T02:12:39.772 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-08-17T02:12:39.772 INFO:teuthology.task.internal:roles: ubuntu@smithi169.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-08-17T02:12:39.772 INFO:teuthology.run_tasks:Running task console_log... 2024-08-17T02:12:39.829 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9c43163ac0>, signals=[15]) 2024-08-17T02:12:39.829 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-17T02:12:39.834 INFO:teuthology.task.internal:Opening connections... 2024-08-17T02:12:39.834 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:12:39.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:12:39.909 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:12:39.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:12:39.984 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-17T02:12:39.991 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2024-08-17T02:12:40.009 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2024-08-17T02:12:40.009 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2024-08-17T02:12:40.068 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="CentOS Stream" 2024-08-17T02:12:40.068 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="9" 2024-08-17T02:12:40.068 INFO:teuthology.orchestra.run.smithi045.stdout:ID="centos" 2024-08-17T02:12:40.068 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:12:40.068 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="9" 2024-08-17T02:12:40.068 INFO:teuthology.orchestra.run.smithi045.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:12:40.068 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:12:40.068 INFO:teuthology.orchestra.run.smithi045.stdout:ANSI_COLOR="0;31" 2024-08-17T02:12:40.068 INFO:teuthology.orchestra.run.smithi045.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:12:40.069 INFO:teuthology.orchestra.run.smithi045.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:12:40.069 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:12:40.069 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:12:40.069 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:12:40.069 INFO:teuthology.orchestra.run.smithi045.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:12:40.070 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2024-08-17T02:12:40.098 DEBUG:teuthology.orchestra.run.smithi169:> uname -m 2024-08-17T02:12:40.116 INFO:teuthology.orchestra.run.smithi169.stdout:x86_64 2024-08-17T02:12:40.116 DEBUG:teuthology.orchestra.run.smithi169:> cat /etc/os-release 2024-08-17T02:12:40.173 INFO:teuthology.orchestra.run.smithi169.stdout:NAME="CentOS Stream" 2024-08-17T02:12:40.173 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION="9" 2024-08-17T02:12:40.173 INFO:teuthology.orchestra.run.smithi169.stdout:ID="centos" 2024-08-17T02:12:40.173 INFO:teuthology.orchestra.run.smithi169.stdout:ID_LIKE="rhel fedora" 2024-08-17T02:12:40.173 INFO:teuthology.orchestra.run.smithi169.stdout:VERSION_ID="9" 2024-08-17T02:12:40.173 INFO:teuthology.orchestra.run.smithi169.stdout:PLATFORM_ID="platform:el9" 2024-08-17T02:12:40.174 INFO:teuthology.orchestra.run.smithi169.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-17T02:12:40.174 INFO:teuthology.orchestra.run.smithi169.stdout:ANSI_COLOR="0;31" 2024-08-17T02:12:40.174 INFO:teuthology.orchestra.run.smithi169.stdout:LOGO="fedora-logo-icon" 2024-08-17T02:12:40.174 INFO:teuthology.orchestra.run.smithi169.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-17T02:12:40.174 INFO:teuthology.orchestra.run.smithi169.stdout:HOME_URL="https://centos.org/" 2024-08-17T02:12:40.174 INFO:teuthology.orchestra.run.smithi169.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-17T02:12:40.174 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-17T02:12:40.174 INFO:teuthology.orchestra.run.smithi169.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-17T02:12:40.174 INFO:teuthology.lock.ops:Updating smithi169.front.sepia.ceph.com on lock server 2024-08-17T02:12:40.198 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-17T02:12:40.209 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-17T02:12:40.214 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-17T02:12:40.214 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:12:40.216 DEBUG:teuthology.orchestra.run.smithi169:> test '!' -e /home/ubuntu/cephtest 2024-08-17T02:12:40.232 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-17T02:12:40.238 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-17T02:12:40.238 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:12:40.274 DEBUG:teuthology.orchestra.run.smithi169:> test -z $(ls -A /var/lib/ceph) 2024-08-17T02:12:40.295 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-17T02:12:40.349 INFO:teuthology.run_tasks:Running task kernel... 2024-08-17T02:12:40.363 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-17T02:12:40.364 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-08-17T02:12:40.364 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-08-17T02:12:40.364 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:12:40.365 DEBUG:teuthology.orchestra.run.smithi169:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-17T02:12:40.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:12:40.381 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:12:40.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:12:40.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-08-17T02:12:40.535 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:40.535 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:12:40.535 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2024-08-17T02:12:40.539 DEBUG:teuthology.task.kernel:sha1 for client.1 is 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:40.539 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "7503b862ff5bc4e556b3daee1c7881aa3e90ed62"... 2024-08-17T02:12:40.539 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-08-17T02:12:40.553 INFO:teuthology.orchestra.run.smithi045.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:12:40.553 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:40.554 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:12:40.554 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum upgrade -y linux-firmware 2024-08-17T02:12:40.556 INFO:teuthology.orchestra.run.smithi169.stdout:5.14.0-437.el9.x86_64 2024-08-17T02:12:40.556 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:12:40.556 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-08-17T02:12:40.557 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum upgrade -y linux-firmware 2024-08-17T02:12:42.941 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-17T02:12:44.234 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 3.9 MB/s | 8.2 MB 00:02 2024-08-17T02:12:46.235 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-08-17T02:12:50.760 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 8.6 MB/s | 6.6 MB 00:00 2024-08-17T02:12:51.033 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 2.9 MB/s | 20 MB 00:06 2024-08-17T02:12:52.395 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 62 kB/s | 18 kB 00:00 2024-08-17T02:12:53.449 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 24 MB/s | 22 MB 00:00 2024-08-17T02:12:57.150 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 2.9 MB/s | 6.6 MB 00:02 2024-08-17T02:12:58.659 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 78 kB/s | 18 kB 00:00 2024-08-17T02:12:58.854 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-08-17T02:12:59.604 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 28 MB/s | 22 MB 00:00 2024-08-17T02:13:00.980 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-08-17T02:13:00.991 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-08-17T02:13:00.991 INFO:teuthology.orchestra.run.smithi169.stdout: Package Architecture Version Repository Size 2024-08-17T02:13:00.991 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-08-17T02:13:00.991 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-08-17T02:13:00.991 INFO:teuthology.orchestra.run.smithi169.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:13:00.991 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:13:00.991 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-08-17T02:13:00.991 INFO:teuthology.orchestra.run.smithi169.stdout:================================================================================ 2024-08-17T02:13:00.991 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 1 Package 2024-08-17T02:13:00.991 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:13:00.992 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 383 M 2024-08-17T02:13:00.992 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-08-17T02:13:05.260 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-08-17T02:13:06.430 INFO:teuthology.orchestra.run.smithi169.stdout:linux-firmware-20240716-145.el9.noarch.rpm 72 MB/s | 383 MB 00:05 2024-08-17T02:13:06.430 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:13:06.430 INFO:teuthology.orchestra.run.smithi169.stdout:Total 70 MB/s | 383 MB 00:05 2024-08-17T02:13:07.362 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-08-17T02:13:07.366 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-08-17T02:13:07.366 INFO:teuthology.orchestra.run.smithi045.stdout: Package Architecture Version Repository Size 2024-08-17T02:13:07.366 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-08-17T02:13:07.366 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2024-08-17T02:13:07.366 INFO:teuthology.orchestra.run.smithi045.stdout: linux-firmware noarch 20240716-145.el9 baseos 383 M 2024-08-17T02:13:07.366 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:13:07.366 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-08-17T02:13:07.367 INFO:teuthology.orchestra.run.smithi045.stdout:================================================================================ 2024-08-17T02:13:07.367 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 1 Package 2024-08-17T02:13:07.367 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:13:07.367 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 383 M 2024-08-17T02:13:07.367 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-08-17T02:13:09.513 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-08-17T02:13:09.592 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-08-17T02:13:09.592 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-08-17T02:13:12.950 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-08-17T02:13:12.951 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-08-17T02:13:20.319 INFO:teuthology.orchestra.run.smithi045.stdout:linux-firmware-20240716-145.el9.noarch.rpm 30 MB/s | 383 MB 00:12 2024-08-17T02:13:20.319 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:13:20.319 INFO:teuthology.orchestra.run.smithi045.stdout:Total 30 MB/s | 383 MB 00:12 2024-08-17T02:13:22.232 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-08-17T02:13:22.901 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:13:22.981 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:23.553 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-08-17T02:13:23.637 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-08-17T02:13:23.637 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-08-17T02:13:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:23.971 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:13:24.685 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:24.685 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:13:24.685 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-08-17T02:13:24.686 INFO:teuthology.orchestra.run.smithi169.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:13:24.686 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:13:24.686 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-08-17T02:13:24.982 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:13:24.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:25.130 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:13:25.130 DEBUG:teuthology.orchestra.run.smithi169:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:13:25.133 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi169.front.sepia.ceph.com to complete... 2024-08-17T02:13:27.042 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-08-17T02:13:27.042 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-08-17T02:13:36.182 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-08-17T02:13:37.304 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:13:37.415 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:37.967 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:37.967 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : linux-firmware-20240716-145.el9.noarch 1/2 2024-08-17T02:13:38.815 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 2/2 2024-08-17T02:13:38.815 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:13:38.815 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2024-08-17T02:13:38.816 INFO:teuthology.orchestra.run.smithi045.stdout: linux-firmware-20240716-145.el9.noarch 2024-08-17T02:13:38.816 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:13:38.816 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-08-17T02:13:39.155 INFO:teuthology.task.kernel:Downloading kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:13:39.156 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7503b862ff5bc4e556b3daee1c7881aa3e90ed62 2024-08-17T02:13:39.310 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ 2024-08-17T02:13:39.311 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/ --input-file=- 2024-08-17T02:13:39.313 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi045.front.sepia.ceph.com to complete... 2024-08-17T02:13:39.864 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17 02:13:39 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:13:39.864 INFO:teuthology.orchestra.run.smithi169.stderr:FINISHED --2024-08-17 02:13:39-- 2024-08-17T02:13:39.864 INFO:teuthology.orchestra.run.smithi169.stderr:Total wall clock time: 15s 2024-08-17T02:13:39.864 INFO:teuthology.orchestra.run.smithi169.stderr:Downloaded: 1 files, 344M in 14s (24.3 MB/s) 2024-08-17T02:13:39.867 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.1... 2024-08-17T02:13:39.867 DEBUG:teuthology.orchestra.run.smithi169:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:13:41.938 INFO:teuthology.orchestra.run.smithi169.stdout:Verifying... ######################################## 2024-08-17T02:13:42.058 INFO:teuthology.orchestra.run.smithi169.stdout:Preparing... ######################################## 2024-08-17T02:13:42.108 INFO:teuthology.orchestra.run.smithi169.stdout:Updating / installing... 2024-08-17T02:13:50.151 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:13:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17 02:13:55 URL:https://2.chacra.ceph.com/r/kernel/testing/7503b862ff5bc4e556b3daee1c7881aa3e90ed62/centos/9/flavors/default/x86_64/kernel-6.11.0_rc3_g7503b862ff5b-1.x86_64.rpm [360536130/360536130] -> "/tmp/kernel.x86_64.rpm" [1] 2024-08-17T02:13:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:FINISHED --2024-08-17 02:13:55-- 2024-08-17T02:13:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:Total wall clock time: 16s 2024-08-17T02:13:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:Downloaded: 1 files, 344M in 16s (21.6 MB/s) 2024-08-17T02:13:55.830 INFO:teuthology.task.kernel:Installing kernel 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 on client.0... 2024-08-17T02:13:55.830 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-08-17T02:13:58.000 INFO:teuthology.orchestra.run.smithi045.stdout:Verifying... ######################################## 2024-08-17T02:13:58.055 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing... ######################################## 2024-08-17T02:13:58.109 INFO:teuthology.orchestra.run.smithi045.stdout:Updating / installing... 2024-08-17T02:14:06.550 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-6.11.0_rc3_g7503b862ff5b-1 ######################################## 2024-08-17T02:14:30.512 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi169.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:14:30.513 DEBUG:teuthology.orchestra.run.smithi169:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:14:30.610 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:30.610 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:30.610 INFO:teuthology.orchestra.run.smithi169.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:30.610 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:30.610 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:14:30.610 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:14:30.610 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:14:30.611 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:14:30.612 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:14:30.613 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:14:30.614 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:14:30.614 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:14:30.614 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:14:30.614 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:14:30.614 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:14:30.614 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:14:30.614 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:14:30.614 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:14:30.614 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:14:30.614 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:14:30.614 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:14:30.615 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:14:30.616 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:14:30.617 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:14:30.618 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:14:30.619 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:14:30.620 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:14:30.621 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:14:30.622 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:14:30.622 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:14:30.622 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:14:30.622 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:14:30.622 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:14:30.622 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:14:30.622 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:14:30.622 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:14:30.622 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:14:30.622 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:14:30.622 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:14:30.623 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:14:30.624 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:14:30.625 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:14:30.626 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:14:30.627 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:14:30.628 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:14:30.629 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:14:30.630 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:14:30.631 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:14:30.632 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:14:30.633 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:14:30.634 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:14:30.635 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:14:30.636 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:14:30.637 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:14:30.638 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:14:30.639 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:14:30.640 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:14:30.641 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:14:30.642 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:14:30.643 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:14:30.644 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:14:30.645 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:14:30.646 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:14:30.647 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:14:30.648 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:14:30.649 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:14:30.650 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:14:30.651 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:14:30.652 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:14:30.653 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:14:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:14:30.655 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:14:30.656 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:14:30.657 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:14:30.658 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:14:30.658 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:14:30.658 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:14:30.658 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:14:30.658 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:14:30.658 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:14:30.658 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:14:30.658 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:14:30.658 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:14:30.658 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:14:30.658 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:14:30.659 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:14:30.660 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:14:30.661 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:14:30.662 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:14:30.663 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:14:30.664 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:14:30.665 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:14:30.666 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:14:30.667 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:14:30.668 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:14:30.669 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:14:30.670 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:14:30.671 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:14:30.672 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:14:30.673 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:14:30.674 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:14:30.675 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:14:30.676 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:14:30.677 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:14:30.678 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:14:30.679 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:14:30.680 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:14:30.681 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:14:30.682 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:14:30.683 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:14:30.684 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:14:30.685 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:14:30.686 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:14:30.687 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:14:30.688 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:14:30.689 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:14:30.690 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:14:30.691 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:14:30.692 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:14:30.693 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:14:30.694 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:14:30.695 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:14:30.696 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:14:30.697 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:14:30.698 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:14:30.699 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:14:30.700 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:14:30.701 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:14:30.702 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:14:30.703 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:14:30.704 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:14:30.705 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:14:30.706 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:14:30.707 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:14:30.708 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:14:30.709 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:14:30.710 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:14:30.711 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:14:30.712 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:14:30.713 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:14:30.714 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:14:30.715 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:14:30.716 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:14:30.717 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:14:30.718 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:14:30.719 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:14:30.720 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:14:30.721 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:14:30.722 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:14:30.723 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:14:30.724 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:14:30.725 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:14:30.726 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:14:30.727 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:14:30.728 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:14:30.729 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:14:30.729 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:14:30.729 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:14:30.729 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:14:30.729 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:14:30.729 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:14:30.729 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:14:30.729 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:14:30.729 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:14:30.729 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:14:30.729 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:14:30.730 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:14:30.731 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:14:30.732 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:14:30.733 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:14:30.734 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:14:30.734 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:14:30.734 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:14:30.734 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:14:30.734 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:14:30.734 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:14:30.734 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:14:30.734 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:14:30.734 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:14:30.734 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:14:30.734 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:14:30.735 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:14:30.736 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:14:30.737 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:14:30.738 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:14:30.739 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:14:30.740 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:14:30.741 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:14:30.742 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:14:30.743 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:14:30.744 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:14:30.745 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:14:30.746 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:14:30.747 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:14:30.748 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:14:30.749 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:14:30.750 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:14:30.751 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:14:30.752 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:14:30.753 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:14:30.754 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:14:30.755 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:14:30.756 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:14:30.757 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:14:30.757 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:14:30.757 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:14:30.757 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:14:30.757 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:14:30.758 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:14:30.759 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:14:30.760 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:14:30.761 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:14:30.761 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:14:30.761 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:14:30.761 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:14:30.761 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:14:30.761 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:14:30.761 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:14:30.761 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:14:30.761 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:14:30.761 INFO:teuthology.orchestra.run.smithi169.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:14:30.765 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:30.766 DEBUG:teuthology.orchestra.run.smithi169:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:14:30.788 INFO:teuthology.orchestra.run.smithi169.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:14:30.788 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:14:30.788 INFO:teuthology.orchestra.run.smithi169.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:14:30.788 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2024-08-17T02:14:30.788 INFO:teuthology.orchestra.run.smithi169.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:14:30.788 INFO:teuthology.orchestra.run.smithi169.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:14:30.788 INFO:teuthology.orchestra.run.smithi169.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:30.788 INFO:teuthology.orchestra.run.smithi169.stdout: fi 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout:done 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:30.789 INFO:teuthology.orchestra.run.smithi169.stdout:fi 2024-08-17T02:14:30.790 DEBUG:teuthology.orchestra.run.smithi169:> sudo rpm -qi grub2-tools 2024-08-17T02:14:30.861 INFO:teuthology.orchestra.run.smithi169.stdout:Name : grub2-tools 2024-08-17T02:14:30.861 INFO:teuthology.orchestra.run.smithi169.stdout:Epoch : 1 2024-08-17T02:14:30.861 INFO:teuthology.orchestra.run.smithi169.stdout:Version : 2.06 2024-08-17T02:14:30.861 INFO:teuthology.orchestra.run.smithi169.stdout:Release : 68.el9 2024-08-17T02:14:30.861 INFO:teuthology.orchestra.run.smithi169.stdout:Architecture: x86_64 2024-08-17T02:14:30.861 INFO:teuthology.orchestra.run.smithi169.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:14:30.861 INFO:teuthology.orchestra.run.smithi169.stdout:Group : Unspecified 2024-08-17T02:14:30.861 INFO:teuthology.orchestra.run.smithi169.stdout:Size : 8264254 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:License : GPLv3+ 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:Packager : builder@centos.org 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:Vendor : CentOS 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:Summary : Support tools for GRUB. 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:Description : 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:14:30.862 INFO:teuthology.orchestra.run.smithi169.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:14:30.863 INFO:teuthology.orchestra.run.smithi169.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:14:30.863 INFO:teuthology.orchestra.run.smithi169.stdout:hardware devices. 2024-08-17T02:14:30.863 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:14:30.863 INFO:teuthology.orchestra.run.smithi169.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:14:30.863 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:14:30.864 INFO:teuthology.task.kernel:Updating grub on smithi169 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:30.864 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:14:31.455 INFO:teuthology.orchestra.run.smithi169.stderr:Generating grub configuration file ... 2024-08-17T02:14:32.831 INFO:teuthology.orchestra.run.smithi169.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:14:32.862 INFO:teuthology.orchestra.run.smithi169.stderr:done 2024-08-17T02:14:32.877 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-08-17T02:14:32.892 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.OK5lVP6Wei 2024-08-17T02:14:32.892 DEBUG:teuthology.orchestra.run.smithi169:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.OK5lVP6Wei 2024-08-17T02:14:32.968 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.OK5lVP6Wei 2024-08-17T02:14:33.105 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.OK5lVP6Wei is 6KB 2024-08-17T02:14:33.155 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.OK5lVP6Wei 2024-08-17T02:14:33.170 DEBUG:teuthology.orchestra.run.smithi169:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:14:33.231 INFO:teuthology.orchestra.run.smithi169.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:14:33.232 INFO:teuthology.orchestra.run.smithi169.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:14:33.232 INFO:teuthology.orchestra.run.smithi169.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:14:33.232 INFO:teuthology.orchestra.run.smithi169.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:14:33.233 DEBUG:teuthology.orchestra.run.smithi169:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:33.389 DEBUG:teuthology.orchestra.run.smithi169:> sudo shutdown -r now 2024-08-17T02:14:47.641 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi045.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-08-17T02:14:47.641 DEBUG:teuthology.orchestra.run.smithi045:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-08-17T02:14:47.722 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/System.map-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:47.722 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/config-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:47.723 INFO:teuthology.orchestra.run.smithi045.stdout:/boot/vmlinuz-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:47.723 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:47.723 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/System.map 2024-08-17T02:14:47.723 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/config 2024-08-17T02:14:47.723 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel 2024-08-17T02:14:47.723 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch 2024-08-17T02:14:47.724 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86 2024-08-17T02:14:47.724 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto 2024-08-17T02:14:47.724 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-08-17T02:14:47.724 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-08-17T02:14:47.724 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-08-17T02:14:47.725 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-08-17T02:14:47.725 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-08-17T02:14:47.725 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-08-17T02:14:47.725 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-08-17T02:14:47.725 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crc32c-intel.ko 2024-08-17T02:14:47.725 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-08-17T02:14:47.726 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-08-17T02:14:47.726 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-08-17T02:14:47.726 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-08-17T02:14:47.726 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-avx2.ko 2024-08-17T02:14:47.726 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-08-17T02:14:47.726 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-08-17T02:14:47.727 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-08-17T02:14:47.727 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-08-17T02:14:47.727 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-08-17T02:14:47.727 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-08-17T02:14:47.727 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-08-17T02:14:47.727 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel 2024-08-17T02:14:47.727 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu 2024-08-17T02:14:47.727 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-amd.ko 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm-intel.ko 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/arch/x86/kvm/kvm.ko 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ansi_cprng.ko 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/anubis.ko 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/arc4.ko 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_memcpy.ko 2024-08-17T02:14:47.728 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_pq.ko 2024-08-17T02:14:47.729 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_raid6_recov.ko 2024-08-17T02:14:47.729 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_tx.ko 2024-08-17T02:14:47.729 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/async_xor.ko 2024-08-17T02:14:47.729 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/async_tx/raid6test.ko 2024-08-17T02:14:47.729 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authenc.ko 2024-08-17T02:14:47.730 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/authencesn.ko 2024-08-17T02:14:47.730 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blake2b_generic.ko 2024-08-17T02:14:47.730 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_common.ko 2024-08-17T02:14:47.730 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/blowfish_generic.ko 2024-08-17T02:14:47.730 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/camellia_generic.ko 2024-08-17T02:14:47.730 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast5_generic.ko 2024-08-17T02:14:47.730 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast6_generic.ko 2024-08-17T02:14:47.730 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cast_common.ko 2024-08-17T02:14:47.730 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ccm.ko 2024-08-17T02:14:47.730 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cmac.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crc32_generic.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_engine.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/crypto_user.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/cts.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/des_generic.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/dh_generic.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecc.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/ecdh_generic.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/echainiv.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/essiv.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/fcrypt.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/khazad.ko 2024-08-17T02:14:47.731 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/lz4hc.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/md4.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/michael_mic.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcbc.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/pcrypt.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/rmd160.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/seed.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/serpent_generic.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tcrypt.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/tea.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_common.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/twofish_generic.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/vmac.ko 2024-08-17T02:14:47.732 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/wp512.ko 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xcbc.ko 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xor.ko 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/crypto/xxhash_generic.ko 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_ipmi.ko 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/acpi_pad.ko 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/ec_sys.ko 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/platform_profile.ko 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbs.ko 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/sbshc.ko 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/acpi/video.ko 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata 2024-08-17T02:14:47.733 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/acard-ahci.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ahci_platform.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/ata_generic.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/libahci_platform.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_acpi.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ali.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_amd.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_artop.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atiixp.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_atp867x.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd640.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cmd64x.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_cypress.ko 2024-08-17T02:14:47.734 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_efar.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt366.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt37x.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x2n.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_hpt3x3.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it8213.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_it821x.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_jmicron.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_marvell.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_mpiix.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_netcell.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ninja32.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87410.ko 2024-08-17T02:14:47.735 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_ns87415.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_oldpiix.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_opti.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_optidma.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pcmcia.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc2027x.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_piccolo.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_rdc.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sch.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_serverworks.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sil680.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sis.ko 2024-08-17T02:14:47.736 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_sl82c105.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_triflex.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pata_via.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/pdc_adma.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_inic162x.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_mv.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_nv.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_promise.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_qstor.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sil24.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sis.ko 2024-08-17T02:14:47.737 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_svw.ko 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_sx4.ko 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_uli.ko 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_via.ko 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ata/sata_vsc.ko 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/auxdisplay/ks0108.ko 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-i2c.ko 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/base/regmap/regmap-mmio.ko 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/bcma/bcma.ko 2024-08-17T02:14:47.738 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/aoe/aoe.ko 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/brd.ko 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/drbd/drbd.ko 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/floppy.ko 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/loop.ko 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/nbd.ko 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/null_blk/null_blk.ko 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/pktcdvd.ko 2024-08-17T02:14:47.739 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/rbd.ko 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/virtio_blk.ko 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/xen-blkfront.ko 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/block/zram/zram.ko 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hangcheck-timer.ko 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/amd-rng.ko 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/intel-rng.ko 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-08-17T02:14:47.740 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/via-rng.ko 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/hw_random/virtio-rng.ko 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_si.ko 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/lp.ko 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/mwave/mwave.ko 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/ppdev.ko 2024-08-17T02:14:47.741 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tlclk.ko 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm.ko 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_atmel.ko 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_infineon.ko 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_nsc.ko 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis.ko 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/uv_mmtimer.ko 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/char/virtio_console.ko 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-08-17T02:14:47.742 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/p4-clockmod.ko 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/powernow-k8.ko 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/cpufreq/speedstep-lib.ko 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/ccp/ccp.ko 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-08-17T02:14:47.743 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-aes.ko 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/padlock-sha.ko 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dca/dca.ko 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/dw/dw_dmac.ko 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/dma/ioat/ioatdma.ko 2024-08-17T02:14:47.744 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/amd64_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/e752x_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/edac_mce_amd.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3000_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i3200_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5100_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i5400_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7300_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i7core_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/i82975x_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/ie31200_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/sb_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/edac/x38_edac.ko 2024-08-17T02:14:47.745 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/edd.ko 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/firmware/iscsi_ibft.ko 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-ich.ko 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/gpio/gpio-viperboard.ko 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-appleir.ko 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-aureal.ko 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-axff.ko 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-dr.ko 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elecom.ko 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-elo.ko 2024-08-17T02:14:47.746 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-emsff.ko 2024-08-17T02:14:47.747 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gaff.ko 2024-08-17T02:14:47.747 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gt683r.ko 2024-08-17T02:14:47.747 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-gyration.ko 2024-08-17T02:14:47.747 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-kbd.ko 2024-08-17T02:14:47.747 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtek-mouse.ko 2024-08-17T02:14:47.748 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-holtekff.ko 2024-08-17T02:14:47.748 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-hyperv.ko 2024-08-17T02:14:47.748 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-icade.ko 2024-08-17T02:14:47.748 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-keytouch.ko 2024-08-17T02:14:47.748 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-kye.ko 2024-08-17T02:14:47.748 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lcpower.ko 2024-08-17T02:14:47.748 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-led.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-lenovo.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-dj.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-multitouch.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-ortek.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-penmount.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-petalynx.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-picolcd.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-pl.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-plantronics.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-primax.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-rmi.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-arvo.ko 2024-08-17T02:14:47.749 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-common.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-isku.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kone.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-konepure.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-lua.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-pyra.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-ryos.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat-savu.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-roccat.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-saitek.ko 2024-08-17T02:14:47.750 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-samsung.ko 2024-08-17T02:14:47.751 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sensor-hub.ko 2024-08-17T02:14:47.751 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sjoy.ko 2024-08-17T02:14:47.751 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sony.ko 2024-08-17T02:14:47.751 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-speedlink.ko 2024-08-17T02:14:47.751 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-steelseries.ko 2024-08-17T02:14:47.751 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-sunplus.ko 2024-08-17T02:14:47.751 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-thrustmaster.ko 2024-08-17T02:14:47.751 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tivo.ko 2024-08-17T02:14:47.751 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-tmff.ko 2024-08-17T02:14:47.751 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-topseed.ko 2024-08-17T02:14:47.752 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-twinhan.ko 2024-08-17T02:14:47.752 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-uclogic.ko 2024-08-17T02:14:47.752 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-waltop.ko 2024-08-17T02:14:47.752 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-wiimote.ko 2024-08-17T02:14:47.752 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-xinmo.ko 2024-08-17T02:14:47.753 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zpff.ko 2024-08-17T02:14:47.753 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/hid-zydacron.ko 2024-08-17T02:14:47.753 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/uhid.ko 2024-08-17T02:14:47.753 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hid/wacom.ko 2024-08-17T02:14:47.753 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv 2024-08-17T02:14:47.753 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_balloon.ko 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_utils.ko 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hv/hv_vmbus.ko 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru.ko 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/abituguru3.ko 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/acpi_power_meter.ko 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7414.ko 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ad7418.ko 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adc128d818.ko 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1025.ko 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1026.ko 2024-08-17T02:14:47.754 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1029.ko 2024-08-17T02:14:47.755 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm1031.ko 2024-08-17T02:14:47.755 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adm9240.ko 2024-08-17T02:14:47.755 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ads7828.ko 2024-08-17T02:14:47.755 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7410.ko 2024-08-17T02:14:47.755 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7411.ko 2024-08-17T02:14:47.755 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7462.ko 2024-08-17T02:14:47.755 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7470.ko 2024-08-17T02:14:47.755 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7475.ko 2024-08-17T02:14:47.755 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/adt7x10.ko 2024-08-17T02:14:47.755 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/amc6821.ko 2024-08-17T02:14:47.755 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/applesmc.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asb100.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asc7621.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/asus_atk0110.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/atxp1.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/coretemp.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/dme1737.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds1621.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ds620.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc1403.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/emc6w201.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71805f.ko 2024-08-17T02:14:47.756 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f71882fg.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/f75375s.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fam15h_power.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/fschmd.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g760a.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/g762.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl518sm.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/gl520sm.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/hwmon-vid.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5500_temp.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/i5k_amb.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmaem.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ibmpex.ko 2024-08-17T02:14:47.757 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina209.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ina2xx.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/it87.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k10temp.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/k8temp.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lineage-pem.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm63.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm73.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm75.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm77.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm78.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm80.ko 2024-08-17T02:14:47.758 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm83.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm85.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm87.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm90.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm92.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm93.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95234.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95241.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/lm95245.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc2945.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4151.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4215.ko 2024-08-17T02:14:47.759 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4222.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4245.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4260.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/ltc4261.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max16065.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1619.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max1668.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max197.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6639.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6650.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/max6697.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/mcp3021.ko 2024-08-17T02:14:47.760 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6683.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775-core.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct6775.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/nct7802.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87360.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pc87427.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pcf8591.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max16064.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max34440.ko 2024-08-17T02:14:47.761 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/max8688.ko 2024-08-17T02:14:47.762 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-08-17T02:14:47.762 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-08-17T02:14:47.762 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-08-17T02:14:47.762 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-08-17T02:14:47.762 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-08-17T02:14:47.762 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-08-17T02:14:47.762 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/powr1220.ko 2024-08-17T02:14:47.762 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5627.ko 2024-08-17T02:14:47.762 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch5636.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sch56xx-common.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht15.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sht21.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/shtc1.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/sis5595.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47b397.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m1.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/smsc47m192.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/thmc50.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp102.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp103.ko 2024-08-17T02:14:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp401.ko 2024-08-17T02:14:47.764 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/tmp421.ko 2024-08-17T02:14:47.764 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via-cputemp.ko 2024-08-17T02:14:47.764 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/via686a.ko 2024-08-17T02:14:47.764 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt1211.ko 2024-08-17T02:14:47.764 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/vt8231.ko 2024-08-17T02:14:47.764 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627ehf.ko 2024-08-17T02:14:47.764 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83627hf.ko 2024-08-17T02:14:47.764 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83781d.ko 2024-08-17T02:14:47.764 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83791d.ko 2024-08-17T02:14:47.764 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83792d.ko 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83793.ko 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83795.ko 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l785ts.ko 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/hwmon/w83l786ng.ko 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-08-17T02:14:47.765 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-i801.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-isch.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-parport.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-08-17T02:14:47.766 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-via.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-dev.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-mux.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-smbus.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/i2c/i2c-stub.ko 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core 2024-08-17T02:14:47.767 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_cm.ko 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_core.ko 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_umad.ko 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/iw_cm.ko 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_cm.ko 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-08-17T02:14:47.768 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-08-17T02:14:47.769 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/fm801-gp.ko 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/gameport/gameport.ko 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/joydev.ko 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/keyboard/gpio_keys.ko 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/appletouch.ko 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/bcm5974.ko 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/cyapatp.ko 2024-08-17T02:14:47.770 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/elan_i2c.ko 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/sermouse.ko 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/synaptics_usb.ko 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/mouse/vsxxxaa.ko 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/rmi4/rmi_core.ko 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/altera_ps2.ko 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/arc_ps2.ko 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/serio/serio_raw.ko 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/input/sparse-keymap.ko 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds 2024-08-17T02:14:47.771 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-blinkm.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lm3530.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-lp3944.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/leds-ss4200.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md 2024-08-17T02:14:47.772 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/bcache/bcache.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-bio-prison.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache-smq.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-cache.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-crypt.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-delay.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-flakey.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-log-userspace.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-multipath.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-queue-length.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-raid.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-round-robin.ko 2024-08-17T02:14:47.773 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-service-time.ko 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-switch.ko 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-thin-pool.ko 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/dm-verity.ko 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid0.ko 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid1.ko 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid10.ko 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/md/raid456.ko 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion 2024-08-17T02:14:47.774 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptbase.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptctl.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptfc.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptlan.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptsas.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptscsih.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/message/fusion/mptspi.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_ich.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/lpc_sch.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/mfd-core.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/sm501.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/viperboard.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/vx855.ko 2024-08-17T02:14:47.775 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/mfd/wl1273-core.ko 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds9802als.ko 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/apds990x.ko 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/bh1770glc.ko 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/cb710/cb710.ko 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/at24.ko 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/eeprom/max6875.ko 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/enclosure.ko 2024-08-17T02:14:47.776 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/hpilo.ko 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29003.ko 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/isl29020.ko 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-me.ko 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei-txe.ko 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/mei/mei.ko 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-gru/gru.ko 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xp.ko 2024-08-17T02:14:47.777 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpc.ko 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_7xx1.ko 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tifm_core.ko 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/tsl2550.ko 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_balloon.ko 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/bonding/bonding.ko 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53 2024-08-17T02:14:47.778 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/b53/b53_common.ko 2024-08-17T02:14:47.779 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/bcm-sf2.ko 2024-08-17T02:14:47.779 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6060.ko 2024-08-17T02:14:47.779 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx 2024-08-17T02:14:47.779 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-08-17T02:14:47.779 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/dummy.ko 2024-08-17T02:14:47.779 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/eql.ko 2024-08-17T02:14:47.779 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet 2024-08-17T02:14:47.779 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com 2024-08-17T02:14:47.779 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-08-17T02:14:47.779 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-08-17T02:14:47.779 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/8390.ko 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/agere/et131x.ko 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera 2024-08-17T02:14:47.780 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx 2024-08-17T02:14:47.781 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade 2024-08-17T02:14:47.782 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna 2024-08-17T02:14:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-08-17T02:14:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio 2024-08-17T02:14:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb 2024-08-17T02:14:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-08-17T02:14:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-08-17T02:14:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-08-17T02:14:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-08-17T02:14:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-08-17T02:14:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-08-17T02:14:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-08-17T02:14:47.783 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-08-17T02:14:47.784 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-08-17T02:14:47.785 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink 2024-08-17T02:14:47.785 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-08-17T02:14:47.785 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-08-17T02:14:47.785 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/dnet.ko 2024-08-17T02:14:47.785 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex 2024-08-17T02:14:47.785 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet 2024-08-17T02:14:47.785 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-08-17T02:14:47.785 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ethoc.ko 2024-08-17T02:14:47.785 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/fealnx.ko 2024-08-17T02:14:47.785 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e100.ko 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-08-17T02:14:47.786 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/jme.ko 2024-08-17T02:14:47.787 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/skge.ko 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom 2024-08-17T02:14:47.788 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen 2024-08-17T02:14:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-08-17T02:14:47.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-08-17T02:14:47.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-08-17T02:14:47.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-08-17T02:14:47.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc 2024-08-17T02:14:47.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-08-17T02:14:47.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek 2024-08-17T02:14:47.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-08-17T02:14:47.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-08-17T02:14:47.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/atp.ko 2024-08-17T02:14:47.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-08-17T02:14:47.790 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis190.ko 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sis/sis900.ko 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-08-17T02:14:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/cassini.ko 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/niu.ko 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sungem.ko 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-08-17T02:14:47.792 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/ti/tlan.ko 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/geneve.ko 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ieee802154/fakelb.ko 2024-08-17T02:14:47.793 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ifb.ko 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ipvlan/ipvlan.ko 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvlan.ko 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/macvtap.ko 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio.ko 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mdio/mdio-regmap.ko 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/mii.ko 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/net_failover.ko 2024-08-17T02:14:47.794 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/netconsole.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/nlmon.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs-lynx.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/amd.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm7xxx.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/bcm87xx.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/broadcom.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/cicada.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/davicom.ko 2024-08-17T02:14:47.795 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/dp83640.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/et1011c.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/icplus.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/lxt.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/marvell.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/micrel.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/national.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/phylink.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/qsemi.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/realtek.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/smsc.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/ste10Xp.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/phy/vitesse.ko 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp 2024-08-17T02:14:47.796 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/bsd_comp.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_async.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_deflate.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_generic.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_mppe.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/ppp_synctty.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppoe.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pppox.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/ppp/pptp.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slhc.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/slip/slip.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/sungem_phy.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tap.ko 2024-08-17T02:14:47.797 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team.ko 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_activebackup.ko 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_broadcast.ko 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_random.ko 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/tun.ko 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/veth.ko 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/virtio_net.ko 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan 2024-08-17T02:14:47.798 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/vxlan/vxlan.ko 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netback/xen-netback.ko 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/net/xen-netfront.ko 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ntb/ntb.ko 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme-core.ko 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/nvme/host/nvme.ko 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport.ko 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_cs.ko 2024-08-17T02:14:47.799 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_pc.ko 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/parport/parport_serial.ko 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/pcie/aer_inject.ko 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pci/xen-pcifront.ko 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/i82092.ko 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/pd6729.ko 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pcmcia/yenta_socket.ko 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel 2024-08-17T02:14:47.800 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acer-wmi.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/acerhdf.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/apple-gmux.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-laptop.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/asus-wmi.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/classmate-laptop.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/hdaps.ko 2024-08-17T02:14:47.801 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/intel_ips.ko 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/msi-wmi.ko 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/mxm-wmi.ko 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-laptop.ko 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/samsung-q10.ko 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/topstar-laptop.ko 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/toshiba_haps.ko 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi-bmof.ko 2024-08-17T02:14:47.802 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/platform/x86/wmi.ko 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_common.ko 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/powercap/intel_rapl_msr.ko 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-gpio.ko 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps-ldisc.ko 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/clients/pps_parport.ko 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/pps/pps_core.ko 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp.ko 2024-08-17T02:14:47.803 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ptp/ptp_kvm.ko 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ras/amd/fmpm.ko 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-bq32k.ko 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1286.ko 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1307.ko 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1374.ko 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1511.ko 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1553.ko 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1672.ko 2024-08-17T02:14:47.804 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds1742.ko 2024-08-17T02:14:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds2404.ko 2024-08-17T02:14:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-ds3232.ko 2024-08-17T02:14:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-em3027.ko 2024-08-17T02:14:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-fm3130.ko 2024-08-17T02:14:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl12022.ko 2024-08-17T02:14:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-isl1208.ko 2024-08-17T02:14:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m41t80.ko 2024-08-17T02:14:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t35.ko 2024-08-17T02:14:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-m48t59.ko 2024-08-17T02:14:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-max6900.ko 2024-08-17T02:14:47.805 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-msm6242.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf2127.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf85063.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8523.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8563.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-pcf8583.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rp5c01.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rs5c372.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8025.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-rx8581.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-08-17T02:14:47.806 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/rtc/rtc-x1205.ko 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-9xxx.ko 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-sas.ko 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/3w-xxxx.ko 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/BusLogic.ko 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/a100u2w.ko 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aacraid/aacraid.ko 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/advansys.ko 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-08-17T02:14:47.807 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/am53c974.ko 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/atp870u.ko 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bfa/bfa.ko 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ch.ko 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor 2024-08-17T02:14:47.808 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/csiostor/csiostor.ko 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dc395x.ko 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-08-17T02:14:47.809 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/dmx3191d.ko 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esas2r/esas2r.ko 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/esp_scsi.ko 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/fcoe.ko 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/fnic/fnic.ko 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hpsa.ko 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hptiop.ko 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/hv_storvsc.ko 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/initio.ko 2024-08-17T02:14:47.810 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ipr.ko 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ips.ko 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/isci/isci.ko 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/iscsi_tcp.ko 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libfc/libfc.ko 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi.ko 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libiscsi_tcp.ko 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/libsas/libsas.ko 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc 2024-08-17T02:14:47.811 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/lpfc/lpfc.ko 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid.ko 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvsas/mvsas.ko 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/mvumi.ko 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/pmcraid.ko 2024-08-17T02:14:47.812 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla1280.ko 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/raid_class.ko 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_debug.ko 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_fc.ko 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_sas.ko 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_spi.ko 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/scsi_transport_srp.ko 2024-08-17T02:14:47.813 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/ses.ko 2024-08-17T02:14:47.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/st.ko 2024-08-17T02:14:47.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/stex.ko 2024-08-17T02:14:47.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2 2024-08-17T02:14:47.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-08-17T02:14:47.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/virtio_scsi.ko 2024-08-17T02:14:47.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/vmw_pvscsi.ko 2024-08-17T02:14:47.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/scsi/wd719x.ko 2024-08-17T02:14:47.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb 2024-08-17T02:14:47.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ssb/ssb.ko 2024-08-17T02:14:47.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target 2024-08-17T02:14:47.814 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/loopback/tcm_loop.ko 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_file.ko 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_iblock.ko 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_mod.ko 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_pscsi.ko 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/target_core_user.ko 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal 2024-08-17T02:14:47.815 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-08-17T02:14:47.816 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_gsm.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/n_hdlc.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/nozomi.ko 2024-08-17T02:14:47.817 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/arc_uart.ko 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/tty/serial/jsm/jsm.ko 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/core/ufshcd-core.ko 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio.ko 2024-08-17T02:14:47.818 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_aec.ko 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_cif.ko 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_pci_generic.ko 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/uio/uio_sercos3.ko 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-acm.ko 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/cdc-wdm.ko 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usblp.ko 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/class/usbtmc.ko 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/host/sl811-hcd.ko 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image 2024-08-17T02:14:47.819 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/mdc800.ko 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/image/microtek.ko 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/adutux.ko 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/appledisplay.ko 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi26.ko 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/emi62.ko 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ezusb.ko 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/idmouse.ko 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/iowarrior.ko 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/isight_firmware.ko 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/ldusb.ko 2024-08-17T02:14:47.820 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/legousbtower.ko 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/trancevibrator.ko 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usb3503.ko 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usblcd.ko 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/usbsevseg.ko 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/uss720.ko 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/misc/yurex.ko 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/phy/phy-generic.ko 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/aircable.ko 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ark3116.ko 2024-08-17T02:14:47.821 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/belkin_sa.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ch341.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cp210x.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cyberjack.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/cypress_m8.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/digi_acceleport.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/empeg.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ftdi_sio.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/garmin_gps.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_edgeport.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/io_ti.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipaq.ko 2024-08-17T02:14:47.822 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ipw.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ir-usb.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/keyspan_pda.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kl5kusb105.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/kobil_sct.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mct_u232.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7720.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/mos7840.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/navman.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/omninet.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/opticon.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/option.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/oti6858.ko 2024-08-17T02:14:47.823 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/pl2303.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcaux.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/qcserial.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/quatech2.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/safe_serial.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/sierra.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/spcp8x5.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ssu100.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/symbolserial.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_debug.ko 2024-08-17T02:14:47.824 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/usb_wwan.ko 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/visor.ko 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/whiteheat.ko 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/serial/xsens_mt.ko 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/uas.ko 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-alauda.ko 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-cypress.ko 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-datafab.ko 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-freecom.ko 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-isd200.ko 2024-08-17T02:14:47.825 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-08-17T02:14:47.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-karma.ko 2024-08-17T02:14:47.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-onetouch.ko 2024-08-17T02:14:47.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-realtek.ko 2024-08-17T02:14:47.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr09.ko 2024-08-17T02:14:47.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-sddr55.ko 2024-08-17T02:14:47.826 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/ums-usbat.ko 2024-08-17T02:14:47.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/storage/usb-storage.ko 2024-08-17T02:14:47.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip 2024-08-17T02:14:47.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-core.ko 2024-08-17T02:14:47.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/usbip-host.ko 2024-08-17T02:14:47.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-08-17T02:14:47.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio 2024-08-17T02:14:47.827 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/pci/vfio-pci.ko 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio.ko 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost.ko 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_iotlb.ko 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_net.ko 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/vhost/vhost_scsi.ko 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/apple_bl.ko 2024-08-17T02:14:47.828 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/lcd.ko 2024-08-17T02:14:47.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/video/backlight/platform_lcd.ko 2024-08-17T02:14:47.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio 2024-08-17T02:14:47.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio.ko 2024-08-17T02:14:47.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_balloon.ko 2024-08-17T02:14:47.829 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_mmio.ko 2024-08-17T02:14:47.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci.ko 2024-08-17T02:14:47.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-08-17T02:14:47.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-08-17T02:14:47.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/virtio/virtio_ring.ko 2024-08-17T02:14:47.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1 2024-08-17T02:14:47.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters 2024-08-17T02:14:47.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2482.ko 2024-08-17T02:14:47.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/masters/ds2490.ko 2024-08-17T02:14:47.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves 2024-08-17T02:14:47.830 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_smem.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/slaves/w1_therm.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/w1/wire.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim1535_wdt.ko 2024-08-17T02:14:47.831 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/alim7101_wdt.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/f71808e_wdt.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/hpwdt.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/i6300esb.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/iTCO_wdt.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ib700wdt.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ibmasr.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it8712f_wdt.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/it87_wdt.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/machzwd.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/nv_tco.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_pci.ko 2024-08-17T02:14:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/pcwd_usb.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sch311x_wdt.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/softdog.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/sp5100_tco.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/via_wdt.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83877f_wdt.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/w83977f_wdt.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/wdt_pci.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/watchdog/xen_wdt.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-acpi-processor.ko 2024-08-17T02:14:47.833 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-evtchn.ko 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntalloc.ko 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-gntdev.ko 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xen-privcmd.ko 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/drivers/xen/xenfs/xenfs.ko 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/9p/9p.ko 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs 2024-08-17T02:14:47.834 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/affs/affs.ko 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/befs/befs.ko 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/binfmt_misc.ko 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/btrfs/btrfs.ko 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cachefiles/cachefiles.ko 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ceph/ceph.ko 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/coda/coda.ko 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/cramfs/cramfs.ko 2024-08-17T02:14:47.835 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/dlm/dlm.ko 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ecryptfs/ecryptfs.ko 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/f2fs/f2fs.ko 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/fat.ko 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/msdos.ko 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fat/vfat.ko 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/cuse.ko 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/fuse/fuse.ko 2024-08-17T02:14:47.836 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/gfs2/gfs2.ko 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfs/hfs.ko 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/hfsplus/hfsplus.ko 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/isofs/isofs.ko 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/jfs/jfs.ko 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/lockd/lockd.ko 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix 2024-08-17T02:14:47.837 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/minix/minix.ko 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/netfs/netfs.ko 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfs.ko 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv3.ko 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs/nfsv4.ko 2024-08-17T02:14:47.838 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/grace.ko 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfs_common/nfs_acl.ko 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nfsd/nfsd.ko 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nilfs2/nilfs2.ko 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-celtic.ko 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-centeuro.ko 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-croatian.ko 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-cyrillic.ko 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-gaelic.ko 2024-08-17T02:14:47.839 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-greek.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-iceland.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-inuit.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-roman.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-romanian.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/mac-turkish.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1250.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1251.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp1255.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp737.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp775.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp850.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp852.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp855.ko 2024-08-17T02:14:47.840 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp857.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp860.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp861.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp862.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp863.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp864.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp865.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp866.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp869.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp874.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp932.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp936.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp949.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_cp950.ko 2024-08-17T02:14:47.841 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_euc-jp.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-1.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-13.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-14.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-15.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-2.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-3.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-4.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-5.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-6.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-7.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_iso8859-9.ko 2024-08-17T02:14:47.842 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-r.ko 2024-08-17T02:14:47.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-ru.ko 2024-08-17T02:14:47.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_koi8-u.ko 2024-08-17T02:14:47.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_ucs2_utils.ko 2024-08-17T02:14:47.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/nls/nls_utf8.ko 2024-08-17T02:14:47.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2 2024-08-17T02:14:47.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster 2024-08-17T02:14:47.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-08-17T02:14:47.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm 2024-08-17T02:14:47.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-08-17T02:14:47.843 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2.ko 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/overlayfs/overlay.ko 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/pstore/ramoops.ko 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/reiserfs/reiserfs.ko 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs 2024-08-17T02:14:47.844 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/romfs/romfs.ko 2024-08-17T02:14:47.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb 2024-08-17T02:14:47.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client 2024-08-17T02:14:47.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/client/cifs.ko 2024-08-17T02:14:47.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common 2024-08-17T02:14:47.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_arc4.ko 2024-08-17T02:14:47.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/smb/common/cifs_md4.ko 2024-08-17T02:14:47.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs 2024-08-17T02:14:47.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/squashfs/squashfs.ko 2024-08-17T02:14:47.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv 2024-08-17T02:14:47.845 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/sysv/sysv.ko 2024-08-17T02:14:47.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf 2024-08-17T02:14:47.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/udf/udf.ko 2024-08-17T02:14:47.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs 2024-08-17T02:14:47.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/ufs/ufs.ko 2024-08-17T02:14:47.846 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs 2024-08-17T02:14:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/fs/xfs/xfs.ko 2024-08-17T02:14:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel 2024-08-17T02:14:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu 2024-08-17T02:14:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/rcu/rcutorture.ko 2024-08-17T02:14:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/torture.ko 2024-08-17T02:14:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace 2024-08-17T02:14:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-08-17T02:14:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib 2024-08-17T02:14:47.847 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/asn1_encoder.ko 2024-08-17T02:14:47.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc-itu-t.ko 2024-08-17T02:14:47.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crc8.ko 2024-08-17T02:14:47.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto 2024-08-17T02:14:47.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libaescfb.ko 2024-08-17T02:14:47.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libarc4.ko 2024-08-17T02:14:47.848 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/crypto/libdes.ko 2024-08-17T02:14:47.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/libcrc32c.ko 2024-08-17T02:14:47.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lru_cache.ko 2024-08-17T02:14:47.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4 2024-08-17T02:14:47.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4_compress.ko 2024-08-17T02:14:47.849 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/lz4/lz4hc_compress.ko 2024-08-17T02:14:47.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math 2024-08-17T02:14:47.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/math/cordic.ko 2024-08-17T02:14:47.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6 2024-08-17T02:14:47.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/raid6/raid6_pq.ko 2024-08-17T02:14:47.850 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon 2024-08-17T02:14:47.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/reed_solomon/reed_solomon.ko 2024-08-17T02:14:47.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_bm.ko 2024-08-17T02:14:47.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_fsm.ko 2024-08-17T02:14:47.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/ts_kmp.ko 2024-08-17T02:14:47.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd 2024-08-17T02:14:47.851 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/lib/zstd/zstd_compress.ko 2024-08-17T02:14:47.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm 2024-08-17T02:14:47.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/mm/hwpoison-inject.ko 2024-08-17T02:14:47.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net 2024-08-17T02:14:47.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan 2024-08-17T02:14:47.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/6lowpan.ko 2024-08-17T02:14:47.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_dest.ko 2024-08-17T02:14:47.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_fragment.ko 2024-08-17T02:14:47.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_hop.ko 2024-08-17T02:14:47.852 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_ipv6.ko 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_mobility.ko 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_routing.ko 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/6lowpan/nhc_udp.ko 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/garp.ko 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/mrp.ko 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/p8022.ko 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/psnap.ko 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/802/stp.ko 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/8021q/8021q.ko 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p 2024-08-17T02:14:47.853 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet.ko 2024-08-17T02:14:47.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_fd.ko 2024-08-17T02:14:47.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_rdma.ko 2024-08-17T02:14:47.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/9p/9pnet_virtio.ko 2024-08-17T02:14:47.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv 2024-08-17T02:14:47.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/batman-adv/batman-adv.ko 2024-08-17T02:14:47.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge 2024-08-17T02:14:47.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/br_netfilter.ko 2024-08-17T02:14:47.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/bridge.ko 2024-08-17T02:14:47.854 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter 2024-08-17T02:14:47.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-08-17T02:14:47.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_among.ko 2024-08-17T02:14:47.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arp.ko 2024-08-17T02:14:47.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-08-17T02:14:47.855 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_limit.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_log.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_snat.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_stp.ko 2024-08-17T02:14:47.856 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-08-17T02:14:47.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-08-17T02:14:47.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-08-17T02:14:47.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-08-17T02:14:47.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/ebtables.ko 2024-08-17T02:14:47.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-08-17T02:14:47.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-08-17T02:14:47.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-08-17T02:14:47.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph 2024-08-17T02:14:47.857 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ceph/libceph.ko 2024-08-17T02:14:47.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core 2024-08-17T02:14:47.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/failover.ko 2024-08-17T02:14:47.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/core/pktgen.ko 2024-08-17T02:14:47.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp 2024-08-17T02:14:47.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp.ko 2024-08-17T02:14:47.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_diag.ko 2024-08-17T02:14:47.858 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv4.ko 2024-08-17T02:14:47.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dccp/dccp_ipv6.ko 2024-08-17T02:14:47.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver 2024-08-17T02:14:47.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dns_resolver/dns_resolver.ko 2024-08-17T02:14:47.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa 2024-08-17T02:14:47.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/dsa_core.ko 2024-08-17T02:14:47.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_brcm.ko 2024-08-17T02:14:47.859 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_dsa.ko 2024-08-17T02:14:47.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_none.ko 2024-08-17T02:14:47.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/dsa/tag_trailer.ko 2024-08-17T02:14:47.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154 2024-08-17T02:14:47.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan 2024-08-17T02:14:47.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-08-17T02:14:47.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154.ko 2024-08-17T02:14:47.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ieee802154/ieee802154_socket.ko 2024-08-17T02:14:47.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4 2024-08-17T02:14:47.860 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ah4.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/esp4.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/fou.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/gre.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/inet_diag.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_gre.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_tunnel.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ip_vti.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipcomp.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/ipip.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arp_tables.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-08-17T02:14:47.861 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-08-17T02:14:47.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-08-17T02:14:47.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-08-17T02:14:47.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-08-17T02:14:47.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-08-17T02:14:47.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-08-17T02:14:47.862 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-08-17T02:14:47.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/iptable_security.ko 2024-08-17T02:14:47.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-08-17T02:14:47.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-08-17T02:14:47.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-08-17T02:14:47.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-08-17T02:14:47.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-08-17T02:14:47.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-08-17T02:14:47.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-08-17T02:14:47.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-08-17T02:14:47.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-08-17T02:14:47.863 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_bic.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_dctcp.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_diag.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_highspeed.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_htcp.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_hybla.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_illinois.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_lp.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_scalable.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_vegas.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_veno.ko 2024-08-17T02:14:47.864 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_westwood.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tcp_yeah.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/tunnel4.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_diag.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/udp_tunnel.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv4/xfrm4_tunnel.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ah6.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/esp6.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/fou6.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_tunnel.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ip6_vti.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/ipcomp6.ko 2024-08-17T02:14:47.865 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-08-17T02:14:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-08-17T02:14:47.867 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/sit.ko 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/tunnel6.ko 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/ipv6/xfrm6_tunnel.ko 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/key/af_key.ko 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_core.ko 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_debugfs.ko 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_eth.ko 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip.ko 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ip6.ko 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_netlink.ko 2024-08-17T02:14:47.868 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/l2tp/l2tp_ppp.ko 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/llc/llc.ko 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mac802154/mac802154.ko 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/mpls/mpls_gso.ko 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set.ko 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-08-17T02:14:47.869 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs 2024-08-17T02:14:47.870 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-08-17T02:14:47.871 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conncount.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_h323.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_irc.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sane.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_sip.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-08-17T02:14:47.872 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_dup_netdev.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_flow_table_inet.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_log_syslog.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_amanda.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_ftp.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_irc.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_sip.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_nat_tftp.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_synproxy_core.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nf_tables.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_acct.ko 2024-08-17T02:14:47.873 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_log.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_osf.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nfnetlink_queue.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_chain_nat.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_compat.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_ct.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_dup_netdev.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fib.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_fwd_netdev.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_hash.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_limit.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_log.ko 2024-08-17T02:14:47.874 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_masq.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_nat.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_numgen.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_queue.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_quota.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_redir.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_reject_inet.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_socket.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/nft_tunnel.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_AUDIT.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CHECKSUM.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CLASSIFY.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-08-17T02:14:47.875 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_CT.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_DSCP.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HL.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_HMARK.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_IDLETIMER.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LED.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_LOG.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_MASQUERADE.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NETMAP.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFLOG.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_NFQUEUE.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_RATEEST.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_REDIRECT.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_SECMARK.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPMSS.ko 2024-08-17T02:14:47.876 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TEE.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TPROXY.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_TRACE.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_addrtype.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_bpf.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cgroup.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cluster.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_comment.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connbytes.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlabel.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connlimit.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_connmark.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_conntrack.ko 2024-08-17T02:14:47.877 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_cpu.ko 2024-08-17T02:14:47.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dccp.ko 2024-08-17T02:14:47.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_devgroup.ko 2024-08-17T02:14:47.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_dscp.ko 2024-08-17T02:14:47.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ecn.ko 2024-08-17T02:14:47.878 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_esp.ko 2024-08-17T02:14:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hashlimit.ko 2024-08-17T02:14:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_helper.ko 2024-08-17T02:14:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_hl.ko 2024-08-17T02:14:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipcomp.ko 2024-08-17T02:14:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_iprange.ko 2024-08-17T02:14:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_ipvs.ko 2024-08-17T02:14:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_l2tp.ko 2024-08-17T02:14:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_length.ko 2024-08-17T02:14:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_limit.ko 2024-08-17T02:14:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mac.ko 2024-08-17T02:14:47.879 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_mark.ko 2024-08-17T02:14:47.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_multiport.ko 2024-08-17T02:14:47.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nat.ko 2024-08-17T02:14:47.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_nfacct.ko 2024-08-17T02:14:47.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_osf.ko 2024-08-17T02:14:47.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_owner.ko 2024-08-17T02:14:47.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_physdev.ko 2024-08-17T02:14:47.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_pkttype.ko 2024-08-17T02:14:47.880 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_policy.ko 2024-08-17T02:14:47.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_quota.ko 2024-08-17T02:14:47.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_rateest.ko 2024-08-17T02:14:47.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_realm.ko 2024-08-17T02:14:47.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_recent.ko 2024-08-17T02:14:47.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_sctp.ko 2024-08-17T02:14:47.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_set.ko 2024-08-17T02:14:47.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_socket.ko 2024-08-17T02:14:47.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_state.ko 2024-08-17T02:14:47.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_statistic.ko 2024-08-17T02:14:47.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_string.ko 2024-08-17T02:14:47.881 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_tcpmss.ko 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_time.ko 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netfilter/xt_u32.ko 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/netlink/netlink_diag.ko 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/nsh/nsh.ko 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/openvswitch.ko 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-geneve.ko 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-gre.ko 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/openvswitch/vport-vxlan.ko 2024-08-17T02:14:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/packet/af_packet_diag.ko 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds.ko 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_rdma.ko 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/rds/rds_tcp.ko 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_csum.ko 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_gact.ko 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_mirred.ko 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_nat.ko 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_pedit.ko 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_police.ko 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_simple.ko 2024-08-17T02:14:47.883 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_skbedit.ko 2024-08-17T02:14:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/act_vlan.ko 2024-08-17T02:14:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_basic.ko 2024-08-17T02:14:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_bpf.ko 2024-08-17T02:14:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_flow.ko 2024-08-17T02:14:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_fw.ko 2024-08-17T02:14:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_route.ko 2024-08-17T02:14:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/cls_u32.ko 2024-08-17T02:14:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_cmp.ko 2024-08-17T02:14:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_ipset.ko 2024-08-17T02:14:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_meta.ko 2024-08-17T02:14:47.884 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_nbyte.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_text.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/em_u32.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_choke.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_codel.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_drr.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_fq.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_gred.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hfsc.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_hhf.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_htb.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_ingress.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio.ko 2024-08-17T02:14:47.885 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_mqprio_lib.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_multiq.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_netem.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_pie.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_plug.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_prio.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_qfq.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_red.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfb.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_sfq.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_tbf.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sched/sch_teql.ko 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp 2024-08-17T02:14:47.886 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp.ko 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sctp/sctp_diag.ko 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/sunrpc.ko 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc.ko 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/tipc/tipc_diag.ko 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix 2024-08-17T02:14:47.887 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/unix/unix_diag.ko 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock.ko 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_diag.ko 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/vmw_vsock/vsock_loopback.ko 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/net/xfrm/xfrm_ipcomp.ko 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-08-17T02:14:47.888 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/kernel/security/keys/trusted-keys/trusted.ko 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.alias.bin 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.alias.bin 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.bin 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.builtin.modinfo 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep.bin 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.devname 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.order 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.softdep 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols 2024-08-17T02:14:47.889 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.symbols.bin 2024-08-17T02:14:47.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.weakdep 2024-08-17T02:14:47.890 INFO:teuthology.orchestra.run.smithi045.stdout:/lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:14:47.893 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:47.893 DEBUG:teuthology.orchestra.run.smithi045:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-08-17T02:14:47.918 INFO:teuthology.orchestra.run.smithi045.stdout:postinstall scriptlet (using /bin/sh): 2024-08-17T02:14:47.918 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:14:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: /usr/bin/kernel-install add 6.11.0-rc3-g7503b862ff5b /lib/modules/6.11.0-rc3-g7503b862ff5b/vmlinuz 2024-08-17T02:14:47.918 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2024-08-17T02:14:47.918 INFO:teuthology.orchestra.run.smithi045.stdout:for file in vmlinuz System.map config; do 2024-08-17T02:14:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b"; then 2024-08-17T02:14:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: cp "/lib/modules/6.11.0-rc3-g7503b862ff5b/${file}" "/boot/${file}-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:47.918 INFO:teuthology.orchestra.run.smithi045.stdout: fi 2024-08-17T02:14:47.918 INFO:teuthology.orchestra.run.smithi045.stdout:done 2024-08-17T02:14:47.918 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -d "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" ] && \ 2024-08-17T02:14:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: ! diff -rq "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" >/dev/null 2>&1; then 2024-08-17T02:14:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: rm -rf "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: cp -r "/lib/modules/6.11.0-rc3-g7503b862ff5b/dtb" "/boot/dtb-6.11.0-rc3-g7503b862ff5b" 2024-08-17T02:14:47.919 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2024-08-17T02:14:47.919 INFO:teuthology.orchestra.run.smithi045.stdout:if [ ! -e "/lib/modules/6.11.0-rc3-g7503b862ff5b/modules.dep" ]; then 2024-08-17T02:14:47.919 INFO:teuthology.orchestra.run.smithi045.stdout: /usr/sbin/depmod 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:47.919 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2024-08-17T02:14:47.919 INFO:teuthology.orchestra.run.smithi045.stdout:preuninstall scriptlet (using /bin/sh): 2024-08-17T02:14:47.919 INFO:teuthology.orchestra.run.smithi045.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-08-17T02:14:47.919 INFO:teuthology.orchestra.run.smithi045.stdout:kernel-install remove 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:47.919 INFO:teuthology.orchestra.run.smithi045.stdout:fi 2024-08-17T02:14:47.920 DEBUG:teuthology.orchestra.run.smithi045:> sudo rpm -qi grub2-tools 2024-08-17T02:14:47.993 INFO:teuthology.orchestra.run.smithi045.stdout:Name : grub2-tools 2024-08-17T02:14:47.993 INFO:teuthology.orchestra.run.smithi045.stdout:Epoch : 1 2024-08-17T02:14:47.993 INFO:teuthology.orchestra.run.smithi045.stdout:Version : 2.06 2024-08-17T02:14:47.993 INFO:teuthology.orchestra.run.smithi045.stdout:Release : 68.el9 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:Architecture: x86_64 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:Group : Unspecified 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:Size : 8264254 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:License : GPLv3+ 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:Packager : builder@centos.org 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:Vendor : CentOS 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-17T02:14:47.994 INFO:teuthology.orchestra.run.smithi045.stdout:Summary : Support tools for GRUB. 2024-08-17T02:14:47.995 INFO:teuthology.orchestra.run.smithi045.stdout:Description : 2024-08-17T02:14:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:14:47.995 INFO:teuthology.orchestra.run.smithi045.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-17T02:14:47.995 INFO:teuthology.orchestra.run.smithi045.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-17T02:14:47.995 INFO:teuthology.orchestra.run.smithi045.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-17T02:14:47.995 INFO:teuthology.orchestra.run.smithi045.stdout:hardware devices. 2024-08-17T02:14:47.995 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:14:47.995 INFO:teuthology.orchestra.run.smithi045.stdout:This subpackage provides tools for support of all platforms. 2024-08-17T02:14:47.996 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-17T02:14:47.996 INFO:teuthology.task.kernel:Updating grub on smithi045 to boot 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:47.996 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-17T02:14:48.567 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2024-08-17T02:14:50.016 INFO:teuthology.orchestra.run.smithi045.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-17T02:14:50.047 INFO:teuthology.orchestra.run.smithi045.stderr:done 2024-08-17T02:14:50.049 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2024-08-17T02:14:50.065 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.xL4UOPvGn6 2024-08-17T02:14:50.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xL4UOPvGn6 2024-08-17T02:14:50.131 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.xL4UOPvGn6 2024-08-17T02:14:50.268 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.xL4UOPvGn6 is 6KB 2024-08-17T02:14:50.318 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.xL4UOPvGn6 2024-08-17T02:14:50.333 DEBUG:teuthology.orchestra.run.smithi045:> sudo /bin/ls /boot/loader/entries || true 2024-08-17T02:14:50.396 INFO:teuthology.orchestra.run.smithi045.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-17T02:14:50.396 INFO:teuthology.orchestra.run.smithi045.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-17T02:14:50.396 INFO:teuthology.orchestra.run.smithi045.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-17T02:14:50.396 INFO:teuthology.orchestra.run.smithi045.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b.conf 2024-08-17T02:14:50.398 DEBUG:teuthology.orchestra.run.smithi045:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.11.0-rc3-g7503b862ff5b 2024-08-17T02:14:50.568 DEBUG:teuthology.orchestra.run.smithi045:> sudo shutdown -r now 2024-08-17T02:14:50.642 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2024-08-17T02:15:03.402 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-08-17T02:15:03.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-08-17T02:15:03.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:20.586 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-17T02:15:20.587 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-08-17T02:15:20.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:21.823 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-08-17T02:15:30.830 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-08-17T02:15:30.831 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:33.890 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-08-17T02:15:38.975 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-08-17T02:15:45.895 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-08-17T02:15:45.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:47.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-08-17T02:15:47.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:15:51.042 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2024-08-17T02:16:03.054 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-08-17T02:16:03.055 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:04.322 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.169 2024-08-17T02:16:19.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-08-17T02:16:19.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:16:20.041 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-08-17T02:16:20.641 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-08-17T02:16:20.641 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:16:20.642 DEBUG:teuthology.orchestra.run.smithi169:> uname -r 2024-08-17T02:16:20.676 INFO:teuthology.orchestra.run.smithi169.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:20.676 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:20.676 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:16:20.676 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:16:21.681 DEBUG:teuthology.parallel:result is None 2024-08-17T02:16:34.902 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-08-17T02:16:35.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-08-17T02:16:35.422 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc3-g7503b862ff5b"... 2024-08-17T02:16:35.423 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2024-08-17T02:16:35.458 INFO:teuthology.orchestra.run.smithi045.stdout:6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:35.459 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc3-g7503b862ff5b vs 6.11.0-rc3-g7503b862ff5b 2024-08-17T02:16:35.459 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-17T02:16:35.459 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-17T02:16:36.463 DEBUG:teuthology.parallel:result is None 2024-08-17T02:16:36.463 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-17T02:16:36.471 INFO:teuthology.task.internal:Creating test directory... 2024-08-17T02:16:36.471 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:16:36.475 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-17T02:16:36.514 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-17T02:16:36.520 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-17T02:16:36.530 INFO:teuthology.task.internal:Creating archive directory... 2024-08-17T02:16:36.531 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:16:36.552 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-17T02:16:36.605 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-17T02:16:36.613 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-17T02:16:36.613 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:16:36.617 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-17T02:16:36.732 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:36.779 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:36.797 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:36.837 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-17T02:16:36.840 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-17T02:16:36.847 INFO:teuthology.task.internal:Configuring sudo... 2024-08-17T02:16:36.852 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:16:36.856 DEBUG:teuthology.orchestra.run.smithi169:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-17T02:16:36.912 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-17T02:16:36.923 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-17T02:16:36.923 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:16:36.927 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-17T02:16:36.961 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:37.064 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:37.151 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:37.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:37.288 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:16:37.288 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:16:37.387 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:37.452 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-17T02:16:37.532 DEBUG:teuthology.orchestra.run.smithi169:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:37.595 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-17T02:16:37.671 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:16:37.671 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-17T02:16:37.725 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2024-08-17T02:16:37.729 DEBUG:teuthology.orchestra.run.smithi169:> sudo service rsyslog restart 2024-08-17T02:16:37.808 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:16:37.862 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:16:38.232 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-17T02:16:38.240 INFO:teuthology.task.internal:Starting timer... 2024-08-17T02:16:38.240 INFO:teuthology.run_tasks:Running task pcp... 2024-08-17T02:16:38.256 INFO:teuthology.run_tasks:Running task selinux... 2024-08-17T02:16:38.264 DEBUG:teuthology.orchestra.run.smithi045:> sudo service auditd rotate 2024-08-17T02:16:38.382 INFO:teuthology.orchestra.run.smithi045.stdout:Rotating logs: 2024-08-17T02:16:38.386 DEBUG:teuthology.orchestra.run.smithi169:> sudo service auditd rotate 2024-08-17T02:16:38.492 INFO:teuthology.orchestra.run.smithi169.stdout:Rotating logs: 2024-08-17T02:16:38.496 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-17T02:16:38.496 DEBUG:teuthology.orchestra.run.smithi045:> /usr/sbin/getenforce 2024-08-17T02:16:38.547 INFO:teuthology.orchestra.run.smithi045.stdout:Permissive 2024-08-17T02:16:38.548 DEBUG:teuthology.orchestra.run.smithi169:> /usr/sbin/getenforce 2024-08-17T02:16:38.596 INFO:teuthology.orchestra.run.smithi169.stdout:Permissive 2024-08-17T02:16:38.596 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi045.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi169.front.sepia.ceph.com': 'permissive'} 2024-08-17T02:16:38.596 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:16:38.655 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:16:38.656 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:16:38.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:16:38.713 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-17T02:16:38.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:16:38.769 DEBUG:teuthology.orchestra.run.smithi169:> sudo /usr/sbin/setenforce permissive 2024-08-17T02:16:38.834 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-17T02:16:38.843 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-17T02:16:38.856 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-17T02:16:38.856 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi169.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-17T02:22:25.148 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi169.front.sepia.ceph.com')] 2024-08-17T02:22:25.149 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-08-17T02:22:25.150 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:22:25.238 DEBUG:teuthology.orchestra.run.smithi045:> true 2024-08-17T02:22:25.346 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2024-08-17T02:22:25.346 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-08-17T02:22:25.347 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi169.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-17T02:22:25.435 DEBUG:teuthology.orchestra.run.smithi169:> true 2024-08-17T02:22:25.541 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi169.front.sepia.ceph.com' 2024-08-17T02:22:25.541 INFO:teuthology.run_tasks:Running task clock... 2024-08-17T02:22:25.552 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-17T02:22:25.552 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:22:25.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:22:25.557 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-17T02:22:25.557 DEBUG:teuthology.orchestra.run.smithi169:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:22:25.618 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:22:25.642 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-17T02:22:25.648 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:22:25.672 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-17T02:22:25.700 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: ntpd: command not found 2024-08-17T02:22:25.723 INFO:teuthology.orchestra.run.smithi169.stderr:sudo: ntpd: command not found 2024-08-17T02:22:25.724 INFO:teuthology.orchestra.run.smithi045.stdout:506 Cannot talk to daemon 2024-08-17T02:22:25.748 INFO:teuthology.orchestra.run.smithi169.stdout:506 Cannot talk to daemon 2024-08-17T02:22:25.755 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:22:25.776 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-17T02:22:25.784 INFO:teuthology.orchestra.run.smithi045.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:22:25.806 INFO:teuthology.orchestra.run.smithi169.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-17T02:22:25.891 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:22:25.897 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:22:25.897 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-08-17T02:22:25.897 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:22:25.898 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:22:25.898 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:22:25.898 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:22:25.911 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:22:25.917 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:22:25.917 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-08-17T02:22:25.917 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:22:25.917 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:22:25.918 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:22:25.918 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:22:25.919 INFO:teuthology.run_tasks:Running task install... 2024-08-17T02:22:25.927 DEBUG:teuthology.task.install:project ceph 2024-08-17T02:22:25.927 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}} 2024-08-17T02:22:25.927 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'} 2024-08-17T02:22:25.928 INFO:teuthology.task.install:Using flavor: default 2024-08-17T02:22:25.937 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-17T02:22:25.937 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-08-17T02:22:25.938 DEBUG:teuthology.orchestra.run.smithi045:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:22:25.938 DEBUG:teuthology.orchestra.run.smithi169:> sudo dnf -y install 'dnf-command(copr)' 2024-08-17T02:22:26.638 INFO:teuthology.orchestra.run.smithi169.stdout:Last metadata expiration check: 0:01:26 ago on Sat 17 Aug 2024 02:21:00 AM UTC. 2024-08-17T02:22:26.658 INFO:teuthology.orchestra.run.smithi045.stdout:Last metadata expiration check: 0:01:18 ago on Sat 17 Aug 2024 02:21:08 AM UTC. 2024-08-17T02:22:26.724 INFO:teuthology.orchestra.run.smithi169.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:22:26.749 INFO:teuthology.orchestra.run.smithi045.stdout:Package dnf-plugins-core-4.3.0-16.el9.noarch is already installed. 2024-08-17T02:22:26.766 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-08-17T02:22:26.767 INFO:teuthology.orchestra.run.smithi169.stdout:Nothing to do. 2024-08-17T02:22:26.767 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-08-17T02:22:26.795 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-08-17T02:22:26.796 INFO:teuthology.orchestra.run.smithi045.stdout:Nothing to do. 2024-08-17T02:22:26.796 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-08-17T02:22:26.845 DEBUG:teuthology.orchestra.run.smithi169:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:22:26.884 DEBUG:teuthology.orchestra.run.smithi045:> sudo dnf -y copr enable ceph/el9 2024-08-17T02:22:27.097 INFO:teuthology.orchestra.run.smithi169.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:22:27.097 INFO:teuthology.orchestra.run.smithi169.stderr:of the main distribution, and quality may vary. 2024-08-17T02:22:27.097 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-08-17T02:22:27.097 INFO:teuthology.orchestra.run.smithi169.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:22:27.097 INFO:teuthology.orchestra.run.smithi169.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:22:27.097 INFO:teuthology.orchestra.run.smithi169.stderr:, 2024-08-17T02:22:27.097 INFO:teuthology.orchestra.run.smithi169.stderr:and packages are not held to any quality or security level. 2024-08-17T02:22:27.097 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-08-17T02:22:27.097 INFO:teuthology.orchestra.run.smithi169.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:22:27.098 INFO:teuthology.orchestra.run.smithi169.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi045.stderr:Enabling a Copr repository. Please note that this repository is not part 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi045.stderr:of the main distribution, and quality may vary. 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi045.stderr: 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi045.stderr:The Fedora Project does not exercise any power over the contents of 2024-08-17T02:22:27.162 INFO:teuthology.orchestra.run.smithi045.stderr:this repository beyond the rules outlined in the Copr FAQ at 2024-08-17T02:22:27.163 INFO:teuthology.orchestra.run.smithi045.stderr:, 2024-08-17T02:22:27.163 INFO:teuthology.orchestra.run.smithi045.stderr:and packages are not held to any quality or security level. 2024-08-17T02:22:27.163 INFO:teuthology.orchestra.run.smithi045.stderr: 2024-08-17T02:22:27.163 INFO:teuthology.orchestra.run.smithi045.stderr:Please do not file bug reports about these packages in Fedora 2024-08-17T02:22:27.163 INFO:teuthology.orchestra.run.smithi045.stderr:Bugzilla. In case of problems, contact the owner of this repository. 2024-08-17T02:22:27.179 INFO:teuthology.orchestra.run.smithi169.stdout:Repository successfully enabled. 2024-08-17T02:22:27.224 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:22:27.224 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:27.259 INFO:teuthology.orchestra.run.smithi045.stdout:Repository successfully enabled. 2024-08-17T02:22:27.307 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'tag': None, 'wait_for_package': False} 2024-08-17T02:22:27.308 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:22:27.372 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:22:27.372 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:22:27.451 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/ 2024-08-17T02:22:27.451 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1375.g2577e813 2024-08-17T02:22:27.579 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:22:27.579 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:22:27.579 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:22:27.623 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-mchangir-mgr-volumes-print-thread-name-quincy/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-17T02:22:27.623 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:22:27.623 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-17T02:22:27.636 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:22:27.636 DEBUG:teuthology.orchestra.run.smithi169:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:22:27.680 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2024-08-17T02:22:27.680 DEBUG:teuthology.orchestra.run.smithi045:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2577e8139c6b8786f9d6d6ea21b8da9244b9260e/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-17T02:22:27.733 DEBUG:teuthology.orchestra.run.smithi169:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:22:27.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-17T02:22:27.812 DEBUG:teuthology.orchestra.run.smithi169:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:22:27.858 DEBUG:teuthology.orchestra.run.smithi045:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-17T02:22:27.868 INFO:teuthology.orchestra.run.smithi169.stdout:check_obsoletes = 1 2024-08-17T02:22:27.871 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum clean all 2024-08-17T02:22:27.913 INFO:teuthology.orchestra.run.smithi045.stdout:check_obsoletes = 1 2024-08-17T02:22:27.916 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum clean all 2024-08-17T02:22:28.143 INFO:teuthology.orchestra.run.smithi169.stdout:45 files removed 2024-08-17T02:22:28.180 DEBUG:teuthology.orchestra.run.smithi169:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:22:28.196 INFO:teuthology.orchestra.run.smithi045.stdout:45 files removed 2024-08-17T02:22:28.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2024-08-17T02:22:28.919 INFO:teuthology.orchestra.run.smithi169.stdout:ceph packages for x86_64 207 kB/s | 77 kB 00:00 2024-08-17T02:22:29.037 INFO:teuthology.orchestra.run.smithi045.stdout:ceph packages for x86_64 181 kB/s | 77 kB 00:00 2024-08-17T02:22:29.253 INFO:teuthology.orchestra.run.smithi169.stdout:ceph noarch packages 37 kB/s | 11 kB 00:00 2024-08-17T02:22:29.488 INFO:teuthology.orchestra.run.smithi045.stdout:ceph noarch packages 26 kB/s | 11 kB 00:00 2024-08-17T02:22:29.711 INFO:teuthology.orchestra.run.smithi169.stdout:ceph source packages 4.2 kB/s | 1.8 kB 00:00 2024-08-17T02:22:29.847 INFO:teuthology.orchestra.run.smithi045.stdout:ceph source packages 5.6 kB/s | 1.8 kB 00:00 2024-08-17T02:22:29.937 INFO:teuthology.orchestra.run.smithi169.stdout:Copr repo for el9 owned by ceph 40 kB/s | 7.6 kB 00:00 2024-08-17T02:22:30.081 INFO:teuthology.orchestra.run.smithi045.stdout:Copr repo for el9 owned by ceph 39 kB/s | 7.6 kB 00:00 2024-08-17T02:22:30.654 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.2 MB 00:00 2024-08-17T02:22:31.831 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-08-17T02:22:32.714 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-08-17T02:22:36.157 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - AppStream 6.4 MB/s | 20 MB 00:03 2024-08-17T02:22:37.148 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.6 MB 00:00 2024-08-17T02:22:38.690 INFO:teuthology.orchestra.run.smithi169.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 18 kB 00:00 2024-08-17T02:22:39.703 INFO:teuthology.orchestra.run.smithi169.stdout:Extra Packages for Enterprise Linux 25 MB/s | 22 MB 00:00 2024-08-17T02:22:40.891 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.6 MB 00:00 2024-08-17T02:22:42.500 INFO:teuthology.orchestra.run.smithi045.stdout:CentOS Stream 9 - Extras packages 80 kB/s | 18 kB 00:00 2024-08-17T02:22:43.746 INFO:teuthology.orchestra.run.smithi045.stdout:Extra Packages for Enterprise Linux 20 MB/s | 22 MB 00:01 2024-08-17T02:22:46.076 INFO:teuthology.orchestra.run.smithi169.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-08-17T02:22:48.646 INFO:teuthology.orchestra.run.smithi169.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:22:48.647 INFO:teuthology.orchestra.run.smithi169.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:22:48.657 INFO:teuthology.orchestra.run.smithi169.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:22:48.658 INFO:teuthology.orchestra.run.smithi169.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:22:48.658 INFO:teuthology.orchestra.run.smithi169.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:22:48.659 INFO:teuthology.orchestra.run.smithi169.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:22:48.661 INFO:teuthology.orchestra.run.smithi169.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:22:48.663 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:22:48.664 INFO:teuthology.orchestra.run.smithi169.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:22:48.726 INFO:teuthology.orchestra.run.smithi169.stdout:Dependencies resolved. 2024-08-17T02:22:48.757 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-08-17T02:22:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: Package Arch Version Repository Size 2024-08-17T02:22:48.757 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-08-17T02:22:48.757 INFO:teuthology.orchestra.run.smithi169.stdout:Installing: 2024-08-17T02:22:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:22:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:22:48.757 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:22:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:22:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:22:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:22:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:22:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:22:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:22:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:22:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:22:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:22:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:22:48.758 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:22:48.759 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:22:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:22:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:22:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:22:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:22:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:22:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:22:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:22:48.760 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrading: 2024-08-17T02:22:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:22:48.760 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout:Installing dependencies: 2024-08-17T02:22:48.761 INFO:teuthology.orchestra.run.smithi169.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:22:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:22:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:22:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:22:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:22:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:22:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:22:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:22:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:22:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:22:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:22:48.762 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:22:48.763 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:22:48.764 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:22:48.765 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:22:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:22:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:22:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:22:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:22:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:22:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:22:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:22:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:22:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:22:48.766 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:22:48.767 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:22:48.768 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:22:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:22:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:22:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:22:48.769 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:22:48.770 INFO:teuthology.orchestra.run.smithi169.stdout:Installing weak dependencies: 2024-08-17T02:22:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:22:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:22:48.770 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction Summary 2024-08-17T02:22:48.770 INFO:teuthology.orchestra.run.smithi169.stdout:======================================================================================= 2024-08-17T02:22:48.770 INFO:teuthology.orchestra.run.smithi169.stdout:Install 121 Packages 2024-08-17T02:22:48.770 INFO:teuthology.orchestra.run.smithi169.stdout:Upgrade 12 Packages 2024-08-17T02:22:48.770 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:22:48.771 INFO:teuthology.orchestra.run.smithi169.stdout:Total download size: 206 M 2024-08-17T02:22:48.771 INFO:teuthology.orchestra.run.smithi169.stdout:Downloading Packages: 2024-08-17T02:22:49.560 INFO:teuthology.orchestra.run.smithi169.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 36 kB/s | 6.5 kB 00:00 2024-08-17T02:22:49.752 INFO:teuthology.orchestra.run.smithi169.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.2 MB/s | 813 kB 00:00 2024-08-17T02:22:49.836 INFO:teuthology.orchestra.run.smithi169.stdout:(3/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 11 MB/s | 5.0 MB 00:00 2024-08-17T02:22:49.861 INFO:teuthology.orchestra.run.smithi169.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 1.2 MB/s | 137 kB 00:00 2024-08-17T02:22:49.944 INFO:teuthology.orchestra.run.smithi169.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 19 MB/s | 2.1 MB 00:00 2024-08-17T02:22:50.078 INFO:teuthology.orchestra.run.smithi169.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 6.5 MB/s | 1.4 MB 00:00 2024-08-17T02:22:50.162 INFO:teuthology.orchestra.run.smithi169.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 18 MB/s | 3.9 MB 00:00 2024-08-17T02:22:50.310 INFO:teuthology.orchestra.run.smithi045.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-17T02:22:50.862 INFO:teuthology.orchestra.run.smithi169.stdout:(8/133): ceph-radosgw-17.2.7-1375.g2577e813.el9 20 MB/s | 14 MB 00:00 2024-08-17T02:22:51.129 INFO:teuthology.orchestra.run.smithi169.stdout:(9/133): ceph-common-17.2.7-1375.g2577e813.el9. 13 MB/s | 22 MB 00:01 2024-08-17T02:22:51.146 INFO:teuthology.orchestra.run.smithi169.stdout:(10/133): ceph-selinux-17.2.7-1375.g2577e813.el 89 kB/s | 25 kB 00:00 2024-08-17T02:22:51.205 INFO:teuthology.orchestra.run.smithi169.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 3.6 MB/s | 215 kB 00:00 2024-08-17T02:22:51.422 INFO:teuthology.orchestra.run.smithi169.stdout:(12/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 11 MB/s | 15 MB 00:01 2024-08-17T02:22:51.447 INFO:teuthology.orchestra.run.smithi169.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 103 kB/s | 25 kB 00:00 2024-08-17T02:22:51.481 INFO:teuthology.orchestra.run.smithi169.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 11 MB/s | 636 kB 00:00 2024-08-17T02:22:51.506 INFO:teuthology.orchestra.run.smithi169.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.7 MB/s | 163 kB 00:00 2024-08-17T02:22:51.531 INFO:teuthology.orchestra.run.smithi169.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 2.5 MB/s | 126 kB 00:00 2024-08-17T02:22:51.565 INFO:teuthology.orchestra.run.smithi169.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 7.7 MB/s | 458 kB 00:00 2024-08-17T02:22:51.615 INFO:teuthology.orchestra.run.smithi169.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 901 kB/s | 45 kB 00:00 2024-08-17T02:22:51.674 INFO:teuthology.orchestra.run.smithi169.stdout:(19/133): python3-ceph-common-17.2.7-1375.g2577 2.0 MB/s | 120 kB 00:00 2024-08-17T02:22:51.732 INFO:teuthology.orchestra.run.smithi169.stdout:(20/133): python3-cephfs-17.2.7-1375.g2577e813. 3.1 MB/s | 182 kB 00:00 2024-08-17T02:22:51.799 INFO:teuthology.orchestra.run.smithi169.stdout:(21/133): python3-rados-17.2.7-1375.g2577e813.e 5.4 MB/s | 369 kB 00:00 2024-08-17T02:22:51.875 INFO:teuthology.orchestra.run.smithi169.stdout:(22/133): librgw2-17.2.7-1375.g2577e813.el9.x86 14 MB/s | 4.9 MB 00:00 2024-08-17T02:22:51.908 INFO:teuthology.orchestra.run.smithi169.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 3.1 MB/s | 344 kB 00:00 2024-08-17T02:22:51.934 INFO:teuthology.orchestra.run.smithi169.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.9 MB/s | 116 kB 00:00 2024-08-17T02:22:51.959 INFO:teuthology.orchestra.run.smithi169.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:22:52.009 INFO:teuthology.orchestra.run.smithi169.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 3.2 MB/s | 165 kB 00:00 2024-08-17T02:22:52.068 INFO:teuthology.orchestra.run.smithi169.stdout:(27/133): ceph-grafana-dashboards-17.2.7-1375.g 419 kB/s | 24 kB 00:00 2024-08-17T02:22:52.127 INFO:teuthology.orchestra.run.smithi169.stdout:(28/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 15 MB/s | 2.9 MB 00:00 2024-08-17T02:22:52.152 INFO:teuthology.orchestra.run.smithi169.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 1.5 MB/s | 124 kB 00:00 2024-08-17T02:22:52.452 INFO:teuthology.orchestra.run.smithi169.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 10 MB/s | 3.4 MB 00:00 2024-08-17T02:22:52.561 INFO:teuthology.orchestra.run.smithi169.stdout:(31/133): ceph-mgr-diskprediction-local-17.2.7- 18 MB/s | 7.4 MB 00:00 2024-08-17T02:22:52.586 INFO:teuthology.orchestra.run.smithi169.stdout:(32/133): ceph-mgr-modules-core-17.2.7-1375.g25 1.8 MB/s | 240 kB 00:00 2024-08-17T02:22:52.620 INFO:teuthology.orchestra.run.smithi169.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 813 kB/s | 47 kB 00:00 2024-08-17T02:22:52.637 INFO:teuthology.orchestra.run.smithi169.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 289 kB/s | 15 kB 00:00 2024-08-17T02:22:52.670 INFO:teuthology.orchestra.run.smithi169.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 5.3 MB/s | 269 kB 00:00 2024-08-17T02:22:52.687 INFO:teuthology.orchestra.run.smithi169.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:22:52.704 INFO:teuthology.orchestra.run.smithi169.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 538 kB/s | 18 kB 00:00 2024-08-17T02:22:52.973 INFO:teuthology.orchestra.run.smithi045.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:22:52.974 INFO:teuthology.orchestra.run.smithi045.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-17T02:22:52.985 INFO:teuthology.orchestra.run.smithi045.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-17T02:22:52.986 INFO:teuthology.orchestra.run.smithi045.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-17T02:22:52.986 INFO:teuthology.orchestra.run.smithi045.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-17T02:22:52.987 INFO:teuthology.orchestra.run.smithi045.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-17T02:22:52.989 INFO:teuthology.orchestra.run.smithi045.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-17T02:22:52.991 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-17T02:22:52.992 INFO:teuthology.orchestra.run.smithi045.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-17T02:22:53.058 INFO:teuthology.orchestra.run.smithi045.stdout:Dependencies resolved. 2024-08-17T02:22:53.090 INFO:teuthology.orchestra.run.smithi045.stdout:======================================================================================= 2024-08-17T02:22:53.090 INFO:teuthology.orchestra.run.smithi045.stdout: Package Arch Version Repository Size 2024-08-17T02:22:53.090 INFO:teuthology.orchestra.run.smithi045.stdout:======================================================================================= 2024-08-17T02:22:53.090 INFO:teuthology.orchestra.run.smithi045.stdout:Installing: 2024-08-17T02:22:53.090 INFO:teuthology.orchestra.run.smithi045.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-17T02:22:53.090 INFO:teuthology.orchestra.run.smithi045.stdout: ceph x86_64 2:17.2.7-1375.g2577e813.el9 ceph 6.5 k 2024-08-17T02:22:53.090 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base x86_64 2:17.2.7-1375.g2577e813.el9 ceph 5.0 M 2024-08-17T02:22:53.090 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 813 k 2024-08-17T02:22:53.090 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1375.g2577e813.el9 ceph 137 k 2024-08-17T02:22:53.090 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr x86_64 2:17.2.7-1375.g2577e813.el9 ceph 1.4 M 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 124 k 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 3.4 M 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 7.4 M 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 47 k 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 14 M 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test x86_64 2:17.2.7-1375.g2577e813.el9 ceph 48 M 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 269 k 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 83 k 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 215 k 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 18 k 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-17T02:22:53.091 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 636 k 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel x86_64 2:17.2.7-1375.g2577e813.el9 ceph 126 k 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs x86_64 2:17.2.7-1375.g2577e813.el9 ceph 182 k 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados x86_64 2:17.2.7-1375.g2577e813.el9 ceph 369 k 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 344 k 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw x86_64 2:17.2.7-1375.g2577e813.el9 ceph 116 k 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 82 k 2024-08-17T02:22:53.092 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 165 k 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrading: 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.1 M 2024-08-17T02:22:53.093 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.9 M 2024-08-17T02:22:53.094 INFO:teuthology.orchestra.run.smithi045.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-17T02:22:53.094 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-17T02:22:53.094 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-17T02:22:53.094 INFO:teuthology.orchestra.run.smithi045.stdout:Installing dependencies: 2024-08-17T02:22:53.094 INFO:teuthology.orchestra.run.smithi045.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-17T02:22:53.094 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 22 M 2024-08-17T02:22:53.094 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 24 k 2024-08-17T02:22:53.094 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds x86_64 2:17.2.7-1375.g2577e813.el9 ceph 2.1 M 2024-08-17T02:22:53.094 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 240 k 2024-08-17T02:22:53.094 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon x86_64 2:17.2.7-1375.g2577e813.el9 ceph 3.9 M 2024-08-17T02:22:53.094 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd x86_64 2:17.2.7-1375.g2577e813.el9 ceph 15 M 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1375.g2577e813.el9 ceph-noarch 15 k 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux x86_64 2:17.2.7-1375.g2577e813.el9 ceph 25 k 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi045.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite x86_64 2:17.2.7-1375.g2577e813.el9 ceph 163 k 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi045.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-17T02:22:53.095 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 458 k 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2 x86_64 2:17.2.7-1375.g2577e813.el9 ceph 4.9 M 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-17T02:22:53.096 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse x86_64 2:17.2.7-1375.g2577e813.el9 ceph 45 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common x86_64 2:17.2.7-1375.g2577e813.el9 ceph 120 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth noarch 1:2.33.0-1.el9 epel 220 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-17T02:22:53.097 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-17T02:22:53.098 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-17T02:22:53.099 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-17T02:22:53.100 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout:Installing weak dependencies: 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction Summary 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout:======================================================================================= 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout:Install 121 Packages 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout:Upgrade 12 Packages 2024-08-17T02:22:53.101 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:22:53.102 INFO:teuthology.orchestra.run.smithi045.stdout:Total download size: 206 M 2024-08-17T02:22:53.102 INFO:teuthology.orchestra.run.smithi045.stdout:Downloading Packages: 2024-08-17T02:22:53.397 INFO:teuthology.orchestra.run.smithi169.stdout:(38/133): ceph-test-17.2.7-1375.g2577e813.el9.x 21 MB/s | 48 MB 00:02 2024-08-17T02:22:53.439 INFO:teuthology.orchestra.run.smithi169.stdout:(39/133): fuse-2.9.9-16.el9.x86_64.rpm 106 kB/s | 80 kB 00:00 2024-08-17T02:22:53.714 INFO:teuthology.orchestra.run.smithi169.stdout:(40/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 922 kB/s | 253 kB 00:00 2024-08-17T02:22:53.736 INFO:teuthology.orchestra.run.smithi045.stdout:(1/133): ceph-17.2.7-1375.g2577e813.el9.x86_64. 33 kB/s | 6.5 kB 00:00 2024-08-17T02:22:53.747 INFO:teuthology.orchestra.run.smithi169.stdout:(41/133): libgfortran-11.4.1-3.el9.x86_64.rpm 770 kB/s | 803 kB 00:01 2024-08-17T02:22:53.856 INFO:teuthology.orchestra.run.smithi169.stdout:(42/133): python3-ply-3.11-14.el9.noarch.rpm 985 kB/s | 106 kB 00:00 2024-08-17T02:22:53.906 INFO:teuthology.orchestra.run.smithi169.stdout:(43/133): libquadmath-11.4.1-3.el9.x86_64.rpm 384 kB/s | 195 kB 00:00 2024-08-17T02:22:53.937 INFO:teuthology.orchestra.run.smithi045.stdout:(2/133): ceph-fuse-17.2.7-1375.g2577e813.el9.x8 4.0 MB/s | 813 kB 00:00 2024-08-17T02:22:53.966 INFO:teuthology.orchestra.run.smithi169.stdout:(44/133): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 135 kB 00:00 2024-08-17T02:22:54.007 INFO:teuthology.orchestra.run.smithi169.stdout:(45/133): python3-cryptography-36.0.1-4.el9.x86 4.2 MB/s | 1.2 MB 00:00 2024-08-17T02:22:54.032 INFO:teuthology.orchestra.run.smithi169.stdout:(46/133): python3-requests-2.25.1-8.el9.noarch. 996 kB/s | 125 kB 00:00 2024-08-17T02:22:54.054 INFO:teuthology.orchestra.run.smithi045.stdout:(3/133): ceph-base-17.2.7-1375.g2577e813.el9.x8 9.7 MB/s | 5.0 MB 00:00 2024-08-17T02:22:54.074 INFO:teuthology.orchestra.run.smithi169.stdout:(47/133): python3-urllib3-1.26.5-6.el9.noarch.r 1.9 MB/s | 215 kB 00:00 2024-08-17T02:22:54.087 INFO:teuthology.orchestra.run.smithi045.stdout:(4/133): ceph-immutable-object-cache-17.2.7-137 916 kB/s | 137 kB 00:00 2024-08-17T02:22:54.163 INFO:teuthology.orchestra.run.smithi045.stdout:(5/133): ceph-mds-17.2.7-1375.g2577e813.el9.x86 19 MB/s | 2.1 MB 00:00 2024-08-17T02:22:54.216 INFO:teuthology.orchestra.run.smithi169.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 153 kB/s | 22 kB 00:00 2024-08-17T02:22:54.275 INFO:teuthology.orchestra.run.smithi169.stdout:(49/133): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-08-17T02:22:54.313 INFO:teuthology.orchestra.run.smithi045.stdout:(6/133): ceph-mgr-17.2.7-1375.g2577e813.el9.x86 6.3 MB/s | 1.4 MB 00:00 2024-08-17T02:22:54.358 INFO:teuthology.orchestra.run.smithi169.stdout:(50/133): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-08-17T02:22:54.392 INFO:teuthology.orchestra.run.smithi169.stdout:(51/133): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-08-17T02:22:54.413 INFO:teuthology.orchestra.run.smithi045.stdout:(7/133): ceph-mon-17.2.7-1375.g2577e813.el9.x86 16 MB/s | 3.9 MB 00:00 2024-08-17T02:22:54.450 INFO:teuthology.orchestra.run.smithi169.stdout:(52/133): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-08-17T02:22:54.534 INFO:teuthology.orchestra.run.smithi169.stdout:(53/133): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 11 kB 00:00 2024-08-17T02:22:54.585 INFO:teuthology.orchestra.run.smithi169.stdout:(54/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-08-17T02:22:54.618 INFO:teuthology.orchestra.run.smithi169.stdout:(55/133): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 943 kB 00:00 2024-08-17T02:22:54.643 INFO:teuthology.orchestra.run.smithi169.stdout:(56/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-08-17T02:22:54.669 INFO:teuthology.orchestra.run.smithi169.stdout:(57/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-08-17T02:22:54.727 INFO:teuthology.orchestra.run.smithi169.stdout:(58/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 436 kB/s | 25 kB 00:00 2024-08-17T02:22:54.786 INFO:teuthology.orchestra.run.smithi169.stdout:(59/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 815 kB/s | 47 kB 00:00 2024-08-17T02:22:54.819 INFO:teuthology.orchestra.run.smithi169.stdout:(60/133): libtool-2.4.6-46.el9.x86_64.rpm 3.2 MB/s | 581 kB 00:00 2024-08-17T02:22:54.845 INFO:teuthology.orchestra.run.smithi169.stdout:(61/133): librdkafka-1.6.1-102.el9.x86_64.rpm 2.9 MB/s | 662 kB 00:00 2024-08-17T02:22:54.855 INFO:teuthology.orchestra.run.smithi045.stdout:(8/133): ceph-common-17.2.7-1375.g2577e813.el9. 17 MB/s | 22 MB 00:01 2024-08-17T02:22:54.870 INFO:teuthology.orchestra.run.smithi169.stdout:(62/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-08-17T02:22:54.895 INFO:teuthology.orchestra.run.smithi169.stdout:(63/133): openblas-0.3.21-2.el9.x86_64.rpm 467 kB/s | 35 kB 00:00 2024-08-17T02:22:54.897 INFO:teuthology.orchestra.run.smithi045.stdout:(9/133): ceph-selinux-17.2.7-1375.g2577e813.el9 607 kB/s | 25 kB 00:00 2024-08-17T02:22:55.063 INFO:teuthology.orchestra.run.smithi169.stdout:(64/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 23 MB/s | 4.4 MB 00:00 2024-08-17T02:22:55.121 INFO:teuthology.orchestra.run.smithi169.stdout:(65/133): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-08-17T02:22:55.180 INFO:teuthology.orchestra.run.smithi169.stdout:(66/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-17T02:22:55.214 INFO:teuthology.orchestra.run.smithi045.stdout:(10/133): ceph-radosgw-17.2.7-1375.g2577e813.el 18 MB/s | 14 MB 00:00 2024-08-17T02:22:55.238 INFO:teuthology.orchestra.run.smithi169.stdout:(67/133): python3-jsonpatch-1.21-16.el9.noarch. 441 kB/s | 26 kB 00:00 2024-08-17T02:22:55.273 INFO:teuthology.orchestra.run.smithi045.stdout:(11/133): cephfs-mirror-17.2.7-1375.g2577e813.e 3.6 MB/s | 215 kB 00:00 2024-08-17T02:22:55.297 INFO:teuthology.orchestra.run.smithi169.stdout:(68/133): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-08-17T02:22:55.356 INFO:teuthology.orchestra.run.smithi169.stdout:(69/133): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-08-17T02:22:55.414 INFO:teuthology.orchestra.run.smithi169.stdout:(70/133): python3-markupsafe-1.1.1-12.el9.x86_6 598 kB/s | 35 kB 00:00 2024-08-17T02:22:55.473 INFO:teuthology.orchestra.run.smithi045.stdout:(12/133): ceph-osd-17.2.7-1375.g2577e813.el9.x8 13 MB/s | 15 MB 00:01 2024-08-17T02:22:55.490 INFO:teuthology.orchestra.run.smithi045.stdout:(13/133): libcephfs-devel-17.2.7-1375.g2577e813 115 kB/s | 25 kB 00:00 2024-08-17T02:22:55.532 INFO:teuthology.orchestra.run.smithi045.stdout:(14/133): libcephfs2-17.2.7-1375.g2577e813.el9. 11 MB/s | 636 kB 00:00 2024-08-17T02:22:55.557 INFO:teuthology.orchestra.run.smithi045.stdout:(15/133): libcephsqlite-17.2.7-1375.g2577e813.e 2.4 MB/s | 163 kB 00:00 2024-08-17T02:22:55.582 INFO:teuthology.orchestra.run.smithi045.stdout:(16/133): librados-devel-17.2.7-1375.g2577e813. 2.5 MB/s | 126 kB 00:00 2024-08-17T02:22:55.615 INFO:teuthology.orchestra.run.smithi169.stdout:(71/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-08-17T02:22:55.624 INFO:teuthology.orchestra.run.smithi045.stdout:(17/133): libradosstriper1-17.2.7-1375.g2577e81 6.7 MB/s | 458 kB 00:00 2024-08-17T02:22:55.691 INFO:teuthology.orchestra.run.smithi045.stdout:(18/133): python3-ceph-argparse-17.2.7-1375.g25 679 kB/s | 45 kB 00:00 2024-08-17T02:22:55.707 INFO:teuthology.orchestra.run.smithi169.stdout:(72/133): openblas-openmp-0.3.21-2.el9.x86_64.r 5.5 MB/s | 4.7 MB 00:00 2024-08-17T02:22:55.732 INFO:teuthology.orchestra.run.smithi169.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-08-17T02:22:55.824 INFO:teuthology.orchestra.run.smithi169.stdout:(74/133): python3-babel-2.9.1-2.el9.noarch.rpm 6.4 MB/s | 6.0 MB 00:00 2024-08-17T02:22:55.824 INFO:teuthology.orchestra.run.smithi045.stdout:(19/133): librgw2-17.2.7-1375.g2577e813.el9.x86 20 MB/s | 4.9 MB 00:00 2024-08-17T02:22:55.841 INFO:teuthology.orchestra.run.smithi169.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 709 kB/s | 77 kB 00:00 2024-08-17T02:22:55.858 INFO:teuthology.orchestra.run.smithi045.stdout:(20/133): python3-ceph-common-17.2.7-1375.g2577 721 kB/s | 120 kB 00:00 2024-08-17T02:22:55.866 INFO:teuthology.orchestra.run.smithi169.stdout:(76/133): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-08-17T02:22:55.892 INFO:teuthology.orchestra.run.smithi169.stdout:(77/133): python3-prettytable-0.7.2-27.el9.noar 629 kB/s | 42 kB 00:00 2024-08-17T02:22:55.892 INFO:teuthology.orchestra.run.smithi045.stdout:(21/133): python3-cephfs-17.2.7-1375.g2577e813. 2.6 MB/s | 182 kB 00:00 2024-08-17T02:22:55.917 INFO:teuthology.orchestra.run.smithi169.stdout:(78/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-08-17T02:22:55.925 INFO:teuthology.orchestra.run.smithi045.stdout:(22/133): python3-rados-17.2.7-1375.g2577e813.e 5.4 MB/s | 369 kB 00:00 2024-08-17T02:22:55.942 INFO:teuthology.orchestra.run.smithi169.stdout:(79/133): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-08-17T02:22:55.959 INFO:teuthology.orchestra.run.smithi045.stdout:(23/133): python3-rbd-17.2.7-1375.g2577e813.el9 5.0 MB/s | 344 kB 00:00 2024-08-17T02:22:55.967 INFO:teuthology.orchestra.run.smithi169.stdout:(80/133): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-08-17T02:22:55.984 INFO:teuthology.orchestra.run.smithi045.stdout:(24/133): python3-rgw-17.2.7-1375.g2577e813.el9 1.9 MB/s | 116 kB 00:00 2024-08-17T02:22:55.993 INFO:teuthology.orchestra.run.smithi169.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 711 kB/s | 54 kB 00:00 2024-08-17T02:22:56.009 INFO:teuthology.orchestra.run.smithi045.stdout:(25/133): rbd-fuse-17.2.7-1375.g2577e813.el9.x8 1.6 MB/s | 82 kB 00:00 2024-08-17T02:22:56.026 INFO:teuthology.orchestra.run.smithi169.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-08-17T02:22:56.085 INFO:teuthology.orchestra.run.smithi169.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 3.2 MB/s | 304 kB 00:00 2024-08-17T02:22:56.102 INFO:teuthology.orchestra.run.smithi045.stdout:(26/133): rbd-nbd-17.2.7-1375.g2577e813.el9.x86 1.8 MB/s | 165 kB 00:00 2024-08-17T02:22:56.119 INFO:teuthology.orchestra.run.smithi169.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.0 MB/s | 96 kB 00:00 2024-08-17T02:22:56.144 INFO:teuthology.orchestra.run.smithi169.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-17T02:22:56.169 INFO:teuthology.orchestra.run.smithi045.stdout:(27/133): rbd-mirror-17.2.7-1375.g2577e813.el9. 16 MB/s | 2.9 MB 00:00 2024-08-17T02:22:56.186 INFO:teuthology.orchestra.run.smithi045.stdout:(28/133): ceph-grafana-dashboards-17.2.7-1375.g 292 kB/s | 24 kB 00:00 2024-08-17T02:22:56.194 INFO:teuthology.orchestra.run.smithi169.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 598 kB/s | 45 kB 00:00 2024-08-17T02:22:56.228 INFO:teuthology.orchestra.run.smithi045.stdout:(29/133): ceph-mgr-cephadm-17.2.7-1375.g2577e81 2.1 MB/s | 124 kB 00:00 2024-08-17T02:22:56.253 INFO:teuthology.orchestra.run.smithi169.stdout:(87/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.8 MB/s | 309 kB 00:00 2024-08-17T02:22:56.270 INFO:teuthology.orchestra.run.smithi169.stdout:(88/133): liboath-2.6.7-2.el9.x86_64.rpm 668 kB/s | 49 kB 00:00 2024-08-17T02:22:56.295 INFO:teuthology.orchestra.run.smithi169.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.7 MB/s | 67 kB 00:00 2024-08-17T02:22:56.312 INFO:teuthology.orchestra.run.smithi169.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 2.6 MB/s | 43 kB 00:00 2024-08-17T02:22:56.337 INFO:teuthology.orchestra.run.smithi169.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:22:56.363 INFO:teuthology.orchestra.run.smithi169.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 556 kB/s | 14 kB 00:00 2024-08-17T02:22:56.396 INFO:teuthology.orchestra.run.smithi169.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 5.1 MB/s | 172 kB 00:00 2024-08-17T02:22:56.430 INFO:teuthology.orchestra.run.smithi169.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 4.0 MB/s | 548 kB 00:00 2024-08-17T02:22:56.464 INFO:teuthology.orchestra.run.smithi169.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.4 MB/s | 220 kB 00:00 2024-08-17T02:22:56.486 INFO:teuthology.orchestra.run.smithi045.stdout:(30/133): ceph-mgr-dashboard-17.2.7-1375.g2577e 11 MB/s | 3.4 MB 00:00 2024-08-17T02:22:56.497 INFO:teuthology.orchestra.run.smithi169.stdout:(96/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.5 MB/s | 358 kB 00:00 2024-08-17T02:22:56.523 INFO:teuthology.orchestra.run.smithi169.stdout:(97/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2024-08-17T02:22:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:(31/133): ceph-mgr-modules-core-17.2.7-1375.g25 4.0 MB/s | 240 kB 00:00 2024-08-17T02:22:56.571 INFO:teuthology.orchestra.run.smithi169.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 240 kB/s | 18 kB 00:00 2024-08-17T02:22:56.599 INFO:teuthology.orchestra.run.smithi169.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 308 kB/s | 23 kB 00:00 2024-08-17T02:22:56.626 INFO:teuthology.orchestra.run.smithi169.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 375 kB/s | 19 kB 00:00 2024-08-17T02:22:56.649 INFO:teuthology.orchestra.run.smithi169.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-08-17T02:22:56.654 INFO:teuthology.orchestra.run.smithi045.stdout:(32/133): ceph-mgr-diskprediction-local-17.2.7- 17 MB/s | 7.4 MB 00:00 2024-08-17T02:22:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:(33/133): ceph-mgr-rook-17.2.7-1375.g2577e813.e 380 kB/s | 47 kB 00:00 2024-08-17T02:22:56.674 INFO:teuthology.orchestra.run.smithi169.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:22:56.700 INFO:teuthology.orchestra.run.smithi169.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 815 kB/s | 41 kB 00:00 2024-08-17T02:22:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:(34/133): ceph-prometheus-alerts-17.2.7-1375.g2 250 kB/s | 15 kB 00:00 2024-08-17T02:22:56.725 INFO:teuthology.orchestra.run.smithi169.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:22:56.738 INFO:teuthology.orchestra.run.smithi045.stdout:(35/133): ceph-volume-17.2.7-1375.g2577e813.el9 3.9 MB/s | 269 kB 00:00 2024-08-17T02:22:56.750 INFO:teuthology.orchestra.run.smithi169.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:22:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:(36/133): cephadm-17.2.7-1375.g2577e813.el9.noa 1.6 MB/s | 83 kB 00:00 2024-08-17T02:22:56.775 INFO:teuthology.orchestra.run.smithi169.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:22:56.780 INFO:teuthology.orchestra.run.smithi045.stdout:(37/133): cephfs-top-17.2.7-1375.g2577e813.el9. 435 kB/s | 18 kB 00:00 2024-08-17T02:22:56.809 INFO:teuthology.orchestra.run.smithi169.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.1 MB/s | 272 kB 00:00 2024-08-17T02:22:56.834 INFO:teuthology.orchestra.run.smithi169.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 659 kB/s | 16 kB 00:00 2024-08-17T02:22:56.860 INFO:teuthology.orchestra.run.smithi169.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-17T02:22:56.885 INFO:teuthology.orchestra.run.smithi169.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-08-17T02:22:56.918 INFO:teuthology.orchestra.run.smithi169.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 4.2 MB/s | 1.0 MB 00:00 2024-08-17T02:22:56.944 INFO:teuthology.orchestra.run.smithi169.stdout:(112/133): python3-routes-2.5.1-5.el9.noarch.rp 3.2 MB/s | 188 kB 00:00 2024-08-17T02:22:56.969 INFO:teuthology.orchestra.run.smithi169.stdout:(113/133): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-17T02:22:56.995 INFO:teuthology.orchestra.run.smithi169.stdout:(114/133): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-08-17T02:22:57.012 INFO:teuthology.orchestra.run.smithi169.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-08-17T02:22:57.046 INFO:teuthology.orchestra.run.smithi169.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 2.6 MB/s | 90 kB 00:00 2024-08-17T02:22:57.079 INFO:teuthology.orchestra.run.smithi169.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-08-17T02:22:57.098 INFO:teuthology.orchestra.run.smithi169.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 1.0 MB/s | 20 kB 00:00 2024-08-17T02:22:57.132 INFO:teuthology.orchestra.run.smithi169.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 4.8 MB/s | 427 kB 00:00 2024-08-17T02:22:57.190 INFO:teuthology.orchestra.run.smithi169.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 17 MB/s | 1.6 MB 00:00 2024-08-17T02:22:57.414 INFO:teuthology.orchestra.run.smithi045.stdout:(38/133): fuse-2.9.9-16.el9.x86_64.rpm 123 kB/s | 80 kB 00:00 2024-08-17T02:22:57.516 INFO:teuthology.orchestra.run.smithi169.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 10 MB/s | 16 MB 00:01 2024-08-17T02:22:57.683 INFO:teuthology.orchestra.run.smithi169.stdout:(122/133): librbd1-17.2.7-1375.g2577e813.el9.x8 6.0 MB/s | 2.9 MB 00:00 2024-08-17T02:22:57.733 INFO:teuthology.orchestra.run.smithi169.stdout:(123/133): librados2-17.2.7-1375.g2577e813.el9. 5.1 MB/s | 3.1 MB 00:00 2024-08-17T02:22:57.925 INFO:teuthology.orchestra.run.smithi169.stdout:(124/133): NetworkManager-team-1.48.2-2.el9.x86 213 kB/s | 41 kB 00:00 2024-08-17T02:22:58.073 INFO:teuthology.orchestra.run.smithi045.stdout:(39/133): ceph-test-17.2.7-1375.g2577e813.el9.x 15 MB/s | 48 MB 00:03 2024-08-17T02:22:58.148 INFO:teuthology.orchestra.run.smithi045.stdout:(40/133): libgfortran-11.4.1-3.el9.x86_64.rpm 587 kB/s | 803 kB 00:01 2024-08-17T02:22:58.200 INFO:teuthology.orchestra.run.smithi169.stdout:(125/133): NetworkManager-1.48.2-2.el9.x86_64.r 3.4 MB/s | 2.3 MB 00:00 2024-08-17T02:22:58.242 INFO:teuthology.orchestra.run.smithi169.stdout:(126/133): NetworkManager-tui-1.48.2-2.el9.x86_ 780 kB/s | 247 kB 00:00 2024-08-17T02:22:58.301 INFO:teuthology.orchestra.run.smithi169.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 366 kB/s | 37 kB 00:00 2024-08-17T02:22:58.351 INFO:teuthology.orchestra.run.smithi169.stdout:(128/133): elfutils-libelf-0.191-4.el9.x86_64.r 1.9 MB/s | 207 kB 00:00 2024-08-17T02:22:58.401 INFO:teuthology.orchestra.run.smithi169.stdout:(129/133): NetworkManager-libnm-1.48.2-2.el9.x8 2.5 MB/s | 1.8 MB 00:00 2024-08-17T02:22:58.427 INFO:teuthology.orchestra.run.smithi169.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 2.0 MB/s | 260 kB 00:00 2024-08-17T02:22:58.552 INFO:teuthology.orchestra.run.smithi169.stdout:(131/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 8.7 MB/s | 1.1 MB 00:00 2024-08-17T02:22:58.611 INFO:teuthology.orchestra.run.smithi169.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-08-17T02:22:58.644 INFO:teuthology.orchestra.run.smithi169.stdout:(133/133): openssl-3.2.2-2.el9.x86_64.rpm 4.6 MB/s | 1.4 MB 00:00 2024-08-17T02:22:58.648 INFO:teuthology.orchestra.run.smithi169.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:22:58.648 INFO:teuthology.orchestra.run.smithi169.stdout:Total 21 MB/s | 206 MB 00:09 2024-08-17T02:22:58.681 INFO:teuthology.orchestra.run.smithi045.stdout:(41/133): libquadmath-11.4.1-3.el9.x86_64.rpm 154 kB/s | 195 kB 00:01 2024-08-17T02:22:58.882 INFO:teuthology.orchestra.run.smithi045.stdout:(42/133): python3-cffi-1.14.5-5.el9.x86_64.rpm 326 kB/s | 253 kB 00:00 2024-08-17T02:22:59.132 INFO:teuthology.orchestra.run.smithi045.stdout:(43/133): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:00 2024-08-17T02:22:59.390 INFO:teuthology.orchestra.run.smithi045.stdout:(44/133): python3-ply-3.11-14.el9.noarch.rpm 150 kB/s | 106 kB 00:00 2024-08-17T02:22:59.649 INFO:teuthology.orchestra.run.smithi045.stdout:(45/133): python3-pycparser-2.20-6.el9.noarch.r 176 kB/s | 135 kB 00:00 2024-08-17T02:22:59.891 INFO:teuthology.orchestra.run.smithi045.stdout:(46/133): python3-requests-2.25.1-8.el9.noarch. 171 kB/s | 125 kB 00:00 2024-08-17T02:22:59.941 INFO:teuthology.orchestra.run.smithi045.stdout:(47/133): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-08-17T02:22:59.991 INFO:teuthology.orchestra.run.smithi045.stdout:(48/133): elfutils-libelf-devel-0.191-4.el9.x86 435 kB/s | 22 kB 00:00 2024-08-17T02:23:00.050 INFO:teuthology.orchestra.run.smithi045.stdout:(49/133): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 313 kB 00:00 2024-08-17T02:23:00.100 INFO:teuthology.orchestra.run.smithi045.stdout:(50/133): flexiblas-3.0.4-8.el9.x86_64.rpm 658 kB/s | 33 kB 00:00 2024-08-17T02:23:00.184 INFO:teuthology.orchestra.run.smithi045.stdout:(51/133): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-08-17T02:23:00.209 INFO:teuthology.orchestra.run.smithi045.stdout:(52/133): python3-urllib3-1.26.5-6.el9.noarch.r 272 kB/s | 215 kB 00:00 2024-08-17T02:23:00.268 INFO:teuthology.orchestra.run.smithi045.stdout:(53/133): flexiblas-openblas-openmp-3.0.4-8.el9 218 kB/s | 18 kB 00:00 2024-08-17T02:23:00.326 INFO:teuthology.orchestra.run.smithi045.stdout:(54/133): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-08-17T02:23:00.349 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction check 2024-08-17T02:23:00.351 INFO:teuthology.orchestra.run.smithi045.stdout:(55/133): libaio-devel-0.3.111-13.el9.x86_64.rp 78 kB/s | 11 kB 00:00 2024-08-17T02:23:00.387 INFO:teuthology.orchestra.run.smithi045.stdout:(56/133): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-08-17T02:23:00.412 INFO:teuthology.orchestra.run.smithi045.stdout:(57/133): librabbitmq-0.11.0-7.el9.x86_64.rpm 528 kB/s | 45 kB 00:00 2024-08-17T02:23:00.446 INFO:teuthology.orchestra.run.smithi045.stdout:(58/133): libtool-2.4.6-46.el9.x86_64.rpm 9.7 MB/s | 581 kB 00:00 2024-08-17T02:23:00.472 INFO:teuthology.orchestra.run.smithi045.stdout:(59/133): libuuid-devel-2.37.4-18.el9.x86_64.rp 435 kB/s | 25 kB 00:00 2024-08-17T02:23:00.497 INFO:teuthology.orchestra.run.smithi045.stdout:(60/133): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-08-17T02:23:00.530 INFO:teuthology.orchestra.run.smithi045.stdout:(61/133): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-08-17T02:23:00.556 INFO:teuthology.orchestra.run.smithi045.stdout:(62/133): openblas-0.3.21-2.el9.x86_64.rpm 603 kB/s | 35 kB 00:00 2024-08-17T02:23:00.559 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction check succeeded. 2024-08-17T02:23:00.559 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction test 2024-08-17T02:23:00.590 INFO:teuthology.orchestra.run.smithi045.stdout:(63/133): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-08-17T02:23:00.732 INFO:teuthology.orchestra.run.smithi045.stdout:(64/133): openblas-openmp-0.3.21-2.el9.x86_64.r 24 MB/s | 4.7 MB 00:00 2024-08-17T02:23:00.807 INFO:teuthology.orchestra.run.smithi045.stdout:(65/133): openssl-devel-3.2.2-2.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-08-17T02:23:00.832 INFO:teuthology.orchestra.run.smithi045.stdout:(66/133): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-08-17T02:23:00.865 INFO:teuthology.orchestra.run.smithi045.stdout:(67/133): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-08-17T02:23:00.891 INFO:teuthology.orchestra.run.smithi045.stdout:(68/133): python3-jsonpatch-1.21-16.el9.noarch. 437 kB/s | 26 kB 00:00 2024-08-17T02:23:00.908 INFO:teuthology.orchestra.run.smithi045.stdout:(69/133): python3-jsonpointer-2.0-4.el9.noarch. 456 kB/s | 19 kB 00:00 2024-08-17T02:23:01.000 INFO:teuthology.orchestra.run.smithi045.stdout:(70/133): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-08-17T02:23:01.017 INFO:teuthology.orchestra.run.smithi045.stdout:(71/133): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-08-17T02:23:01.042 INFO:teuthology.orchestra.run.smithi045.stdout:(72/133): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-08-17T02:23:01.084 INFO:teuthology.orchestra.run.smithi045.stdout:(73/133): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-08-17T02:23:01.127 INFO:teuthology.orchestra.run.smithi045.stdout:(74/133): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-08-17T02:23:01.159 INFO:teuthology.orchestra.run.smithi045.stdout:(75/133): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-08-17T02:23:01.185 INFO:teuthology.orchestra.run.smithi045.stdout:(76/133): python3-prettytable-0.7.2-27.el9.noar 731 kB/s | 42 kB 00:00 2024-08-17T02:23:01.219 INFO:teuthology.orchestra.run.smithi045.stdout:(77/133): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-08-17T02:23:01.243 INFO:teuthology.orchestra.run.smithi045.stdout:(78/133): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-08-17T02:23:01.319 INFO:teuthology.orchestra.run.smithi045.stdout:(79/133): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 5.1 MB 00:00 2024-08-17T02:23:01.345 INFO:teuthology.orchestra.run.smithi045.stdout:(80/133): python3-pytz-2021.1-5.el9.noarch.rpm 406 kB/s | 51 kB 00:00 2024-08-17T02:23:01.370 INFO:teuthology.orchestra.run.smithi045.stdout:(81/133): python3-requests-oauthlib-1.3.0-12.el 427 kB/s | 54 kB 00:00 2024-08-17T02:23:01.428 INFO:teuthology.orchestra.run.smithi045.stdout:(82/133): python3-toml-0.10.2-6.el9.noarch.rpm 720 kB/s | 42 kB 00:00 2024-08-17T02:23:01.453 INFO:teuthology.orchestra.run.smithi045.stdout:(83/133): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-08-17T02:23:01.487 INFO:teuthology.orchestra.run.smithi045.stdout:(84/133): xfsprogs-devel-6.4.0-3.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-08-17T02:23:01.513 INFO:teuthology.orchestra.run.smithi045.stdout:(85/133): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-17T02:23:01.596 INFO:teuthology.orchestra.run.smithi045.stdout:(86/133): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-08-17T02:23:01.663 INFO:teuthology.orchestra.run.smithi045.stdout:(87/133): gperftools-libs-2.9.1-2.el9.x86_64.rp 2.0 MB/s | 309 kB 00:00 2024-08-17T02:23:01.697 INFO:teuthology.orchestra.run.smithi045.stdout:(88/133): liboath-2.6.7-2.el9.x86_64.rpm 498 kB/s | 49 kB 00:00 2024-08-17T02:23:01.722 INFO:teuthology.orchestra.run.smithi045.stdout:(89/133): libunwind-1.6.2-1.el9.x86_64.rpm 1.2 MB/s | 67 kB 00:00 2024-08-17T02:23:01.749 INFO:teuthology.orchestra.run.smithi045.stdout:(90/133): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 1.7 MB/s | 43 kB 00:00 2024-08-17T02:23:01.773 INFO:teuthology.orchestra.run.smithi045.stdout:(91/133): python3-cachetools-4.2.4-1.el9.noarch 1.3 MB/s | 32 kB 00:00 2024-08-17T02:23:01.798 INFO:teuthology.orchestra.run.smithi045.stdout:(92/133): python3-certifi-2023.05.07-4.el9.noar 567 kB/s | 14 kB 00:00 2024-08-17T02:23:01.840 INFO:teuthology.orchestra.run.smithi045.stdout:(93/133): python3-cheroot-8.6.0-4.el9.noarch.rp 4.0 MB/s | 172 kB 00:00 2024-08-17T02:23:01.865 INFO:teuthology.orchestra.run.smithi045.stdout:(94/133): python3-asyncssh-2.13.2-5.el9.noarch. 3.8 MB/s | 548 kB 00:00 2024-08-17T02:23:01.899 INFO:teuthology.orchestra.run.smithi045.stdout:(95/133): python3-google-auth-2.33.0-1.el9.noar 6.5 MB/s | 220 kB 00:00 2024-08-17T02:23:01.924 INFO:teuthology.orchestra.run.smithi045.stdout:(96/133): python3-jaraco-8.2.1-3.el9.noarch.rpm 430 kB/s | 11 kB 00:00 2024-08-17T02:23:01.950 INFO:teuthology.orchestra.run.smithi045.stdout:(97/133): python3-cherrypy-18.6.1-2.el9.noarch. 3.2 MB/s | 358 kB 00:00 2024-08-17T02:23:01.975 INFO:teuthology.orchestra.run.smithi045.stdout:(98/133): python3-jaraco-classes-3.2.1-5.el9.no 352 kB/s | 18 kB 00:00 2024-08-17T02:23:02.022 INFO:teuthology.orchestra.run.smithi045.stdout:(99/133): python3-jaraco-collections-3.0.0-8.el 320 kB/s | 23 kB 00:00 2024-08-17T02:23:02.050 INFO:teuthology.orchestra.run.smithi045.stdout:(100/133): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-08-17T02:23:02.076 INFO:teuthology.orchestra.run.smithi045.stdout:(101/133): python3-jaraco-text-3.2.0-6.el9.noar 371 kB/s | 20 kB 00:00 2024-08-17T02:23:02.101 INFO:teuthology.orchestra.run.smithi045.stdout:(102/133): python3-jwt+crypto-2.4.0-1.el9.noarc 180 kB/s | 9.0 kB 00:00 2024-08-17T02:23:02.126 INFO:teuthology.orchestra.run.smithi045.stdout:(103/133): python3-jwt-2.4.0-1.el9.noarch.rpm 816 kB/s | 41 kB 00:00 2024-08-17T02:23:02.165 INFO:teuthology.orchestra.run.smithi045.stdout:(104/133): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-17T02:23:02.177 INFO:teuthology.orchestra.run.smithi045.stdout:(105/133): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-17T02:23:02.202 INFO:teuthology.orchestra.run.smithi045.stdout:(106/133): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-17T02:23:02.236 INFO:teuthology.orchestra.run.smithi045.stdout:(107/133): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-17T02:23:02.261 INFO:teuthology.orchestra.run.smithi045.stdout:(108/133): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-08-17T02:23:02.292 INFO:teuthology.orchestra.run.smithi045.stdout:(109/133): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.9 MB/s | 90 kB 00:00 2024-08-17T02:23:02.320 INFO:teuthology.orchestra.run.smithi045.stdout:(110/133): python3-repoze-lru-0.7-16.el9.noarch 1.1 MB/s | 31 kB 00:00 2024-08-17T02:23:02.362 INFO:teuthology.orchestra.run.smithi045.stdout:(111/133): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-08-17T02:23:02.388 INFO:teuthology.orchestra.run.smithi045.stdout:(112/133): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-17T02:23:02.413 INFO:teuthology.orchestra.run.smithi045.stdout:(113/133): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-08-17T02:23:02.439 INFO:teuthology.orchestra.run.smithi045.stdout:(114/133): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-08-17T02:23:02.489 INFO:teuthology.orchestra.run.smithi045.stdout:(115/133): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-08-17T02:23:02.514 INFO:teuthology.orchestra.run.smithi045.stdout:(116/133): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-08-17T02:23:02.540 INFO:teuthology.orchestra.run.smithi045.stdout:(117/133): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-17T02:23:02.557 INFO:teuthology.orchestra.run.smithi045.stdout:(118/133): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-08-17T02:23:02.590 INFO:teuthology.orchestra.run.smithi045.stdout:(119/133): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-08-17T02:23:02.611 INFO:teuthology.orchestra.run.smithi169.stdout:Transaction test succeeded. 2024-08-17T02:23:02.612 INFO:teuthology.orchestra.run.smithi169.stdout:Running transaction 2024-08-17T02:23:02.657 INFO:teuthology.orchestra.run.smithi045.stdout:(120/133): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-17T02:23:02.824 INFO:teuthology.orchestra.run.smithi045.stdout:(121/133): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-08-17T02:23:03.324 INFO:teuthology.orchestra.run.smithi045.stdout:(122/133): librados2-17.2.7-1375.g2577e813.el9. 4.2 MB/s | 3.1 MB 00:00 2024-08-17T02:23:03.400 INFO:teuthology.orchestra.run.smithi045.stdout:(123/133): librbd1-17.2.7-1375.g2577e813.el9.x8 4.0 MB/s | 2.9 MB 00:00 2024-08-17T02:23:03.867 INFO:teuthology.orchestra.run.smithi045.stdout:(124/133): NetworkManager-1.48.2-2.el9.x86_64.r 2.2 MB/s | 2.3 MB 00:01 2024-08-17T02:23:04.134 INFO:teuthology.orchestra.run.smithi045.stdout:(125/133): NetworkManager-team-1.48.2-2.el9.x86 56 kB/s | 41 kB 00:00 2024-08-17T02:23:04.501 INFO:teuthology.orchestra.run.smithi045.stdout:(126/133): NetworkManager-libnm-1.48.2-2.el9.x8 1.5 MB/s | 1.8 MB 00:01 2024-08-17T02:23:04.776 INFO:teuthology.orchestra.run.smithi045.stdout:(127/133): elfutils-debuginfod-client-0.191-4.e 57 kB/s | 37 kB 00:00 2024-08-17T02:23:04.801 INFO:teuthology.orchestra.run.smithi045.stdout:(128/133): NetworkManager-tui-1.48.2-2.el9.x86_ 265 kB/s | 247 kB 00:00 2024-08-17T02:23:05.251 INFO:teuthology.orchestra.run.smithi045.stdout:(129/133): elfutils-libelf-0.191-4.el9.x86_64.r 276 kB/s | 207 kB 00:00 2024-08-17T02:23:05.610 INFO:teuthology.orchestra.run.smithi045.stdout:(130/133): elfutils-libs-0.191-4.el9.x86_64.rpm 311 kB/s | 260 kB 00:00 2024-08-17T02:23:05.835 INFO:teuthology.orchestra.run.smithi045.stdout:(131/133): openssl-3.2.2-2.el9.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2024-08-17T02:23:06.277 INFO:teuthology.orchestra.run.smithi045.stdout:(132/133): openssl-libs-3.2.2-2.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-08-17T02:23:06.635 INFO:teuthology.orchestra.run.smithi045.stdout:(133/133): xfsprogs-6.4.0-3.el9.x86_64.rpm 1.1 MB/s | 1.1 MB 00:01 2024-08-17T02:23:06.643 INFO:teuthology.orchestra.run.smithi045.stdout:-------------------------------------------------------------------------------- 2024-08-17T02:23:06.643 INFO:teuthology.orchestra.run.smithi045.stdout:Total 15 MB/s | 206 MB 00:13 2024-08-17T02:23:08.380 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction check 2024-08-17T02:23:08.435 INFO:teuthology.orchestra.run.smithi169.stdout: Preparing : 1/1 2024-08-17T02:23:08.525 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:23:08.579 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:23:08.608 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction check succeeded. 2024-08-17T02:23:08.609 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction test 2024-08-17T02:23:08.650 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:23:08.702 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:23:08.734 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:23:08.789 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:23:09.122 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:23:09.226 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:23:09.387 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:23:09.419 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:23:09.535 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:23:10.010 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:23:10.037 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:23:10.143 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:23:10.221 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:23:10.248 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:23:10.370 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:23:10.407 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:23:10.551 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:23:10.836 INFO:teuthology.orchestra.run.smithi045.stdout:Transaction test succeeded. 2024-08-17T02:23:10.836 INFO:teuthology.orchestra.run.smithi045.stdout:Running transaction 2024-08-17T02:23:10.855 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:23:11.064 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:23:11.142 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:23:11.262 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:23:11.375 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:23:11.728 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:23:11.773 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:23:11.817 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:23:11.900 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:23:11.950 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:23:11.984 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:23:12.081 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:23:12.144 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:23:12.188 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:23:12.243 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:23:12.322 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:23:12.358 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:23:12.404 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:23:12.505 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:23:12.664 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:23:12.727 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:23:13.398 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:23:13.526 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:23:13.568 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:23:13.623 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:23:13.666 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:23:13.704 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:23:13.757 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:23:14.005 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:23:14.065 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:23:14.151 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:23:14.198 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:23:14.234 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:23:14.293 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:23:14.345 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:23:14.395 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:23:14.575 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:23:14.628 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:23:14.674 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:23:14.790 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:23:14.838 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:23:14.881 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:23:14.911 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:23:14.948 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:23:14.986 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:23:15.023 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:23:15.058 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:23:15.091 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:23:15.134 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:23:15.167 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:23:15.202 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:23:15.252 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:23:15.375 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:23:15.434 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:23:16.313 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:23:16.369 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:23:16.402 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:23:16.516 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:23:16.561 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:23:16.806 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:23:16.838 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:23:16.921 INFO:teuthology.orchestra.run.smithi045.stdout: Preparing : 1/1 2024-08-17T02:23:16.937 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:23:17.016 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/145 2024-08-17T02:23:17.067 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/145 2024-08-17T02:23:17.142 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/145 2024-08-17T02:23:17.185 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/145 2024-08-17T02:23:17.217 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/145 2024-08-17T02:23:17.277 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/145 2024-08-17T02:23:17.623 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/145 2024-08-17T02:23:17.745 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:23:17.767 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:23:17.880 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:23:17.898 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:23:17.935 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:23:18.079 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:23:18.589 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:23:18.620 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:23:18.719 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:23:18.788 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/145 2024-08-17T02:23:18.822 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:23:18.984 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:23:19.014 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:23:19.173 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 14/145 2024-08-17T02:23:19.447 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 15/145 2024-08-17T02:23:19.476 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:23:19.572 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:23:19.608 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:23:19.642 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:23:19.663 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:23:19.732 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 16/145 2024-08-17T02:23:19.843 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:23:19.991 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:23:20.000 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:23:20.045 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:23:20.161 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:23:20.188 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:23:20.351 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 17/145 2024-08-17T02:23:20.397 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/145 2024-08-17T02:23:20.442 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/145 2024-08-17T02:23:20.527 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/145 2024-08-17T02:23:20.575 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/145 2024-08-17T02:23:20.608 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/145 2024-08-17T02:23:20.709 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 23/145 2024-08-17T02:23:20.779 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 24/145 2024-08-17T02:23:20.811 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 25/145 2024-08-17T02:23:20.860 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 26/145 2024-08-17T02:23:20.949 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 27/145 2024-08-17T02:23:20.982 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 28/145 2024-08-17T02:23:21.028 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 29/145 2024-08-17T02:23:21.126 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 30/145 2024-08-17T02:23:21.310 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 31/145 2024-08-17T02:23:21.385 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 32/145 2024-08-17T02:23:22.070 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rsa-4.9-2.el9.noarch 33/145 2024-08-17T02:23:22.179 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 34/145 2024-08-17T02:23:22.223 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 35/145 2024-08-17T02:23:22.397 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 36/145 2024-08-17T02:23:22.606 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 37/145 2024-08-17T02:23:22.645 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 38/145 2024-08-17T02:23:22.699 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/145 2024-08-17T02:23:22.736 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 40/145 2024-08-17T02:23:22.738 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:23:22.777 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:23:22.798 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/145 2024-08-17T02:23:22.885 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/145 2024-08-17T02:23:22.937 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 43/145 2024-08-17T02:23:22.974 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/145 2024-08-17T02:23:23.033 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/145 2024-08-17T02:23:23.085 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/145 2024-08-17T02:23:23.143 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/145 2024-08-17T02:23:23.325 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/145 2024-08-17T02:23:23.376 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/145 2024-08-17T02:23:23.390 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:23:23.419 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/145 2024-08-17T02:23:23.439 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:23:23.552 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/145 2024-08-17T02:23:23.575 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:23:23.575 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:23:23.575 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:23:23.575 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:23.601 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-google-auth-1:2.33.0-1.el9.noarch 52/145 2024-08-17T02:23:23.606 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:23:23.644 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/145 2024-08-17T02:23:23.682 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 54/145 2024-08-17T02:23:23.720 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 55/145 2024-08-17T02:23:23.758 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 56/145 2024-08-17T02:23:23.804 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 57/145 2024-08-17T02:23:23.838 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 58/145 2024-08-17T02:23:23.871 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 59/145 2024-08-17T02:23:23.915 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 60/145 2024-08-17T02:23:23.947 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 61/145 2024-08-17T02:23:23.982 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 62/145 2024-08-17T02:23:24.034 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 63/145 2024-08-17T02:23:24.169 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-packaging-20.9-5.el9.noarch 64/145 2024-08-17T02:23:24.256 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 65/145 2024-08-17T02:23:25.217 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 66/145 2024-08-17T02:23:25.273 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 67/145 2024-08-17T02:23:25.307 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 68/145 2024-08-17T02:23:25.446 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:23:25.490 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 70/145 2024-08-17T02:23:25.733 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-0.3.21-2.el9.x86_64 71/145 2024-08-17T02:23:25.770 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 72/145 2024-08-17T02:23:25.871 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 73/145 2024-08-17T02:23:26.741 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 74/145 2024-08-17T02:23:26.897 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 75/145 2024-08-17T02:23:28.593 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 76/145 2024-08-17T02:23:28.692 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 77/145 2024-08-17T02:23:28.728 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 78/145 2024-08-17T02:23:28.761 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 79/145 2024-08-17T02:23:29.095 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 80/145 2024-08-17T02:23:29.147 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:23:29.265 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 81/145 2024-08-17T02:23:29.291 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 82/145 2024-08-17T02:23:32.050 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:23:32.087 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:23:32.721 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 83/145 2024-08-17T02:23:32.766 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:23:32.899 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 84/145 2024-08-17T02:23:32.899 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-17T02:23:32.899 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-17T02:23:32.900 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:23:32.924 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:23:35.719 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:23:35.719 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /sys 2024-08-17T02:23:35.719 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /proc 2024-08-17T02:23:35.719 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /mnt 2024-08-17T02:23:35.719 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /var/tmp 2024-08-17T02:23:35.719 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /home 2024-08-17T02:23:35.720 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /root 2024-08-17T02:23:35.720 INFO:teuthology.orchestra.run.smithi169.stdout:skipping the directory /tmp 2024-08-17T02:23:35.720 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:35.913 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:23:35.948 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:23:35.948 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:35.948 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:23:35.948 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:37.458 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:23:37.517 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:23:37.517 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:37.518 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:23:37.518 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:23:37.518 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:23:37.518 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:37.759 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:23:37.810 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:23:37.811 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:37.811 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:23:37.811 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:23:37.811 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:23:37.811 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:38.218 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:23:38.269 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:23:38.269 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:38.269 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:23:38.269 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:23:38.269 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:23:38.269 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:38.393 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:23:38.453 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:23:38.517 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:23:38.750 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:23:38.814 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:23:38.899 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:23:39.008 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:23:39.180 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:23:39.235 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:23:39.261 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:23:39.296 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:23:39.346 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:23:39.371 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:23:39.866 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:23:39.904 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:23:39.934 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:23:39.994 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:23:40.043 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:23:41.206 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:23:41.245 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:23:42.338 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:23:42.370 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:23:42.507 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:23:42.675 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:23:42.706 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:23:42.759 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:23:42.759 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:42.759 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:23:42.759 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:23:42.759 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:23:42.759 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:42.798 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:23:42.825 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:23:42.918 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:23:42.985 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:23:44.331 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:23:44.367 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:23:44.481 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:23:44.481 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:44.482 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:23:44.482 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:23:44.482 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:23:44.482 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:44.527 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:23:44.577 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:23:44.577 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:44.577 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:23:44.577 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:44.636 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:23:44.688 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:23:44.688 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:44.688 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:23:44.688 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:23:44.688 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:23:44.688 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:45.003 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:23:45.054 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:23:45.055 INFO:teuthology.orchestra.run.smithi169.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:45.055 INFO:teuthology.orchestra.run.smithi169.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:23:45.055 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:23:45.055 INFO:teuthology.orchestra.run.smithi169.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:23:45.055 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:45.088 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 85/145 2024-08-17T02:23:45.088 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /sys 2024-08-17T02:23:45.089 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /proc 2024-08-17T02:23:45.089 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /mnt 2024-08-17T02:23:45.089 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /var/tmp 2024-08-17T02:23:45.089 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /home 2024-08-17T02:23:45.089 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /root 2024-08-17T02:23:45.089 INFO:teuthology.orchestra.run.smithi045.stdout:skipping the directory /tmp 2024-08-17T02:23:45.089 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:23:45.309 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:23:45.345 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 86/145 2024-08-17T02:23:45.345 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:45.345 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-17T02:23:45.345 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:23:46.869 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:23:46.928 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 87/145 2024-08-17T02:23:46.928 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:46.928 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-17T02:23:46.928 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:23:46.928 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-17T02:23:46.928 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:23:47.170 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:23:47.221 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 88/145 2024-08-17T02:23:47.221 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:47.221 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-17T02:23:47.221 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:23:47.221 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-17T02:23:47.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:23:47.665 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:23:47.716 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 89/145 2024-08-17T02:23:47.716 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:47.717 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-17T02:23:47.717 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:23:47.717 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-17T02:23:47.717 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:23:47.855 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : automake-1.16.2-8.el9.noarch 90/145 2024-08-17T02:23:47.916 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-ply-3.11-14.el9.noarch 91/145 2024-08-17T02:23:47.990 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 92/145 2024-08-17T02:23:48.227 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 93/145 2024-08-17T02:23:48.284 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 94/145 2024-08-17T02:23:48.372 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 95/145 2024-08-17T02:23:48.484 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/145 2024-08-17T02:23:48.664 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 97/145 2024-08-17T02:23:48.723 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 98/145 2024-08-17T02:23:48.748 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 99/145 2024-08-17T02:23:48.784 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 100/145 2024-08-17T02:23:48.825 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 101/145 2024-08-17T02:23:48.850 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : fuse-2.9.9-16.el9.x86_64 102/145 2024-08-17T02:23:49.353 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:23:49.398 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 103/145 2024-08-17T02:23:49.455 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 104/145 2024-08-17T02:23:49.527 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 105/145 2024-08-17T02:23:49.555 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:23:49.757 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:23:49.799 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:23:49.842 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:23:49.880 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:23:49.905 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:23:49.940 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:23:49.980 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:23:50.011 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:23:50.059 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:23:50.806 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 106/145 2024-08-17T02:23:50.857 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:23:51.362 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:23:51.621 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:23:51.687 INFO:teuthology.orchestra.run.smithi169.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:23:51.735 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:23:51.837 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:23:51.875 INFO:teuthology.orchestra.run.smithi169.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:23:51.900 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:23:51.925 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:23:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:23:51.954 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:23:52.016 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 107/145 2024-08-17T02:23:52.049 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:23:52.053 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:23:52.085 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:23:52.085 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:23:52.195 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 108/145 2024-08-17T02:23:52.212 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:23:52.236 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:23:52.262 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:23:52.262 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:23:52.370 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 109/145 2024-08-17T02:23:52.402 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:23:52.454 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 110/145 2024-08-17T02:23:52.454 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:52.454 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-17T02:23:52.454 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:23:52.454 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-17T02:23:52.454 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:23:52.505 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:23:52.506 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:23:52.532 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:23:52.559 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 111/145 2024-08-17T02:23:52.616 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:23:52.648 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:23:52.667 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 112/145 2024-08-17T02:23:52.684 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:23:52.731 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 113/145 2024-08-17T02:23:52.765 INFO:teuthology.orchestra.run.smithi169.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:23:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:23:52.969 INFO:teuthology.orchestra.run.smithi169.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:23:52.969 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:23:54.136 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libtool-2.4.6-46.el9.x86_64 114/145 2024-08-17T02:23:54.164 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:23:54.278 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 115/145 2024-08-17T02:23:54.278 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:54.278 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-17T02:23:54.278 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:23:54.278 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-17T02:23:54.278 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:23:54.332 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:23:54.383 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1375.g2577e 116/145 2024-08-17T02:23:54.383 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:54.383 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-17T02:23:54.383 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:23:54.440 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:23:54.493 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 117/145 2024-08-17T02:23:54.493 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:54.493 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-17T02:23:54.493 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:23:54.493 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-17T02:23:54.494 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:23:54.825 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:23:54.876 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 118/145 2024-08-17T02:23:54.876 INFO:teuthology.orchestra.run.smithi045.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-17T02:23:54.876 INFO:teuthology.orchestra.run.smithi045.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-17T02:23:54.877 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:23:54.877 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-17T02:23:54.877 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:23:58.317 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:23:58.317 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:23:58.317 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:23:58.317 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:23:58.317 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:23:58.318 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:23:58.318 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:23:58.318 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:23:58.318 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:23:58.318 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:23:58.318 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:23:58.318 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:23:58.318 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:23:58.318 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:23:58.318 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:23:58.319 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:23:58.319 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:23:58.319 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:23:58.319 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:23:58.319 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:23:58.319 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:23:58.319 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:23:58.319 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:23:58.319 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:23:58.319 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:23:58.320 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:23:58.320 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:23:58.320 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:23:58.320 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:23:58.320 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:23:58.320 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:23:58.320 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:23:58.320 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:23:58.320 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:23:58.320 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:23:58.321 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:23:58.322 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:23:58.322 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:23:58.322 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:23:58.322 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:23:58.322 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:23:58.322 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:23:58.322 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:23:58.322 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:23:58.322 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:23:58.322 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:23:58.323 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:23:58.324 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:23:58.324 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:23:58.324 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:23:58.324 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:23:58.324 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:23:58.324 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:23:58.324 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:23:58.324 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:23:58.324 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:23:58.325 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:23:58.325 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:23:58.325 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:23:58.325 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:23:58.325 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:23:58.325 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:23:58.325 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:23:58.325 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:23:58.325 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:23:58.325 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:23:58.326 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:23:58.326 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:23:58.326 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:23:58.326 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:23:58.326 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:23:58.326 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:23:58.326 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:23:58.326 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:23:58.326 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:23:58.327 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:23:58.327 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:23:58.327 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:23:58.327 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:23:58.327 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:23:58.327 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:23:58.327 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:23:58.327 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:23:58.327 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:23:58.327 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:23:58.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:23:58.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:23:58.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:23:58.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:23:58.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:23:58.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:23:58.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:23:58.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:23:58.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:23:58.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:23:58.328 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:23:58.329 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:23:58.330 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:23:58.330 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:23:58.330 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:23:58.330 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:23:58.330 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:23:58.330 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:23:58.330 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:23:58.330 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:23:58.330 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:23:58.330 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:23:58.330 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:23:58.331 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:23:58.331 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:23:58.331 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:23:59.879 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 119/145 2024-08-17T02:23:59.930 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 120/145 2024-08-17T02:23:59.974 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 121/145 2024-08-17T02:24:00.032 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 122/145 2024-08-17T02:24:00.070 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 123/145 2024-08-17T02:24:00.104 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 124/145 2024-08-17T02:24:00.152 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 125/145 2024-08-17T02:24:00.184 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:24:00.232 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 127/145 2024-08-17T02:24:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:24:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:00.261 INFO:teuthology.orchestra.run.smithi169.stdout:Upgraded: 2024-08-17T02:24:00.261 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:24:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:24:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:24:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:00.262 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout:Installed: 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:00.263 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.264 INFO:teuthology.orchestra.run.smithi169.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.265 INFO:teuthology.orchestra.run.smithi169.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:24:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:24:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:24:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:24:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:24:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:24:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:24:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:24:00.266 INFO:teuthology.orchestra.run.smithi169.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.267 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:24:00.268 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:24:00.269 INFO:teuthology.orchestra.run.smithi169.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.270 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:24:00.271 INFO:teuthology.orchestra.run.smithi169.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:24:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:24:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:24:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:24:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:24:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:24:00.272 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:00.272 INFO:teuthology.orchestra.run.smithi169.stdout:Complete! 2024-08-17T02:24:00.899 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:01.633 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 128/145 2024-08-17T02:24:01.905 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 129/145 2024-08-17T02:24:01.970 INFO:teuthology.orchestra.run.smithi045.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 130/145 2024-08-17T02:24:02.032 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 131/145 2024-08-17T02:24:02.149 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : flex-2.6.4-9.el9.x86_64 132/145 2024-08-17T02:24:02.182 INFO:teuthology.orchestra.run.smithi045.stdout: Installing : bison-3.7.4-5.el9.x86_64 133/145 2024-08-17T02:24:02.238 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 134/145 2024-08-17T02:24:02.274 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:24:02.303 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 136/145 2024-08-17T02:24:02.303 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:24:02.412 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 137/145 2024-08-17T02:24:02.443 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 138/145 2024-08-17T02:24:02.443 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:24:02.553 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 139/145 2024-08-17T02:24:02.578 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 140/145 2024-08-17T02:24:02.598 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:24:02.598 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:24:02.964 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 141/145 2024-08-17T02:24:02.964 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:24:03.085 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 142/145 2024-08-17T02:24:03.140 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:24:03.173 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 144/145 2024-08-17T02:24:03.251 INFO:teuthology.orchestra.run.smithi045.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:24:03.563 INFO:teuthology.orchestra.run.smithi045.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:24:03.563 INFO:teuthology.orchestra.run.smithi045.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-08-17T02:24:03.564 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-2:17.2.7-1375.g2577e813.el9.x86_64 1/145 2024-08-17T02:24:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2/145 2024-08-17T02:24:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 3/145 2024-08-17T02:24:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 4/145 2024-08-17T02:24:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1375.g2577e 5/145 2024-08-17T02:24:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 6/145 2024-08-17T02:24:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 7/145 2024-08-17T02:24:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 8/145 2024-08-17T02:24:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 9/145 2024-08-17T02:24:08.777 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 10/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 11/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 12/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 13/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_ 14/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 15/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 16/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados-devel-2:17.2.7-1375.g2577e813.el9.x86_6 17/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86 18/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 19/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1375.g2577e813.el 20/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ceph-common-2:17.2.7-1375.g2577e813.el9. 21/145 2024-08-17T02:24:08.778 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_6 22/145 2024-08-17T02:24:08.779 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 23/145 2024-08-17T02:24:08.779 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 24/145 2024-08-17T02:24:08.779 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 25/145 2024-08-17T02:24:08.779 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 26/145 2024-08-17T02:24:08.779 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 27/145 2024-08-17T02:24:08.789 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 28/145 2024-08-17T02:24:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1375.g2577e813. 29/145 2024-08-17T02:24:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noa 30/145 2024-08-17T02:24:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.n 31/145 2024-08-17T02:24:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1375.g257 32/145 2024-08-17T02:24:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el 33/145 2024-08-17T02:24:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 34/145 2024-08-17T02:24:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.e 35/145 2024-08-17T02:24:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 36/145 2024-08-17T02:24:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephadm-2:17.2.7-1375.g2577e813.el9.noarch 37/145 2024-08-17T02:24:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 38/145 2024-08-17T02:24:08.790 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 40/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 41/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 50/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flex-2.6.4-9.el9.x86_64 51/145 2024-08-17T02:24:08.791 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 52/145 2024-08-17T02:24:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 53/145 2024-08-17T02:24:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 54/145 2024-08-17T02:24:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 55/145 2024-08-17T02:24:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 56/145 2024-08-17T02:24:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 57/145 2024-08-17T02:24:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 58/145 2024-08-17T02:24:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 59/145 2024-08-17T02:24:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 60/145 2024-08-17T02:24:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 61/145 2024-08-17T02:24:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 62/145 2024-08-17T02:24:08.792 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 63/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 64/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 65/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 66/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 67/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 68/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 69/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 70/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 71/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 72/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 73/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 74/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 75/145 2024-08-17T02:24:08.793 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 76/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 77/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 78/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 79/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 80/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 82/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 83/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 84/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 85/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 86/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 87/145 2024-08-17T02:24:08.794 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 88/145 2024-08-17T02:24:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 89/145 2024-08-17T02:24:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 90/145 2024-08-17T02:24:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 91/145 2024-08-17T02:24:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 92/145 2024-08-17T02:24:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 93/145 2024-08-17T02:24:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 94/145 2024-08-17T02:24:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 95/145 2024-08-17T02:24:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 96/145 2024-08-17T02:24:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-google-auth-1:2.33.0-1.el9.noarch 97/145 2024-08-17T02:24:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 98/145 2024-08-17T02:24:08.795 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 99/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 100/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 101/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 102/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 103/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 104/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 105/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 106/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 107/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 108/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 109/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 110/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 111/145 2024-08-17T02:24:08.796 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 112/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 113/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 114/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 115/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 116/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 117/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 118/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 119/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 120/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 121/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:17.2.7-1375.g2577e813.el9.x86_64 122/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 123/145 2024-08-17T02:24:08.797 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 124/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 125/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 126/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 127/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 128/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 129/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 130/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 131/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 132/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 133/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 134/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 135/145 2024-08-17T02:24:08.798 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 136/145 2024-08-17T02:24:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 137/145 2024-08-17T02:24:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 138/145 2024-08-17T02:24:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 139/145 2024-08-17T02:24:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 140/145 2024-08-17T02:24:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 141/145 2024-08-17T02:24:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 142/145 2024-08-17T02:24:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 143/145 2024-08-17T02:24:08.799 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 144/145 2024-08-17T02:24:10.749 INFO:teuthology.orchestra.run.smithi045.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 145/145 2024-08-17T02:24:10.749 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:10.749 INFO:teuthology.orchestra.run.smithi045.stdout:Upgraded: 2024-08-17T02:24:10.749 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:10.749 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:10.749 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:10.749 INFO:teuthology.orchestra.run.smithi045.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-17T02:24:10.749 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-17T02:24:10.749 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-17T02:24:10.750 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-17T02:24:10.750 INFO:teuthology.orchestra.run.smithi045.stdout: librados2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.750 INFO:teuthology.orchestra.run.smithi045.stdout: librbd1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.750 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:10.750 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:10.750 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-17T02:24:10.750 INFO:teuthology.orchestra.run.smithi045.stdout:Installed: 2024-08-17T02:24:10.750 INFO:teuthology.orchestra.run.smithi045.stdout: automake-1.16.2-8.el9.noarch 2024-08-17T02:24:10.750 INFO:teuthology.orchestra.run.smithi045.stdout: bison-3.7.4-5.el9.x86_64 2024-08-17T02:24:10.750 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.750 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-grafana-dashboards-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-immutable-object-cache-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mds-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-rook-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:10.751 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mon-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.752 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-osd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.752 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-prometheus-alerts-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:10.752 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-radosgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.752 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-selinux-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.752 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-test-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.752 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-volume-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:10.752 INFO:teuthology.orchestra.run.smithi045.stdout: cephadm-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:10.752 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.752 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-top-2:17.2.7-1375.g2577e813.el9.noarch 2024-08-17T02:24:10.752 INFO:teuthology.orchestra.run.smithi045.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-17T02:24:10.753 INFO:teuthology.orchestra.run.smithi045.stdout: flex-2.6.4-9.el9.x86_64 2024-08-17T02:24:10.753 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-17T02:24:10.753 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-17T02:24:10.753 INFO:teuthology.orchestra.run.smithi045.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-17T02:24:10.753 INFO:teuthology.orchestra.run.smithi045.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-17T02:24:10.753 INFO:teuthology.orchestra.run.smithi045.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-17T02:24:10.753 INFO:teuthology.orchestra.run.smithi045.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-17T02:24:10.753 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.753 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.753 INFO:teuthology.orchestra.run.smithi045.stdout: libcephsqlite-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.754 INFO:teuthology.orchestra.run.smithi045.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-17T02:24:10.754 INFO:teuthology.orchestra.run.smithi045.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-17T02:24:10.754 INFO:teuthology.orchestra.run.smithi045.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-17T02:24:10.754 INFO:teuthology.orchestra.run.smithi045.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-17T02:24:10.754 INFO:teuthology.orchestra.run.smithi045.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-17T02:24:10.754 INFO:teuthology.orchestra.run.smithi045.stdout: librados-devel-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.754 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.754 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-17T02:24:10.754 INFO:teuthology.orchestra.run.smithi045.stdout: librgw2-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.754 INFO:teuthology.orchestra.run.smithi045.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-17T02:24:10.754 INFO:teuthology.orchestra.run.smithi045.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-argparse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.755 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cephfs-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-google-auth-1:2.33.0-1.el9.noarch 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-17T02:24:10.756 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-17T02:24:10.757 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ply-3.11-14.el9.noarch 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-17T02:24:10.758 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rados-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rgw-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-17T02:24:10.759 INFO:teuthology.orchestra.run.smithi045.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-fuse-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-mirror-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: rbd-nbd-2:17.2.7-1375.g2577e813.el9.x86_64 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-17T02:24:10.760 INFO:teuthology.orchestra.run.smithi045.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-17T02:24:10.761 INFO:teuthology.orchestra.run.smithi045.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-17T02:24:10.761 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:10.761 INFO:teuthology.orchestra.run.smithi045.stdout:Complete! 2024-08-17T02:24:11.381 DEBUG:teuthology.parallel:result is None 2024-08-17T02:24:11.381 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:11.523 DEBUG:teuthology.orchestra.run.smithi045:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:24:11.569 INFO:teuthology.orchestra.run.smithi045.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:24:11.570 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:24:11.570 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:24:11.572 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2577e8139c6b8786f9d6d6ea21b8da9244b9260e 2024-08-17T02:24:11.709 DEBUG:teuthology.orchestra.run.smithi169:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-17T02:24:11.760 INFO:teuthology.orchestra.run.smithi169.stdout:17.2.7-1375.g2577e813.el9 2024-08-17T02:24:11.760 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1375.g2577e813.el9 2024-08-17T02:24:11.760 INFO:teuthology.task.install:The correct ceph version 17.2.7-1375.g2577e813 is installed. 2024-08-17T02:24:11.762 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-17T02:24:11.762 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:11.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:24:11.822 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:11.822 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-17T02:24:11.885 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-17T02:24:11.885 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:11.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:24:11.942 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:24:12.045 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:12.046 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/daemon-helper 2024-08-17T02:24:12.103 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-17T02:24:12.199 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-17T02:24:12.199 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:12.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:24:12.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:24:12.351 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:12.352 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-17T02:24:12.406 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-17T02:24:12.501 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-17T02:24:12.501 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:12.501 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:24:12.558 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:24:12.657 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:12.657 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/usr/bin/stdin-killer 2024-08-17T02:24:12.712 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-17T02:24:12.808 INFO:teuthology.run_tasks:Running task ceph... 2024-08-17T02:24:12.889 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-08-17T02:24:12.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2024-08-17T02:24:12.893 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 777 /var/log/ceph 2024-08-17T02:24:12.949 INFO:tasks.ceph:Disabling ceph logrotate... 2024-08-17T02:24:12.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:24:12.953 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/logrotate.d/ceph 2024-08-17T02:24:13.009 INFO:tasks.ceph:Creating extra log directories... 2024-08-17T02:24:13.009 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:24:13.013 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-08-17T02:24:13.078 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-08-17T02:24:13.078 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-08-17T02:24:13.078 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-08-17T02:24:13.078 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:13.078 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:24:13.115 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:13.299 DEBUG:teuthology.orchestra.run.smithi045:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:13.358 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:13.358 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-08-17T02:24:13.394 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:13.565 DEBUG:teuthology.orchestra.run.smithi169:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:13.628 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-08-17T02:24:13.628 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-08-17T02:24:13.629 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268', 'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7858268', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, 'owner': 'scheduled_mchangir@teuthology', 'priority': 25, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5995, 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-mchangir-mgr-volumes-print-thread-name-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLz9RCEh/bsN+pEcKUQOerEsgLcSD7s3S/zpEdJ0YQFhtsauGONRkiqxQy7YBCc6TbO3dPUhCT0tWVA4Xpk/UYc=', 'smithi169.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMni5gCZZEhIlfOlqqNn1Vjukk8Nfk6fr3HOB/a89TM+IUxiog+jiPkev+P1+pSOnHss090MmNGiqYFgsO2qF4k='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'enable_coprs': ['ceph/el9'], 'flavor': 'default', 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', 'filesystem is online with fewer MDS than max_mds', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '2577e8139c6b8786f9d6d6ea21b8da9244b9260e', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '67db276914d29505c9707d04f3a3b8fb9d8aee4b', 'timestamp': '2024-08-17_01:02:08', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-08-17T02:24:13.629 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:24:13.633 DEBUG:teuthology.orchestra.run.smithi169:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-08-17T02:24:13.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:24:13.711 DEBUG:teuthology.orchestra.run.smithi169:> sudo install -d -m0777 -- /var/run/ceph 2024-08-17T02:24:13.768 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:13.768 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:24:13.804 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:24:13.804 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2024-08-17T02:24:13.879 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:24:13.880 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:13.880 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-08-17T02:24:13.880 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:13.880 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:13.880 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-08-17 02:24:03.896431389 +0000 2024-08-17T02:24:13.880 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-08-17 02:21:37.763208192 +0000 2024-08-17T02:24:13.880 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-08-17 02:21:37.763208192 +0000 2024-08-17T02:24:13.880 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-08-17 02:21:37.763208192 +0000 2024-08-17T02:24:13.880 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:24:13.972 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-08-17T02:24:13.972 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-08-17T02:24:13.972 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000215022 s, 2.4 MB/s 2024-08-17T02:24:13.975 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:24:14.011 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2024-08-17T02:24:14.089 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:24:14.089 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-08-17T02:24:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:14.089 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-08-17 02:24:03.896431389 +0000 2024-08-17T02:24:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-08-17 02:21:38.207201623 +0000 2024-08-17T02:24:14.090 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-08-17 02:21:38.207201623 +0000 2024-08-17T02:24:14.090 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-08-17 02:21:38.207201623 +0000 2024-08-17T02:24:14.090 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:24:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-08-17T02:24:14.183 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-08-17T02:24:14.183 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000177377 s, 2.9 MB/s 2024-08-17T02:24:14.185 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:24:14.223 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2024-08-17T02:24:14.299 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:24:14.299 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:14.299 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-08-17T02:24:14.299 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:14.300 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:14.300 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-08-17 02:24:03.897431374 +0000 2024-08-17T02:24:14.300 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-08-17 02:21:38.685194551 +0000 2024-08-17T02:24:14.300 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-08-17 02:21:38.685194551 +0000 2024-08-17T02:24:14.300 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-08-17 02:21:38.685194551 +0000 2024-08-17T02:24:14.301 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:24:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-08-17T02:24:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-08-17T02:24:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000195117 s, 2.6 MB/s 2024-08-17T02:24:14.395 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:24:14.432 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2024-08-17T02:24:14.507 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:24:14.508 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:14.508 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-08-17T02:24:14.508 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:14.508 INFO:teuthology.orchestra.run.smithi045.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:14.508 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2024-08-17 02:24:03.898431358 +0000 2024-08-17T02:24:14.508 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2024-08-17 02:21:39.169187390 +0000 2024-08-17T02:24:14.508 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2024-08-17 02:21:39.169187390 +0000 2024-08-17T02:24:14.509 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: 2024-08-17 02:21:39.169187390 +0000 2024-08-17T02:24:14.509 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:24:14.600 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2024-08-17T02:24:14.600 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2024-08-17T02:24:14.600 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000178209 s, 2.9 MB/s 2024-08-17T02:24:14.603 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:24:14.639 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:14.639 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:14.640 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/scratch_devs of=/dev/stdout 2024-08-17T02:24:14.675 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-17T02:24:14.676 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_1 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 640 Links: 1 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:14.751 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-08-17 02:23:53.312304730 +0000 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-08-17 02:21:30.645752458 +0000 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-08-17 02:21:30.645752458 +0000 2024-08-17T02:24:14.752 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-08-17 02:21:30.645752458 +0000 2024-08-17T02:24:14.752 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-17T02:24:14.845 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-08-17T02:24:14.845 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-08-17T02:24:14.845 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000287089 s, 1.8 MB/s 2024-08-17T02:24:14.848 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-17T02:24:14.884 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_2 2024-08-17T02:24:14.960 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-17T02:24:14.960 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:14.960 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 657 Links: 1 2024-08-17T02:24:14.960 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:14.961 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:14.961 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-08-17 02:23:53.313304709 +0000 2024-08-17T02:24:14.961 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-08-17 02:21:31.143742317 +0000 2024-08-17T02:24:14.961 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-08-17 02:21:31.143742317 +0000 2024-08-17T02:24:14.961 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-08-17 02:21:31.143742317 +0000 2024-08-17T02:24:14.961 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-17T02:24:15.053 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-08-17T02:24:15.053 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-08-17T02:24:15.053 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.00025217 s, 2.0 MB/s 2024-08-17T02:24:15.055 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-17T02:24:15.092 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_3 2024-08-17T02:24:15.168 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-17T02:24:15.168 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:15.168 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 676 Links: 1 2024-08-17T02:24:15.169 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:15.169 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:15.169 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-08-17 02:23:53.314304688 +0000 2024-08-17T02:24:15.169 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-08-17 02:21:31.648732034 +0000 2024-08-17T02:24:15.169 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-08-17 02:21:31.648732034 +0000 2024-08-17T02:24:15.169 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-08-17 02:21:31.648732034 +0000 2024-08-17T02:24:15.169 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-17T02:24:15.262 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-08-17T02:24:15.262 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-08-17T02:24:15.262 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000273991 s, 1.9 MB/s 2024-08-17T02:24:15.265 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-17T02:24:15.302 DEBUG:teuthology.orchestra.run.smithi169:> stat /dev/vg_nvme/lv_4 2024-08-17T02:24:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-17T02:24:15.378 INFO:teuthology.orchestra.run.smithi169.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-17T02:24:15.378 INFO:teuthology.orchestra.run.smithi169.stdout:Device: 6h/6d Inode: 697 Links: 1 2024-08-17T02:24:15.378 INFO:teuthology.orchestra.run.smithi169.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-17T02:24:15.378 INFO:teuthology.orchestra.run.smithi169.stdout:Context: system_u:object_r:device_t:s0 2024-08-17T02:24:15.378 INFO:teuthology.orchestra.run.smithi169.stdout:Access: 2024-08-17 02:23:53.314304688 +0000 2024-08-17T02:24:15.379 INFO:teuthology.orchestra.run.smithi169.stdout:Modify: 2024-08-17 02:21:32.117722484 +0000 2024-08-17T02:24:15.379 INFO:teuthology.orchestra.run.smithi169.stdout:Change: 2024-08-17 02:21:32.117722484 +0000 2024-08-17T02:24:15.379 INFO:teuthology.orchestra.run.smithi169.stdout: Birth: 2024-08-17 02:21:32.117722484 +0000 2024-08-17T02:24:15.379 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-17T02:24:15.472 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records in 2024-08-17T02:24:15.472 INFO:teuthology.orchestra.run.smithi169.stderr:1+0 records out 2024-08-17T02:24:15.472 INFO:teuthology.orchestra.run.smithi169.stderr:512 bytes copied, 0.000262136 s, 2.0 MB/s 2024-08-17T02:24:15.475 DEBUG:teuthology.orchestra.run.smithi169:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-17T02:24:15.512 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:15.512 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:24:15.512 INFO:tasks.ceph:Generating config... 2024-08-17T02:24:15.513 INFO:tasks.ceph:[client] client mount timeout = 600 2024-08-17T02:24:15.513 INFO:tasks.ceph:[client] debug client = 20 2024-08-17T02:24:15.514 INFO:tasks.ceph:[client] debug ms = 1 2024-08-17T02:24:15.514 INFO:tasks.ceph:[client] pid file = 2024-08-17T02:24:15.514 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-08-17T02:24:15.514 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-08-17T02:24:15.514 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-08-17T02:24:15.514 INFO:tasks.ceph:[mds] debug mds = 20 2024-08-17T02:24:15.514 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-08-17T02:24:15.514 INFO:tasks.ceph:[mds] debug ms = 1 2024-08-17T02:24:15.514 INFO:tasks.ceph:[mds] mds debug frag = True 2024-08-17T02:24:15.514 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-08-17T02:24:15.514 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-08-17T02:24:15.514 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-08-17T02:24:15.514 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-08-17T02:24:15.514 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-08-17T02:24:15.515 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-08-17T02:24:15.515 INFO:tasks.ceph:[mgr] debug client = 20 2024-08-17T02:24:15.515 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-08-17T02:24:15.515 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-08-17T02:24:15.515 INFO:tasks.ceph:[mgr] debug ms = 1 2024-08-17T02:24:15.515 INFO:tasks.ceph:[mon] debug mon = 20 2024-08-17T02:24:15.515 INFO:tasks.ceph:[mon] debug ms = 1 2024-08-17T02:24:15.515 INFO:tasks.ceph:[mon] debug paxos = 20 2024-08-17T02:24:15.515 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-08-17T02:24:15.515 INFO:tasks.ceph:[osd] bdev async discard = True 2024-08-17T02:24:15.515 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-08-17T02:24:15.515 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-08-17T02:24:15.515 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-08-17T02:24:15.515 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-08-17T02:24:15.516 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-08-17T02:24:15.516 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-08-17T02:24:15.516 INFO:tasks.ceph:[osd] debug ms = 1 2024-08-17T02:24:15.516 INFO:tasks.ceph:[osd] debug osd = 20 2024-08-17T02:24:15.516 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-08-17T02:24:15.516 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-08-17T02:24:15.516 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-08-17T02:24:15.516 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-08-17T02:24:15.516 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-08-17T02:24:15.516 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-08-17T02:24:15.516 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-08-17T02:24:15.516 INFO:tasks.ceph:Setting up mon.a... 2024-08-17T02:24:15.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-08-17T02:24:15.610 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2024-08-17T02:24:15.615 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-08-17T02:24:15.696 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:24:15.752 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '172.21.15.169'), ('mon.c', '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]')] 2024-08-17T02:24:15.752 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-08-17T02:24:15.753 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:15.753 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:24:15.788 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --add b 172.21.15.169 --addv c '[v2:172.21.15.169:3301,v1:172.21.15.169:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:15.898 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid 2ec357bb-2069-43d1-ab40-d29098820580 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = octopus 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 2ec357bb-2069-43d1-ab40-d29098820580 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2024-08-17T02:24:15.899097+0000 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:created 2024-08-17T02:24:15.899097+0000 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 15 (octopus) 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] mon.b 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] mon.c 2024-08-17T02:24:15.899 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-08-17T02:24:15.901 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-08-17T02:24:15.935 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 2ec357bb-2069-43d1-ab40-d29098820580... 2024-08-17T02:24:15.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:24:15.979 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-08-17T02:24:16.074 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2024-08-17T02:24:16.074 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2024-08-17T02:24:16.074 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:24:16.074 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2024-08-17T02:24:16.074 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.074 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2024-08-17T02:24:16.074 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.074 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.075 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.076 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on skipped message = False 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 2ec357bb-2069-43d1-ab40-d29098820580 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2024-08-17T02:24:16.077 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.078 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2024-08-17T02:24:16.079 INFO:teuthology.orchestra.run.smithi045.stdout: bdev async discard = True 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: bdev enable discard = True 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore allocator = bitmap 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 1/20 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 1/20 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 4/10 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:24:16.080 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2024-08-17T02:24:16.081 INFO:teuthology.orchestra.run.smithi045.stdout: debug finisher = 20 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:24:16.082 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:24:16.083 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2024-08-17T02:24:16.084 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = True 2024-08-17T02:24:16.085 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2024-08-17T02:24:16.086 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2024-08-17T02:24:16.086 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2024-08-17T02:24:16.086 INFO:teuthology.orchestra.run.smithi169.stdout:[global] 2024-08-17T02:24:16.086 INFO:teuthology.orchestra.run.smithi169.stdout: chdir = "" 2024-08-17T02:24:16.086 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-08-17T02:24:16.086 INFO:teuthology.orchestra.run.smithi169.stdout: auth supported = cephx 2024-08-17T02:24:16.086 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.086 INFO:teuthology.orchestra.run.smithi169.stdout: filestore xattr use omap = true 2024-08-17T02:24:16.086 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: mon clock drift allowed = 1.000 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: osd crush chooseleaf type = 0 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: auth debug = true 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on old message = true 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on bug = true 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: mon max pg per osd = 10000 # >= luminous 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: mon pg warn max object skew = 0 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: # disable pg_autoscaler by default for new pools 2024-08-17T02:24:16.087 INFO:teuthology.orchestra.run.smithi169.stdout: osd_pool_default_pg_autoscale_mode = off 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default size = 2 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow primary affinity = true 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd allow pg remap = true 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on legacy crush tunables = false 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on crush straw calc version zero = false 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on no sortbitwise = false 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on osd down out interval zero = false 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: mon warn on too few osds = false 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_pool_no_redundancy = false 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: mon_allow_pool_size_one = true 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.088 INFO:teuthology.orchestra.run.smithi169.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-08-17T02:24:16.089 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.089 INFO:teuthology.orchestra.run.smithi169.stdout: osd default data pool replay window = 5 2024-08-17T02:24:16.089 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.089 INFO:teuthology.orchestra.run.smithi169.stdout: mon allow pool delete = true 2024-08-17T02:24:16.089 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.089 INFO:teuthology.orchestra.run.smithi169.stdout: mon cluster log file level = debug 2024-08-17T02:24:16.089 INFO:teuthology.orchestra.run.smithi169.stdout: debug asserts on shutdown = true 2024-08-17T02:24:16.089 INFO:teuthology.orchestra.run.smithi169.stdout: mon health detail to clog = false 2024-08-17T02:24:16.089 INFO:teuthology.orchestra.run.smithi169.stdout: mon host = "172.21.15.45,172.21.15.169,[v2:172.21.15.169:3301,v1:172.21.15.169:6790]" 2024-08-17T02:24:16.090 INFO:teuthology.orchestra.run.smithi169.stdout: ms die on skipped message = False 2024-08-17T02:24:16.090 INFO:teuthology.orchestra.run.smithi169.stdout: fsid = 2ec357bb-2069-43d1-ab40-d29098820580 2024-08-17T02:24:16.090 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.090 INFO:teuthology.orchestra.run.smithi169.stdout:[osd] 2024-08-17T02:24:16.090 INFO:teuthology.orchestra.run.smithi169.stdout: osd journal size = 100 2024-08-17T02:24:16.090 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.090 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub load threshold = 5.0 2024-08-17T02:24:16.090 INFO:teuthology.orchestra.run.smithi169.stdout: osd scrub max interval = 600 2024-08-17T02:24:16.090 INFO:teuthology.orchestra.run.smithi169.stdout: osd mclock profile = high_recovery_ops 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: osd recover clone overlap = true 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: osd recovery max chunk = 1048576 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug shutdown = true 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug op order = true 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug verify stray on activate = true 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: osd open classes on start = true 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug pg log writeout = true 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: osd deep scrub update digest min age = 30 2024-08-17T02:24:16.091 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: osd map max advance = 10 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: journal zero on create = true 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: filestore ondisk finisher threads = 3 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: filestore apply finisher threads = 3 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: bdev debug aio = true 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: osd debug misdirected ops = true 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: bdev async discard = True 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: bdev enable discard = True 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore allocator = bitmap 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore block size = 96636764160 2024-08-17T02:24:16.092 INFO:teuthology.orchestra.run.smithi169.stdout: bluestore fsck on mount = True 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluefs = 1/20 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: debug bluestore = 1/20 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: debug osd = 20 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: debug rocksdb = 4/10 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd backfillfull_ratio = 0.85 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd full ratio = 0.9 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd nearfull ratio = 0.8 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: osd failsafe full ratio = 0.95 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: osd objectstore = bluestore 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr] 2024-08-17T02:24:16.093 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout: debug mgr = 20 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout: mgr/telemetry/nag = false 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout: debug finisher = 20 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout:[mon] 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-08-17T02:24:16.094 INFO:teuthology.orchestra.run.smithi169.stdout: debug mon = 20 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: debug paxos = 20 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: debug auth = 20 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: mon data avail warn = 5 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: mon mgr mkfs grace = 240 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min pgs per osd = 4 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd reporter subtree level = osd 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: mon osd prime pg temp = true 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: mon reweight min bytes per osd = 10 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: auth mon ticket ttl = 660 # 11m 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: auth service ticket ttl = 240 # 4m 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.095 INFO:teuthology.orchestra.run.smithi169.stdout: # don't complain about insecure global_id in the test suite 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: # 1m isn't quite enough 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: mon_down_mkfs_grace = 2m 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: mon_warn_on_filestore_osds = false 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: mon op complaint time = 120 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout:[client] 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: rgw cache enabled = true 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable ops log = true 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: rgw enable usage log = true 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-08-17T02:24:16.096 INFO:teuthology.orchestra.run.smithi169.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout: client mount timeout = 600 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout: debug client = 20 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout: pid file = "" 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.a] 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.b] 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout:[mon.c] 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-08-17T02:24:16.097 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi169.stdout:[mds] 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds = 20 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi169.stdout: debug mds balancer = 20 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi169.stdout: debug ms = 1 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug frag = True 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi169.stdout: mds debug scatterstat = True 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi169.stdout: mds op complaint time = 180 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi169.stdout: mds verify scatter = True 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi169.stdout: osd op complaint time = 180 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi169.stdout: rados mon op timeout = 900 2024-08-17T02:24:16.098 INFO:teuthology.orchestra.run.smithi169.stdout: rados osd op timeout = 900 2024-08-17T02:24:16.103 INFO:tasks.ceph:Creating admin key on mon.a... 2024-08-17T02:24:16.103 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-08-17T02:24:16.194 INFO:tasks.ceph:Copying monmap to all nodes... 2024-08-17T02:24:16.195 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:16.195 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-08-17T02:24:16.230 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:16.230 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-08-17T02:24:16.305 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:24:16.305 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:16.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:24:16.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:24:16.422 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:16.422 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:16.498 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:24:16.498 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:16.498 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd of=/etc/ceph/ceph.keyring 2024-08-17T02:24:16.498 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-08-17T02:24:16.577 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:16.577 DEBUG:teuthology.orchestra.run.smithi169:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:16.653 INFO:tasks.ceph:Setting up mon nodes... 2024-08-17T02:24:16.653 INFO:tasks.ceph:Setting up mgr nodes... 2024-08-17T02:24:16.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:24:16.752 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-08-17T02:24:16.757 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:24:16.873 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-08-17T02:24:16.879 INFO:tasks.ceph:Setting up mds nodes... 2024-08-17T02:24:16.879 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:24:16.978 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-08-17T02:24:16.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-08-17T02:24:17.038 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:24:17.136 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-08-17T02:24:17.141 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-08-17T02:24:17.197 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:24:17.296 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-08-17T02:24:17.300 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-08-17T02:24:17.356 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:24:17.453 INFO:teuthology.orchestra.run.smithi169.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-08-17T02:24:17.458 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-08-17T02:24:17.514 INFO:tasks.ceph_client:Setting up client nodes... 2024-08-17T02:24:17.515 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-17T02:24:17.591 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-08-17T02:24:17.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-08-17T02:24:17.693 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-08-17T02:24:17.720 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-08-17T02:24:17.796 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-08-17T02:24:17.823 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-08-17T02:24:17.898 INFO:teuthology.orchestra.run.smithi169.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-08-17T02:24:17.925 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-08-17T02:24:17.925 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi169.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-08-17T02:24:17.925 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-08-17T02:24:17.982 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:17.982 INFO:tasks.ceph:role: osd.0 2024-08-17T02:24:17.982 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:24:17.982 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:24:18.037 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:18.037 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:18.037 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:18.037 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:24:18.038 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:18.038 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:18.038 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:18.038 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:24:18.038 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:18.038 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:18.071 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2024-08-17T02:24:18.075 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2024-08-17T02:24:18.075 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-08-17T02:24:18.156 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-08-17T02:24:18.218 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-08-17T02:24:18.277 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:18.277 INFO:tasks.ceph:role: osd.1 2024-08-17T02:24:18.277 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:24:18.277 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:24:18.333 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:18.333 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:18.333 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:18.333 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:24:18.333 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:18.333 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:18.333 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:18.333 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:24:18.333 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:18.334 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:18.367 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2024-08-17T02:24:18.371 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2024-08-17T02:24:18.371 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-08-17T02:24:18.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-08-17T02:24:18.516 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-08-17T02:24:18.572 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:18.572 INFO:tasks.ceph:role: osd.2 2024-08-17T02:24:18.572 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:24:18.572 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:24:18.629 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:18.629 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:18.629 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:18.629 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:24:18.629 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:18.629 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:18.629 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:18.629 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:24:18.629 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:18.629 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:18.662 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2024-08-17T02:24:18.666 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2024-08-17T02:24:18.666 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-08-17T02:24:18.751 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-08-17T02:24:18.814 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-08-17T02:24:18.872 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:18.872 INFO:tasks.ceph:role: osd.3 2024-08-17T02:24:18.872 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:24:18.872 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:24:18.928 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:18.967 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:18.967 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:18.967 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:24:18.967 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:18.967 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:18.967 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:18.967 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:24:18.967 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:18.967 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:18.969 INFO:teuthology.orchestra.run.smithi045.stdout:Discarding blocks...Done. 2024-08-17T02:24:18.969 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2024-08-17T02:24:18.969 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-08-17T02:24:19.049 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-08-17T02:24:19.111 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:19.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:19.220+0000 7fc261f242c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-08-17T02:24:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:19.220+0000 7fc261f242c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-08-17T02:24:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:19.221+0000 7fc261f242c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:24:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:19.221+0000 7fc261f242c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:24:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:19.221+0000 7fc261f242c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-08-17T02:24:19.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:19.223+0000 7fc261f242c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-08-17T02:24:19.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:19.769+0000 7fc261f242c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:20.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:20.543+0000 7fc261f242c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:21.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:21.315+0000 7fc261f242c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:22.152 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-08-17T02:24:22.214 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:22.300+0000 7f3a8a6142c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-08-17T02:24:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:22.300+0000 7f3a8a6142c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-08-17T02:24:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:22.300+0000 7f3a8a6142c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:24:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:22.300+0000 7f3a8a6142c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:24:22.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:22.300+0000 7f3a8a6142c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-08-17T02:24:22.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:22.302+0000 7f3a8a6142c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-08-17T02:24:22.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:22.850+0000 7f3a8a6142c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:23.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:23.617+0000 7f3a8a6142c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:24.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:24.388+0000 7f3a8a6142c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:25.212 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-08-17T02:24:25.274 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:25.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:25.360+0000 7fb5250392c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-08-17T02:24:25.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:25.360+0000 7fb5250392c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-08-17T02:24:25.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:25.360+0000 7fb5250392c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:24:25.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:25.360+0000 7fb5250392c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:24:25.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:25.360+0000 7fb5250392c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-08-17T02:24:25.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:25.362+0000 7fb5250392c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-08-17T02:24:25.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:25.914+0000 7fb5250392c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:26.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:26.676+0000 7fb5250392c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:27.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:27.449+0000 7fb5250392c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:28.284 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-08-17T02:24:28.346 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:28.433+0000 7f684bc162c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-08-17T02:24:28.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:28.433+0000 7f684bc162c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-08-17T02:24:28.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:28.433+0000 7f684bc162c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:24:28.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:28.433+0000 7f684bc162c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:24:28.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:28.433+0000 7f684bc162c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-08-17T02:24:28.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:28.435+0000 7f684bc162c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-08-17T02:24:28.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:28.978+0000 7f684bc162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:29.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:29.746+0000 7f684bc162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:30.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:30.520+0000 7f684bc162c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:31.352 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-08-17T02:24:31.410 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-08-17T02:24:31.473 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:31.473 INFO:tasks.ceph:role: osd.4 2024-08-17T02:24:31.473 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:24:31.473 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-08-17T02:24:31.539 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:31.539 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:31.539 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:31.539 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:24:31.539 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:31.539 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:31.539 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:31.539 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:24:31.539 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:31.539 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:31.953 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-08-17T02:24:31.957 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-08-17T02:24:31.957 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-08-17T02:24:32.094 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-08-17T02:24:32.160 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-08-17T02:24:32.216 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:32.216 INFO:tasks.ceph:role: osd.5 2024-08-17T02:24:32.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:24:32.217 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-08-17T02:24:32.281 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:24:32.281 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:32.281 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:32.282 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:32.282 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:24:32.282 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:32.282 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:32.639 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-08-17T02:24:32.643 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-08-17T02:24:32.643 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-08-17T02:24:32.729 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-08-17T02:24:32.801 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-08-17T02:24:32.857 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:32.857 INFO:tasks.ceph:role: osd.6 2024-08-17T02:24:32.857 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:24:32.858 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-08-17T02:24:32.922 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:32.922 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:32.922 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:32.922 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:24:32.923 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:32.923 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:32.923 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:32.923 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:24:32.923 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:32.923 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:33.314 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-08-17T02:24:33.318 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-08-17T02:24:33.318 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-08-17T02:24:33.428 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-08-17T02:24:33.494 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-08-17T02:24:33.550 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-08-17T02:24:33.550 INFO:tasks.ceph:role: osd.7 2024-08-17T02:24:33.550 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:24:33.550 DEBUG:teuthology.orchestra.run.smithi169:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-08-17T02:24:33.613 INFO:teuthology.orchestra.run.smithi169.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-08-17T02:24:33.613 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 attr=2, projid32bit=1 2024-08-17T02:24:33.613 INFO:teuthology.orchestra.run.smithi169.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-08-17T02:24:33.613 INFO:teuthology.orchestra.run.smithi169.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-08-17T02:24:33.613 INFO:teuthology.orchestra.run.smithi169.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-08-17T02:24:33.613 INFO:teuthology.orchestra.run.smithi169.stdout: = sunit=0 swidth=0 blks 2024-08-17T02:24:33.613 INFO:teuthology.orchestra.run.smithi169.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-08-17T02:24:33.613 INFO:teuthology.orchestra.run.smithi169.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-08-17T02:24:33.613 INFO:teuthology.orchestra.run.smithi169.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-08-17T02:24:33.613 INFO:teuthology.orchestra.run.smithi169.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-08-17T02:24:34.033 INFO:teuthology.orchestra.run.smithi169.stdout:Discarding blocks...Done. 2024-08-17T02:24:34.037 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi169.front.sepia.ceph.com -o noatime 2024-08-17T02:24:34.037 DEBUG:teuthology.orchestra.run.smithi169:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-08-17T02:24:34.184 DEBUG:teuthology.orchestra.run.smithi169:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-08-17T02:24:34.249 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:34.355 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:34.354+0000 7fa6501552c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-08-17T02:24:34.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:34.358+0000 7fa6501552c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-08-17T02:24:34.359 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:34.358+0000 7fa6501552c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:24:34.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:34.358+0000 7fa6501552c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:24:34.360 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:34.358+0000 7fa6501552c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-08-17T02:24:34.369 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:34.368+0000 7fa6501552c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-08-17T02:24:34.914 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:34.913+0000 7fa6501552c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:35.679 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:35.678+0000 7fa6501552c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:36.469 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:36.469+0000 7fa6501552c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:37.298 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-08-17T02:24:37.358 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:37.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:37.442+0000 7fb4aea0a2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-08-17T02:24:37.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:37.443+0000 7fb4aea0a2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-08-17T02:24:37.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:37.443+0000 7fb4aea0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:24:37.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:37.443+0000 7fb4aea0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:24:37.444 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:37.443+0000 7fb4aea0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-08-17T02:24:37.445 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:37.446+0000 7fb4aea0a2c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-08-17T02:24:37.998 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:37.998+0000 7fb4aea0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:38.772 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:38.773+0000 7fb4aea0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:39.538 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:39.538+0000 7fb4aea0a2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:40.390 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-08-17T02:24:40.449 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:40.534 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:40.534+0000 7f929401d2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-08-17T02:24:40.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:40.535+0000 7f929401d2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-08-17T02:24:40.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:40.535+0000 7f929401d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:24:40.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:40.535+0000 7f929401d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:24:40.535 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:40.535+0000 7f929401d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-08-17T02:24:40.537 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:40.537+0000 7f929401d2c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-08-17T02:24:41.089 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:41.089+0000 7f929401d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:41.871 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:41.871+0000 7f929401d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:42.642 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:42.642+0000 7f929401d2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:43.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-08-17T02:24:43.540 DEBUG:teuthology.orchestra.run.smithi169:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:43.624 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:43.624+0000 7f17b906f2c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-08-17T02:24:43.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:43.624+0000 7f17b906f2c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-08-17T02:24:43.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:43.624+0000 7f17b906f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:24:43.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:43.624+0000 7f17b906f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:24:43.625 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:43.624+0000 7f17b906f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-08-17T02:24:43.626 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:43.626+0000 7f17b906f2c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-08-17T02:24:43.630 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:43.635 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:24:44.169 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:44.169+0000 7f17b906f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:44.938 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:44.938+0000 7f17b906f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:45.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:45.709+0000 7f17b906f2c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2024-08-17T02:24:46.537 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-08-17T02:24:46.594 INFO:tasks.ceph:Reading keys from all nodes... 2024-08-17T02:24:46.594 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:46.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-08-17T02:24:46.657 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:46.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-08-17T02:24:46.757 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:46.757 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-08-17T02:24:46.853 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:46.853 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-08-17T02:24:46.950 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:46.950 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-08-17T02:24:47.046 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:47.046 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-08-17T02:24:47.142 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:47.142 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-08-17T02:24:47.238 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:47.239 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-08-17T02:24:47.296 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:47.296 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-08-17T02:24:47.393 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:47.393 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-08-17T02:24:47.489 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:47.489 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-08-17T02:24:47.584 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:47.585 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-08-17T02:24:47.681 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:47.681 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-08-17T02:24:47.778 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:47.778 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-08-17T02:24:47.874 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:47.875 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-08-17T02:24:47.914 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:47.915 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-08-17T02:24:47.992 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:47.992 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-08-17T02:24:48.027 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:48.027 DEBUG:teuthology.orchestra.run.smithi169:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-08-17T02:24:48.102 INFO:tasks.ceph:Adding keys to all mons... 2024-08-17T02:24:48.103 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:24:48.107 DEBUG:teuthology.orchestra.run.smithi169:> sudo tee -a /etc/ceph/ceph.keyring 2024-08-17T02:24:48.159 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2024-08-17T02:24:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDQCcBmlv3hLBAApTWO9QIKFa3fBbvcIv98WA== 2024-08-17T02:24:48.159 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2024-08-17T02:24:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDQCcBmugtUOhAAoCZ/oIc5/Y83lwx83m+W6w== 2024-08-17T02:24:48.159 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2024-08-17T02:24:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDRCcBm3r8tCBAAN9okGEnCpElqvRQ5/GPpkA== 2024-08-17T02:24:48.159 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2024-08-17T02:24:48.159 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDTCcBmlbkxDRAAjEXuodIcQr0lxnMBexVj8g== 2024-08-17T02:24:48.159 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDWCcBmKuf0ERAA0/8o9380SPIAZXBDu03klA== 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDZCcBmwrWNFRAAQqTYFyvCWlMpOSmqjwHbwg== 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDcCcBmdM7XGRAAzuYhFc6Y1pKeGkJI0dpo4g== 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDQCcBm+0YZNBAAEHxJLjiGQFAJfW49L6AULw== 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDRCcBm9WyrERAA/urklBOu7yhEPHOt71uzdQ== 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDRCcBm3zESGxAADV1G8iQrmWKLo8RyqPIFPA== 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2024-08-17T02:24:48.160 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDiCcBmZv84FRAAzjc+dcaL4GGAj75MDt6taA== 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDlCcBmLfR5GhAAM23vQje3y7hH7QUVNBZJhQ== 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDoCcBmhVjiHxAABICAKNq8N92ecqX/Ryy6GQ== 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDrCcBm5Ig7JRAArcSlfKv7r7Rg3WPZqZny0A== 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDRCcBmFztLIxAAYhFZ+pnTExet5Tz55C2blw== 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout:[client.2] 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDRCcBmD8teKRAAaMM+KtD/wcMZ56mhMfqyFw== 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDRCcBmRfmCLxAAr8BGlJvP/yxuqVWkFDX2OA== 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout:[client.3] 2024-08-17T02:24:48.161 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDRCcBm8H6ZNRAAt9DBI348gXMa7ZMPiM/xEA== 2024-08-17T02:24:48.196 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.y] 2024-08-17T02:24:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDQCcBmlv3hLBAApTWO9QIKFa3fBbvcIv98WA== 2024-08-17T02:24:48.196 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.a] 2024-08-17T02:24:48.196 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDQCcBmugtUOhAAoCZ/oIc5/Y83lwx83m+W6w== 2024-08-17T02:24:48.196 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.c] 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDRCcBm3r8tCBAAN9okGEnCpElqvRQ5/GPpkA== 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.0] 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDTCcBmlbkxDRAAjEXuodIcQr0lxnMBexVj8g== 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.1] 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDWCcBmKuf0ERAA0/8o9380SPIAZXBDu03klA== 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.2] 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDZCcBmwrWNFRAAQqTYFyvCWlMpOSmqjwHbwg== 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.3] 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDcCcBmdM7XGRAAzuYhFc6Y1pKeGkJI0dpo4g== 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout:[mgr.x] 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDQCcBm+0YZNBAAEHxJLjiGQFAJfW49L6AULw== 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.b] 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDRCcBm9WyrERAA/urklBOu7yhEPHOt71uzdQ== 2024-08-17T02:24:48.197 INFO:teuthology.orchestra.run.smithi169.stdout:[mds.d] 2024-08-17T02:24:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDRCcBm3zESGxAADV1G8iQrmWKLo8RyqPIFPA== 2024-08-17T02:24:48.198 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.4] 2024-08-17T02:24:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDiCcBmZv84FRAAzjc+dcaL4GGAj75MDt6taA== 2024-08-17T02:24:48.198 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.5] 2024-08-17T02:24:48.198 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDlCcBmLfR5GhAAM23vQje3y7hH7QUVNBZJhQ== 2024-08-17T02:24:48.198 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.6] 2024-08-17T02:24:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDoCcBmhVjiHxAABICAKNq8N92ecqX/Ryy6GQ== 2024-08-17T02:24:48.199 INFO:teuthology.orchestra.run.smithi169.stdout:[osd.7] 2024-08-17T02:24:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDrCcBm5Ig7JRAArcSlfKv7r7Rg3WPZqZny0A== 2024-08-17T02:24:48.199 INFO:teuthology.orchestra.run.smithi169.stdout:[client.0] 2024-08-17T02:24:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDRCcBmFztLIxAAYhFZ+pnTExet5Tz55C2blw== 2024-08-17T02:24:48.199 INFO:teuthology.orchestra.run.smithi169.stdout:[client.2] 2024-08-17T02:24:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDRCcBmD8teKRAAaMM+KtD/wcMZ56mhMfqyFw== 2024-08-17T02:24:48.199 INFO:teuthology.orchestra.run.smithi169.stdout:[client.1] 2024-08-17T02:24:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDRCcBmRfmCLxAAr8BGlJvP/yxuqVWkFDX2OA== 2024-08-17T02:24:48.199 INFO:teuthology.orchestra.run.smithi169.stdout:[client.3] 2024-08-17T02:24:48.199 INFO:teuthology.orchestra.run.smithi169.stdout: key = AQDRCcBm8H6ZNRAAt9DBI348gXMa7ZMPiM/xEA== 2024-08-17T02:24:48.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:48.207 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:48.327 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:48.331 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:48.422 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:48.425 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:48.515 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:48.519 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:48.606 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:48.610 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:48.697 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:48.701 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:48.788 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:48.792 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:48.880 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:48.884 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-08-17T02:24:48.971 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:48.975 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:49.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:49.069 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-08-17T02:24:49.160 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:49.164 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:49.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:49.254 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:49.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:49.346 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:49.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:49.437 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-08-17T02:24:49.523 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:49.527 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:49.619 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:49.623 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:49.713 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:49.717 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:49.807 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:49.811 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-08-17T02:24:49.901 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-08-17T02:24:49.901 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-08-17T02:24:49.958 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:24:50.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-08-17T02:24:50.116 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-08-17T02:24:50.172 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:24:50.273 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-08-17T02:24:50.329 DEBUG:teuthology.orchestra.run.smithi169:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-08-17T02:24:50.385 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-08-17T02:24:50.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-08-17T02:24:50.541 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:50.546 DEBUG:teuthology.orchestra.run.smithi169:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-08-17T02:24:50.581 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-08-17T02:24:50.581 INFO:tasks.ceph.mon.a:Restarting daemon 2024-08-17T02:24:50.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-08-17T02:24:50.623 INFO:tasks.ceph.mon.a:Started 2024-08-17T02:24:50.624 INFO:tasks.ceph.mon.b:Restarting daemon 2024-08-17T02:24:50.624 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-08-17T02:24:50.628 INFO:tasks.ceph.mon.b:Started 2024-08-17T02:24:50.628 INFO:tasks.ceph.mon.c:Restarting daemon 2024-08-17T02:24:50.628 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-08-17T02:24:50.632 INFO:tasks.ceph.mon.c:Started 2024-08-17T02:24:50.632 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-08-17T02:24:50.632 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-08-17T02:24:50.632 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-08-17T02:24:50.636 INFO:tasks.ceph.mgr.y:Started 2024-08-17T02:24:50.636 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-08-17T02:24:50.636 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-08-17T02:24:50.640 INFO:tasks.ceph.mgr.x:Started 2024-08-17T02:24:50.640 INFO:tasks.ceph:Setting crush tunables to default 2024-08-17T02:24:50.640 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2024-08-17T02:24:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.792+0000 7fd002200640 1 Processor -- start 2024-08-17T02:24:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.792+0000 7fd002200640 1 -- start start 2024-08-17T02:24:50.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.793+0000 7fd002200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 0x7fcffc156f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.793+0000 7fd002200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 0x7fcffc0af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:50.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.793+0000 7fd002200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcffc0aff20 con 0x7fcffc0a54d0 2024-08-17T02:24:50.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.793+0000 7fd002200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc158400 con 0x7fcffc0af580 2024-08-17T02:24:50.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.793+0000 7fd002200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcffc1577f0 con 0x7fcffc155980 2024-08-17T02:24:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffbe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 0x7fcffc0af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffbe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 0x7fcffc0af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48396/0 (socket says 172.21.15.45:48396) 2024-08-17T02:24:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffbe00640 1 -- 172.21.15.45:0/2757738384 learned_addr learned my addr 172.21.15.45:0/2757738384 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:24:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffb400640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 0x7fcffc156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffbe00640 1 -- 172.21.15.45:0/2757738384 >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 msgr2=0x7fcffc0af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:24:50.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffbe00640 1 -- 172.21.15.45:0/2757738384 >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 msgr2=0x7fcffc0af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffbe00640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 0x7fcffc0af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffb400640 1 -- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 msgr2=0x7fcffc156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:24:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffbe00640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 0x7fcffc0af9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:24:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffb400640 1 -- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 msgr2=0x7fcffc156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffb400640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 0x7fcffc156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:50.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.794+0000 7fcffb400640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 0x7fcffc156f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-17T02:24:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.995+0000 7fcffbe00640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 0x7fcffc0af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.995+0000 7fcffbe00640 1 -- 172.21.15.45:0/2757738384 >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 msgr2=0x7fcffc0af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-08-17T02:24:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.995+0000 7fcffbe00640 1 -- 172.21.15.45:0/2757738384 >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 msgr2=0x7fcffc0af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.995+0000 7fcffb400640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 0x7fcffc156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.995+0000 7fcffbe00640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 0x7fcffc0af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.995+0000 7fcffbe00640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 0x7fcffc0af9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:24:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.995+0000 7fcffb400640 1 -- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 msgr2=0x7fcffc156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-08-17T02:24:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.995+0000 7fcffb400640 1 -- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 msgr2=0x7fcffc156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-08-17T02:24:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.995+0000 7fcffb400640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 0x7fcffc156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-08-17T02:24:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:50.995+0000 7fcffb400640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 0x7fcffc156f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-17T02:24:51.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.012+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2896457839 0 0) 0x7fcfe8001110 con 0x7fcffc0a54d0 2024-08-17T02:24:51.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.013+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfe00034e0 con 0x7fcffc0a54d0 2024-08-17T02:24:51.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 <== mon.1 v1:172.21.15.169:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1821694627 0 0) 0x7fcfe00034e0 con 0x7fcffc0a54d0 2024-08-17T02:24:51.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 msgr2=0x7fcffc156f70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:24:51.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.169:3300/0 conn(0x7fcffc155980 0x7fcffc156f70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 msgr2=0x7fcffc0af9e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:24:51.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 --2- 172.21.15.45:0/2757738384 >> v2:172.21.15.45:3300/0 conn(0x7fcffc0af580 0x7fcffc0af9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 --> v1:172.21.15.169:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc157ad0 con 0x7fcffc0a54d0 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 <== mon.1 v1:172.21.15.169:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7fcfe8001600 con 0x7fcffc0a54d0 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 >> v1:172.21.15.169:6789/0 conn(0x7fcffc0a54d0 legacy=0x7fcffc155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 --2- 172.21.15.45:0/2757738384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfe0003a50 0x7fcfe0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 --2- 172.21.15.45:0/2757738384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe0004780 0x7fcfe0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 --2- 172.21.15.45:0/2757738384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfe0005180 0x7fcfe000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc158400 con 0x7fcfe0004780 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc1577f0 con 0x7fcfe0005180 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.018+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe000c120 con 0x7fcfe0003a50 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.019+0000 7fcffb400640 1 --2- 172.21.15.45:0/2757738384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfe0003a50 0x7fcfe0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.019+0000 7fcffbe00640 1 --2- 172.21.15.45:0/2757738384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfe0005180 0x7fcfe000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.019+0000 7fcffaa00640 1 --2- 172.21.15.45:0/2757738384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe0004780 0x7fcfe0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.019+0000 7fcffb400640 1 -- 172.21.15.45:0/2757738384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfe0005180 msgr2=0x7fcfe000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.019+0000 7fcffb400640 1 --2- 172.21.15.45:0/2757738384 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcfe0005180 0x7fcfe000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.019+0000 7fcffb400640 1 -- 172.21.15.45:0/2757738384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe0004780 msgr2=0x7fcfe0004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:51.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.019+0000 7fcffb400640 1 --2- 172.21.15.45:0/2757738384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcfe0004780 0x7fcfe0004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.019+0000 7fcffb400640 1 -- 172.21.15.45:0/2757738384 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc157ad0 con 0x7fcfe0003a50 2024-08-17T02:24:51.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.019+0000 7fcffbe00640 1 -- 172.21.15.45:0/2757738384 reap_dead start 2024-08-17T02:24:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.020+0000 7fcffb400640 1 --2- 172.21.15.45:0/2757738384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfe0003a50 0x7fcfe0003e60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcfec006ea0 tx=0x7fcfec008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee54a4f534e4d46c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.021+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec033410 con 0x7fcfe0003a50 2024-08-17T02:24:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.021+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfec02d030 con 0x7fcfe0003a50 2024-08-17T02:24:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.021+0000 7fcffa000640 1 -- 172.21.15.45:0/2757738384 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec033590 con 0x7fcfe0003a50 2024-08-17T02:24:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.021+0000 7fd002200640 1 -- 172.21.15.45:0/2757738384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfe0003a50 msgr2=0x7fcfe0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.021+0000 7fd002200640 1 --2- 172.21.15.45:0/2757738384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfe0003a50 0x7fcfe0003e60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcfec006ea0 tx=0x7fcfec008040 comp rx=0 tx=0).stop 2024-08-17T02:24:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.021+0000 7fd002200640 1 -- 172.21.15.45:0/2757738384 shutdown_connections 2024-08-17T02:24:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.021+0000 7fd002200640 1 --2- 172.21.15.45:0/2757738384 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfe0003a50 0x7fcfe0003e60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.021+0000 7fd002200640 1 -- 172.21.15.45:0/2757738384 >> 172.21.15.45:0/2757738384 conn(0x7fcffc067750 msgr2=0x7fcffc0cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.022+0000 7fd002200640 1 -- 172.21.15.45:0/2757738384 shutdown_connections 2024-08-17T02:24:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.022+0000 7fd002200640 1 -- 172.21.15.45:0/2757738384 wait complete. 2024-08-17T02:24:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.024+0000 7fd002200640 1 Processor -- start 2024-08-17T02:24:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.024+0000 7fd002200640 1 -- start start 2024-08-17T02:24:51.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.025+0000 7fd002200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfe0003a50 0x7fcffc168af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:51.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.025+0000 7fd002200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcffc0ac6f0 0x7fcffc158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:51.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.025+0000 7fd002200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcffc15b4c0 0x7fcffc15b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:51.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.025+0000 7fd002200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc159460 con 0x7fcffc15b4c0 2024-08-17T02:24:51.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.025+0000 7fd002200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc15be80 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.025+0000 7fd002200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc169030 con 0x7fcfe0003a50 2024-08-17T02:24:51.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.025+0000 7fcffaa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcffc0ac6f0 0x7fcffc158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:51.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.025+0000 7fcffbe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcffc15b4c0 0x7fcffc15b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:51.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.025+0000 7fcffb400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfe0003a50 0x7fcffc168af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:51.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.025+0000 7fcffaa00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcffc0ac6f0 0x7fcffc158ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:46594/0 (socket says 172.21.15.45:46594) 2024-08-17T02:24:51.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.025+0000 7fcffaa00640 1 -- 172.21.15.45:0/1895568806 learned_addr learned my addr 172.21.15.45:0/1895568806 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:24:51.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.026+0000 7fcffaa00640 1 -- 172.21.15.45:0/1895568806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfe0003a50 msgr2=0x7fcffc168af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.026+0000 7fcffaa00640 1 --2- 172.21.15.45:0/1895568806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfe0003a50 0x7fcffc168af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.026+0000 7fcffaa00640 1 -- 172.21.15.45:0/1895568806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcffc15b4c0 msgr2=0x7fcffc15b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.026+0000 7fcffaa00640 1 --2- 172.21.15.45:0/1895568806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcffc15b4c0 0x7fcffc15b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.026+0000 7fcffaa00640 1 -- 172.21.15.45:0/1895568806 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc0acc50 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.026+0000 7fcffbe00640 1 --2- 172.21.15.45:0/1895568806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcffc15b4c0 0x7fcffc15b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.026+0000 7fcffaa00640 1 --2- 172.21.15.45:0/1895568806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcffc0ac6f0 0x7fcffc158ad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800e790 tx=0x7fcfe8009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.026+0000 7fcff2a00640 1 -- 172.21.15.45:0/1895568806 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8012660 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.026+0000 7fcff2a00640 1 -- 172.21.15.45:0/1895568806 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe8002e90 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.027+0000 7fd002200640 1 -- 172.21.15.45:0/1895568806 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc0acf30 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.027+0000 7fcff2a00640 1 -- 172.21.15.45:0/1895568806 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8012a10 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.027+0000 7fd002200640 1 -- 172.21.15.45:0/1895568806 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc0ad4f0 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.027+0000 7fcff2a00640 1 -- 172.21.15.45:0/1895568806 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fcfe801d6f0 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.028+0000 7fcff2a00640 1 -- 172.21.15.45:0/1895568806 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcfe801dcf0 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.028+0000 7fd002200640 1 -- 172.21.15.45:0/1895568806 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcffc159610 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.031+0000 7fcff2a00640 1 -- 172.21.15.45:0/1895568806 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fcffc159610 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.100+0000 7fd002200640 1 -- 172.21.15.45:0/1895568806 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcffc071050 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.104+0000 7fcff2a00640 1 -- 172.21.15.45:0/1895568806 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcffc0aff20 con 0x7fcffc0ac6f0 2024-08-17T02:24:51.105 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2024-08-17T02:24:51.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.105+0000 7fd002200640 1 -- 172.21.15.45:0/1895568806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcffc0ac6f0 msgr2=0x7fcffc158ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:51.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.105+0000 7fd002200640 1 --2- 172.21.15.45:0/1895568806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcffc0ac6f0 0x7fcffc158ad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcfe800e790 tx=0x7fcfe8009040 comp rx=0 tx=0).stop 2024-08-17T02:24:51.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.105+0000 7fd002200640 1 -- 172.21.15.45:0/1895568806 shutdown_connections 2024-08-17T02:24:51.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.105+0000 7fd002200640 1 --2- 172.21.15.45:0/1895568806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcffc15b4c0 0x7fcffc15b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.105+0000 7fd002200640 1 --2- 172.21.15.45:0/1895568806 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcffc0ac6f0 0x7fcffc158ad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.105+0000 7fd002200640 1 --2- 172.21.15.45:0/1895568806 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcfe0003a50 0x7fcffc168af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.105+0000 7fd002200640 1 -- 172.21.15.45:0/1895568806 >> 172.21.15.45:0/1895568806 conn(0x7fcffc067750 msgr2=0x7fcffc151ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:51.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.105+0000 7fd002200640 1 -- 172.21.15.45:0/1895568806 shutdown_connections 2024-08-17T02:24:51.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:51.105+0000 7fd002200640 1 -- 172.21.15.45:0/1895568806 wait complete. 2024-08-17T02:24:51.121 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-08-17T02:24:51.121 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:51.121 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-08-17T02:24:51.161 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:51.160+0000 7faee8521ec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:24:51.181 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:51.181 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-08-17T02:24:51.278 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:51.279 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-08-17T02:24:51.324 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:51.320+0000 7faee8521ec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:51.378 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2024-08-17T02:24:51.379 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-08-17T02:24:51.387 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:51.387+0000 7faee8521ec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:24:51.443 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:51.443 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-08-17T02:24:51.497 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:51.497+0000 7fb907d6bec0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-17T02:24:51.500 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:51.500 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-08-17T02:24:51.597 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:51.597 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-08-17T02:24:51.645 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:51.645+0000 7fb907d6bec0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:51.683 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:51.683+0000 7faee8521ec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:24:51.695 DEBUG:teuthology.orchestra.run.smithi169:> set -ex 2024-08-17T02:24:51.695 DEBUG:teuthology.orchestra.run.smithi169:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-08-17T02:24:51.707 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:51.707+0000 7fb907d6bec0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-17T02:24:51.738 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:51.737+0000 7faee8521ec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:24:51.764 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 4aee70be-946b-43f2-be3e-022611970bc3 0 2024-08-17T02:24:51.953 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.953+0000 7f8fdf200640 1 Processor -- start 2024-08-17T02:24:51.954 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.953+0000 7f8fdf200640 1 -- start start 2024-08-17T02:24:51.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.954+0000 7f8fdf200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8fd8159aa0 0x7f8fd80ce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:51.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.955+0000 7f8fdf200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 0x7f8fd81629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:51.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.955+0000 7f8fdf200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fd80cad60 con 0x7f8fd8159e70 2024-08-17T02:24:51.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.955+0000 7f8fdf200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fd80c4b90 con 0x7f8fd8159aa0 2024-08-17T02:24:51.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.955+0000 7f8fdf200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd80ce630 con 0x7f8fd80ccf00 2024-08-17T02:24:51.955 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.955+0000 7f8fde800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 0x7f8fd81629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:51.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.955+0000 7f8fde800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 0x7f8fd81629f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:46644/0 (socket says 172.21.15.169:46644) 2024-08-17T02:24:51.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.955+0000 7f8fde800640 1 -- 172.21.15.169:0/1305107361 learned_addr learned my addr 172.21.15.169:0/1305107361 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:51.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.955+0000 7f8fdde00640 1 --2- 172.21.15.169:0/1305107361 >> v2:172.21.15.169:3300/0 conn(0x7f8fd8159aa0 0x7f8fd80ce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:51.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.955+0000 7f8fde800640 1 -- 172.21.15.169:0/1305107361 >> v2:172.21.15.169:3300/0 conn(0x7f8fd8159aa0 msgr2=0x7f8fd80ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:51.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.955+0000 7f8fde800640 1 --2- 172.21.15.169:0/1305107361 >> v2:172.21.15.169:3300/0 conn(0x7f8fd8159aa0 0x7f8fd80ce050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.955+0000 7f8fde800640 1 -- 172.21.15.169:0/1305107361 >> v1:172.21.15.45:6789/0 conn(0x7f8fd8159e70 legacy=0x7f8fd80cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:51.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.956+0000 7f8fde800640 1 -- 172.21.15.169:0/1305107361 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd80ce910 con 0x7f8fd80ccf00 2024-08-17T02:24:51.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.957+0000 7f8fde800640 1 --2- 172.21.15.169:0/1305107361 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 0x7f8fd81629f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009f20 tx=0x7f8fd4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe4345e0ec382cfc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:51.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.957+0000 7f8fdca00640 1 -- 172.21.15.169:0/1305107361 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4031400 con 0x7f8fd80ccf00 2024-08-17T02:24:51.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.957+0000 7f8fdca00640 1 -- 172.21.15.169:0/1305107361 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd402d050 con 0x7f8fd80ccf00 2024-08-17T02:24:51.957 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.957+0000 7f8fdca00640 1 -- 172.21.15.169:0/1305107361 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd40317d0 con 0x7f8fd80ccf00 2024-08-17T02:24:51.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.957+0000 7f8fdf200640 1 -- 172.21.15.169:0/1305107361 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 msgr2=0x7f8fd81629f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:51.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.957+0000 7f8fdf200640 1 --2- 172.21.15.169:0/1305107361 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 0x7f8fd81629f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4009f20 tx=0x7f8fd4009840 comp rx=0 tx=0).stop 2024-08-17T02:24:51.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.958+0000 7f8fdf200640 1 -- 172.21.15.169:0/1305107361 shutdown_connections 2024-08-17T02:24:51.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.958+0000 7f8fdf200640 1 --2- 172.21.15.169:0/1305107361 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 0x7f8fd81629f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.958+0000 7f8fdf200640 1 --2- 172.21.15.169:0/1305107361 >> v2:172.21.15.169:3300/0 conn(0x7f8fd8159aa0 0x7f8fd80ce050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.958+0000 7f8fdf200640 1 -- 172.21.15.169:0/1305107361 >> 172.21.15.169:0/1305107361 conn(0x7f8fd8099040 msgr2=0x7f8fd806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:51.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.958+0000 7f8fdf200640 1 -- 172.21.15.169:0/1305107361 shutdown_connections 2024-08-17T02:24:51.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.958+0000 7f8fdf200640 1 -- 172.21.15.169:0/1305107361 wait complete. 2024-08-17T02:24:51.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.959+0000 7f8fdf200640 1 Processor -- start 2024-08-17T02:24:51.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.959+0000 7f8fdf200640 1 -- start start 2024-08-17T02:24:51.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.960+0000 7f8fdf200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 0x7f8fd80999b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:51.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.960+0000 7f8fdf200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd8159aa0 0x7f8fd8146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:51.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.960+0000 7f8fdf200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fd8159e70 0x7f8fd809aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:51.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.960+0000 7f8fdf200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd809a9b0 con 0x7f8fd8159aa0 2024-08-17T02:24:51.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.960+0000 7f8fdf200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd8155eb0 con 0x7f8fd8159e70 2024-08-17T02:24:51.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.960+0000 7f8fdf200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fd816a0d0 con 0x7f8fd80ccf00 2024-08-17T02:24:51.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.960+0000 7f8fde800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fd8159e70 0x7f8fd809aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:51.961 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.960+0000 7f8fdde00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 0x7f8fd80999b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:51.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.960+0000 7f8fdd400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd8159aa0 0x7f8fd8146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:51.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.960+0000 7f8fde800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fd8159e70 0x7f8fd809aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:55238/0 (socket says 172.21.15.169:55238) 2024-08-17T02:24:51.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.960+0000 7f8fde800640 1 -- 172.21.15.169:0/3068840110 learned_addr learned my addr 172.21.15.169:0/3068840110 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:51.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.961+0000 7f8fdde00640 1 -- 172.21.15.169:0/3068840110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fd8159e70 msgr2=0x7f8fd809aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:51.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.961+0000 7f8fdde00640 1 --2- 172.21.15.169:0/3068840110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fd8159e70 0x7f8fd809aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.961+0000 7f8fdde00640 1 -- 172.21.15.169:0/3068840110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd8159aa0 msgr2=0x7f8fd8146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:51.962 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.961+0000 7f8fdde00640 1 --2- 172.21.15.169:0/3068840110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd8159aa0 0x7f8fd8146fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:51.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.961+0000 7f8fdde00640 1 -- 172.21.15.169:0/3068840110 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd4009ae0 con 0x7f8fd80ccf00 2024-08-17T02:24:51.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.961+0000 7f8fdd400640 1 --2- 172.21.15.169:0/3068840110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd8159aa0 0x7f8fd8146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:51.963 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.961+0000 7f8fdde00640 1 --2- 172.21.15.169:0/3068840110 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 0x7f8fd80999b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00d890 tx=0x7f8fcc008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:51.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.961+0000 7f8fd1600640 1 -- 172.21.15.169:0/3068840110 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00b6c0 con 0x7f8fd80ccf00 2024-08-17T02:24:51.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.961+0000 7f8fd1600640 1 -- 172.21.15.169:0/3068840110 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fcc00b820 con 0x7f8fd80ccf00 2024-08-17T02:24:51.964 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.962+0000 7f8fdf200640 1 -- 172.21.15.169:0/3068840110 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fd81694c0 con 0x7f8fd80ccf00 2024-08-17T02:24:51.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.962+0000 7f8fd1600640 1 -- 172.21.15.169:0/3068840110 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc00bbc0 con 0x7f8fd80ccf00 2024-08-17T02:24:51.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.962+0000 7f8fdf200640 1 -- 172.21.15.169:0/3068840110 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fd8169850 con 0x7f8fd80ccf00 2024-08-17T02:24:51.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.962+0000 7f8fd1600640 1 -- 172.21.15.169:0/3068840110 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8fcc01e6f0 con 0x7f8fd80ccf00 2024-08-17T02:24:51.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.962+0000 7f8fd1600640 1 -- 172.21.15.169:0/3068840110 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f8fcc014780 con 0x7f8fd80ccf00 2024-08-17T02:24:51.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.963+0000 7f8fdf200640 1 -- 172.21.15.169:0/3068840110 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fd8071050 con 0x7f8fd80ccf00 2024-08-17T02:24:51.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:51.965+0000 7f8fd1600640 1 -- 172.21.15.169:0/3068840110 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8fcc01eb30 con 0x7f8fd80ccf00 2024-08-17T02:24:52.005 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:52.005+0000 7fb907d6bec0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-17T02:24:52.041 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.041+0000 7f8fdf200640 1 -- 172.21.15.169:0/3068840110 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4aee70be-946b-43f2-be3e-022611970bc3", "id": 0} v 0) v1 -- 0x7f8fd806f480 con 0x7f8fd80ccf00 2024-08-17T02:24:52.045 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.045+0000 7f8fd1600640 1 -- 172.21.15.169:0/3068840110 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4aee70be-946b-43f2-be3e-022611970bc3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8fcc01ecd0 con 0x7f8fd80ccf00 2024-08-17T02:24:52.046 INFO:teuthology.orchestra.run.smithi169.stdout:0 2024-08-17T02:24:52.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.046+0000 7f8fdf200640 1 -- 172.21.15.169:0/3068840110 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 msgr2=0x7f8fd80999b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.047+0000 7f8fdf200640 1 --2- 172.21.15.169:0/3068840110 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 0x7f8fd80999b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc00d890 tx=0x7f8fcc008040 comp rx=0 tx=0).stop 2024-08-17T02:24:52.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.047+0000 7f8fdf200640 1 -- 172.21.15.169:0/3068840110 shutdown_connections 2024-08-17T02:24:52.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.047+0000 7f8fdf200640 1 --2- 172.21.15.169:0/3068840110 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8fd8159e70 0x7f8fd809aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.047+0000 7f8fdf200640 1 --2- 172.21.15.169:0/3068840110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8fd8159aa0 0x7f8fd8146fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.047 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.047+0000 7f8fdf200640 1 --2- 172.21.15.169:0/3068840110 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8fd80ccf00 0x7f8fd80999b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.047+0000 7f8fdf200640 1 -- 172.21.15.169:0/3068840110 >> 172.21.15.169:0/3068840110 conn(0x7f8fd8099040 msgr2=0x7f8fd80cd920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:52.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.047+0000 7f8fdf200640 1 -- 172.21.15.169:0/3068840110 shutdown_connections 2024-08-17T02:24:52.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.047+0000 7f8fdf200640 1 -- 172.21.15.169:0/3068840110 wait complete. 2024-08-17T02:24:52.058 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:52.059+0000 7fb907d6bec0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-17T02:24:52.061 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new dd5d03c0-cf41-46b6-b8aa-6a5f3445c515 1 2024-08-17T02:24:52.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.206+0000 7f8060600640 1 Processor -- start 2024-08-17T02:24:52.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.207+0000 7f8060600640 1 -- start start 2024-08-17T02:24:52.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f8060600640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f80580ca2f0 0x7f80580ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f8060600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80580c7370 0x7f80580c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f8060600640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805806f240 con 0x7f8058158ea0 2024-08-17T02:24:52.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f8060600640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80580c6f20 con 0x7f80580c7370 2024-08-17T02:24:52.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f8060600640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80580cacb0 con 0x7f80580ca2f0 2024-08-17T02:24:52.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f805d200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f80580ca2f0 0x7f80580ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f805d200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f80580ca2f0 0x7f80580ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:55240/0 (socket says 172.21.15.169:55240) 2024-08-17T02:24:52.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f805d200640 1 -- 172.21.15.169:0/3886044434 learned_addr learned my addr 172.21.15.169:0/3886044434 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:52.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f805dc00640 1 --1- 172.21.15.169:0/3886044434 >> v1:172.21.15.169:6789/0 conn(0x7f8058158ea0 0x7f80580d0460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:55680/0 (socket says 172.21.15.169:55680) 2024-08-17T02:24:52.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f805e600640 1 --2- 172.21.15.169:0/3886044434 >> v2:172.21.15.45:3300/0 conn(0x7f80580c7370 0x7f80580c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f805d200640 1 -- 172.21.15.169:0/3886044434 >> v2:172.21.15.45:3300/0 conn(0x7f80580c7370 msgr2=0x7f80580c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:52.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f805d200640 1 --2- 172.21.15.169:0/3886044434 >> v2:172.21.15.45:3300/0 conn(0x7f80580c7370 0x7f80580c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f805d200640 1 -- 172.21.15.169:0/3886044434 >> v1:172.21.15.169:6789/0 conn(0x7f8058158ea0 legacy=0x7f80580d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.208+0000 7f805d200640 1 -- 172.21.15.169:0/3886044434 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80580cf410 con 0x7f80580ca2f0 2024-08-17T02:24:52.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.209+0000 7f805e600640 1 --2- 172.21.15.169:0/3886044434 >> v2:172.21.15.45:3300/0 conn(0x7f80580c7370 0x7f80580c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:24:52.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.210+0000 7f805d200640 1 --2- 172.21.15.169:0/3886044434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580ca2f0 0x7f80580ca770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f805809dc60 tx=0x7f80440091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8963f59bdd962b91 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:52.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.210+0000 7f8057e00640 1 -- 172.21.15.169:0/3886044434 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804402add0 con 0x7f80580ca2f0 2024-08-17T02:24:52.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.210+0000 7f8057e00640 1 -- 172.21.15.169:0/3886044434 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8044032440 con 0x7f80580ca2f0 2024-08-17T02:24:52.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.210+0000 7f8057e00640 1 -- 172.21.15.169:0/3886044434 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044032820 con 0x7f80580ca2f0 2024-08-17T02:24:52.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.211+0000 7f8060600640 1 -- 172.21.15.169:0/3886044434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580ca2f0 msgr2=0x7f80580ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.211+0000 7f8060600640 1 --2- 172.21.15.169:0/3886044434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580ca2f0 0x7f80580ca770 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f805809dc60 tx=0x7f80440091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.211+0000 7f8060600640 1 -- 172.21.15.169:0/3886044434 shutdown_connections 2024-08-17T02:24:52.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.211+0000 7f8060600640 1 --2- 172.21.15.169:0/3886044434 >> v2:172.21.15.45:3300/0 conn(0x7f80580c7370 0x7f80580c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.211+0000 7f8060600640 1 --2- 172.21.15.169:0/3886044434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580ca2f0 0x7f80580ca770 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.211+0000 7f8060600640 1 -- 172.21.15.169:0/3886044434 >> 172.21.15.169:0/3886044434 conn(0x7f805806eb90 msgr2=0x7f80580cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:52.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.211+0000 7f8060600640 1 -- 172.21.15.169:0/3886044434 shutdown_connections 2024-08-17T02:24:52.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.211+0000 7f8060600640 1 -- 172.21.15.169:0/3886044434 wait complete. 2024-08-17T02:24:52.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.212+0000 7f8060600640 1 Processor -- start 2024-08-17T02:24:52.213 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.213+0000 7f8060600640 1 -- start start 2024-08-17T02:24:52.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.213+0000 7f8060600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80580c7370 0x7f805809a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.213+0000 7f8060600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580ca2f0 0x7f805809cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.213+0000 7f8060600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8058158ea0 0x7f805809cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.213+0000 7f8060600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80581442c0 con 0x7f8058158ea0 2024-08-17T02:24:52.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.213+0000 7f8060600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805809b2b0 con 0x7f80580ca2f0 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.213+0000 7f8060600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805809a6a0 con 0x7f80580c7370 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.214+0000 7f805d200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580ca2f0 0x7f805809cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.214+0000 7f805dc00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80580c7370 0x7f805809a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.214+0000 7f805d200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580ca2f0 0x7f805809cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:55250/0 (socket says 172.21.15.169:55250) 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.214+0000 7f805d200640 1 -- 172.21.15.169:0/703404584 learned_addr learned my addr 172.21.15.169:0/703404584 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.214+0000 7f805e600640 1 --2- 172.21.15.169:0/703404584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8058158ea0 0x7f805809cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.214+0000 7f805d200640 1 -- 172.21.15.169:0/703404584 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80580c7370 msgr2=0x7f805809a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.214+0000 7f805d200640 1 --2- 172.21.15.169:0/703404584 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80580c7370 0x7f805809a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.214+0000 7f805d200640 1 -- 172.21.15.169:0/703404584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8058158ea0 msgr2=0x7f805809cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.214+0000 7f805d200640 1 --2- 172.21.15.169:0/703404584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8058158ea0 0x7f805809cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.214+0000 7f805d200640 1 -- 172.21.15.169:0/703404584 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8044009450 con 0x7f80580ca2f0 2024-08-17T02:24:52.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.214+0000 7f805d200640 1 --2- 172.21.15.169:0/703404584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580ca2f0 0x7f805809cab0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8044009210 tx=0x7f8044032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:52.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.215+0000 7f8054c00640 1 -- 172.21.15.169:0/703404584 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044031de0 con 0x7f80580ca2f0 2024-08-17T02:24:52.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.215+0000 7f8054c00640 1 -- 172.21.15.169:0/703404584 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804403d420 con 0x7f80580ca2f0 2024-08-17T02:24:52.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.215+0000 7f8054c00640 1 -- 172.21.15.169:0/703404584 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804403d820 con 0x7f80580ca2f0 2024-08-17T02:24:52.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.215+0000 7f8060600640 1 -- 172.21.15.169:0/703404584 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805809a980 con 0x7f80580ca2f0 2024-08-17T02:24:52.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.215+0000 7f8060600640 1 -- 172.21.15.169:0/703404584 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f805809af40 con 0x7f80580ca2f0 2024-08-17T02:24:52.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.215+0000 7f8054c00640 1 -- 172.21.15.169:0/703404584 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f8044039040 con 0x7f80580ca2f0 2024-08-17T02:24:52.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.215+0000 7f8054c00640 1 -- 172.21.15.169:0/703404584 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f804403b3f0 con 0x7f80580ca2f0 2024-08-17T02:24:52.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.216+0000 7f8060600640 1 -- 172.21.15.169:0/703404584 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8058071050 con 0x7f80580ca2f0 2024-08-17T02:24:52.218 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.218+0000 7f8054c00640 1 -- 172.21.15.169:0/703404584 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f8044042070 con 0x7f80580ca2f0 2024-08-17T02:24:52.292 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.292+0000 7f8060600640 1 -- 172.21.15.169:0/703404584 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dd5d03c0-cf41-46b6-b8aa-6a5f3445c515", "id": 1} v 0) v1 -- 0x7f805809b3f0 con 0x7f80580ca2f0 2024-08-17T02:24:52.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.296+0000 7f8054c00640 1 -- 172.21.15.169:0/703404584 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dd5d03c0-cf41-46b6-b8aa-6a5f3445c515", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8044037070 con 0x7f80580ca2f0 2024-08-17T02:24:52.296 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-08-17T02:24:52.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.297+0000 7f8060600640 1 -- 172.21.15.169:0/703404584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580ca2f0 msgr2=0x7f805809cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.297+0000 7f8060600640 1 --2- 172.21.15.169:0/703404584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580ca2f0 0x7f805809cab0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8044009210 tx=0x7f8044032000 comp rx=0 tx=0).stop 2024-08-17T02:24:52.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.297+0000 7f8060600640 1 -- 172.21.15.169:0/703404584 shutdown_connections 2024-08-17T02:24:52.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.297+0000 7f8060600640 1 --2- 172.21.15.169:0/703404584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8058158ea0 0x7f805809cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.297+0000 7f8060600640 1 --2- 172.21.15.169:0/703404584 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f80580ca2f0 0x7f805809cab0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.297+0000 7f8060600640 1 --2- 172.21.15.169:0/703404584 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f80580c7370 0x7f805809a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.297+0000 7f8060600640 1 -- 172.21.15.169:0/703404584 >> 172.21.15.169:0/703404584 conn(0x7f805806eb90 msgr2=0x7f80580c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:52.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.297+0000 7f8060600640 1 -- 172.21.15.169:0/703404584 shutdown_connections 2024-08-17T02:24:52.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.297+0000 7f8060600640 1 -- 172.21.15.169:0/703404584 wait complete. 2024-08-17T02:24:52.311 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new c07cc7a1-a863-4979-aa89-dee6b4b9b549 2 2024-08-17T02:24:52.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.456+0000 7f43d9400640 1 Processor -- start 2024-08-17T02:24:52.456 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.456+0000 7f43d9400640 1 -- start start 2024-08-17T02:24:52.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.457+0000 7f43d9400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f43d4158ea0 0x7f43d40d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.457+0000 7f43d9400640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d406f240 con 0x7f43d40caa00 2024-08-17T02:24:52.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.457+0000 7f43d9400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d40cf410 con 0x7f43d40d09a0 2024-08-17T02:24:52.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.457+0000 7f43d9400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d40c6f20 con 0x7f43d4158ea0 2024-08-17T02:24:52.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.457+0000 7f43d2800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f43d4158ea0 0x7f43d40d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.457+0000 7f43d2800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f43d4158ea0 0x7f43d40d0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:55254/0 (socket says 172.21.15.169:55254) 2024-08-17T02:24:52.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.457+0000 7f43d2800640 1 -- 172.21.15.169:0/4068317443 learned_addr learned my addr 172.21.15.169:0/4068317443 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:52.458 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.457+0000 7f43d1e00640 1 --1- 172.21.15.169:0/4068317443 >> v1:172.21.15.169:6789/0 conn(0x7f43d40d09a0 0x7f43d40ca2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:55684/0 (socket says 172.21.15.169:55684) 2024-08-17T02:24:52.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.458+0000 7f43d2800640 1 -- 172.21.15.169:0/4068317443 >> v1:172.21.15.169:6789/0 conn(0x7f43d40d09a0 legacy=0x7f43d40ca2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.458+0000 7f43d2800640 1 -- 172.21.15.169:0/4068317443 >> v1:172.21.15.45:6789/0 conn(0x7f43d40caa00 legacy=0x7f43d40c7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.459 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.458+0000 7f43d2800640 1 -- 172.21.15.169:0/4068317443 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d40ceb70 con 0x7f43d4158ea0 2024-08-17T02:24:52.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.459+0000 7f43d2800640 1 --2- 172.21.15.169:0/4068317443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d4158ea0 0x7f43d40d0460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009910 tx=0x7f43c40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=817580690caf29b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:52.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.459+0000 7f43d1400640 1 -- 172.21.15.169:0/4068317443 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c402ae60 con 0x7f43d4158ea0 2024-08-17T02:24:52.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.459+0000 7f43d1400640 1 -- 172.21.15.169:0/4068317443 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4032440 con 0x7f43d4158ea0 2024-08-17T02:24:52.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.459+0000 7f43d1400640 1 -- 172.21.15.169:0/4068317443 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c40327e0 con 0x7f43d4158ea0 2024-08-17T02:24:52.460 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.460+0000 7f43d9400640 1 -- 172.21.15.169:0/4068317443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d4158ea0 msgr2=0x7f43d40d0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.460+0000 7f43d9400640 1 --2- 172.21.15.169:0/4068317443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d4158ea0 0x7f43d40d0460 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f43c4009910 tx=0x7f43c40091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.460+0000 7f43d9400640 1 -- 172.21.15.169:0/4068317443 shutdown_connections 2024-08-17T02:24:52.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.460+0000 7f43d9400640 1 --2- 172.21.15.169:0/4068317443 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d4158ea0 0x7f43d40d0460 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.460+0000 7f43d9400640 1 -- 172.21.15.169:0/4068317443 >> 172.21.15.169:0/4068317443 conn(0x7f43d406eb90 msgr2=0x7f43d40cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:52.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.460+0000 7f43d9400640 1 -- 172.21.15.169:0/4068317443 shutdown_connections 2024-08-17T02:24:52.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.460+0000 7f43d9400640 1 -- 172.21.15.169:0/4068317443 wait complete. 2024-08-17T02:24:52.461 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.461+0000 7f43d9400640 1 Processor -- start 2024-08-17T02:24:52.462 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.462+0000 7f43d9400640 1 -- start start 2024-08-17T02:24:52.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.462+0000 7f43d9400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40caa00 0x7f43d40b1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.462+0000 7f43d9400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d40d09a0 0x7f43d409d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d9400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4158ea0 0x7f43d409a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d9400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d409cfa0 con 0x7f43d40d09a0 2024-08-17T02:24:52.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d9400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d409c390 con 0x7f43d40caa00 2024-08-17T02:24:52.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d9400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d409c670 con 0x7f43d4158ea0 2024-08-17T02:24:52.464 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d2800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40caa00 0x7f43d40b1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d3200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4158ea0 0x7f43d409a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d2800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40caa00 0x7f43d40b1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:55260/0 (socket says 172.21.15.169:55260) 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d2800640 1 -- 172.21.15.169:0/568752776 learned_addr learned my addr 172.21.15.169:0/568752776 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d1e00640 1 --2- 172.21.15.169:0/568752776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d40d09a0 0x7f43d409d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d2800640 1 -- 172.21.15.169:0/568752776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4158ea0 msgr2=0x7f43d409a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d2800640 1 --2- 172.21.15.169:0/568752776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4158ea0 0x7f43d409a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d2800640 1 -- 172.21.15.169:0/568752776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d40d09a0 msgr2=0x7f43d409d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d2800640 1 --2- 172.21.15.169:0/568752776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d40d09a0 0x7f43d409d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d2800640 1 -- 172.21.15.169:0/568752776 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4009450 con 0x7f43d40caa00 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.463+0000 7f43d3200640 1 --2- 172.21.15.169:0/568752776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4158ea0 0x7f43d409a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:52.465 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.464+0000 7f43d2800640 1 --2- 172.21.15.169:0/568752776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40caa00 0x7f43d40b1ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f43c4035040 tx=0x7f43c4032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:52.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.464+0000 7f43ca000640 1 -- 172.21.15.169:0/568752776 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4031de0 con 0x7f43d40caa00 2024-08-17T02:24:52.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.464+0000 7f43ca000640 1 -- 172.21.15.169:0/568752776 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c403d420 con 0x7f43d40caa00 2024-08-17T02:24:52.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.464+0000 7f43ca000640 1 -- 172.21.15.169:0/568752776 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c403d7e0 con 0x7f43d40caa00 2024-08-17T02:24:52.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.464+0000 7f43d9400640 1 -- 172.21.15.169:0/568752776 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d409c950 con 0x7f43d40caa00 2024-08-17T02:24:52.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.464+0000 7f43d9400640 1 -- 172.21.15.169:0/568752776 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d409d970 con 0x7f43d40caa00 2024-08-17T02:24:52.466 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.464+0000 7f43ca000640 1 -- 172.21.15.169:0/568752776 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f43c4039040 con 0x7f43d40caa00 2024-08-17T02:24:52.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.464+0000 7f43ca000640 1 -- 172.21.15.169:0/568752776 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f43c403de20 con 0x7f43d40caa00 2024-08-17T02:24:52.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.465+0000 7f43d9400640 1 -- 172.21.15.169:0/568752776 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d409cdd0 con 0x7f43d40caa00 2024-08-17T02:24:52.467 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.467+0000 7f43ca000640 1 -- 172.21.15.169:0/568752776 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f43c4042070 con 0x7f43d40caa00 2024-08-17T02:24:52.543 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.542+0000 7f43d9400640 1 -- 172.21.15.169:0/568752776 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c07cc7a1-a863-4979-aa89-dee6b4b9b549", "id": 2} v 0) v1 -- 0x7f43d4071050 con 0x7f43d40caa00 2024-08-17T02:24:52.547 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.547+0000 7f43ca000640 1 -- 172.21.15.169:0/568752776 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c07cc7a1-a863-4979-aa89-dee6b4b9b549", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f43c402ae60 con 0x7f43d40caa00 2024-08-17T02:24:52.547 INFO:teuthology.orchestra.run.smithi169.stdout:2 2024-08-17T02:24:52.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.547+0000 7f43d9400640 1 -- 172.21.15.169:0/568752776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40caa00 msgr2=0x7f43d40b1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.547+0000 7f43d9400640 1 --2- 172.21.15.169:0/568752776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40caa00 0x7f43d40b1ab0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f43c4035040 tx=0x7f43c4032000 comp rx=0 tx=0).stop 2024-08-17T02:24:52.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.547+0000 7f43d9400640 1 -- 172.21.15.169:0/568752776 shutdown_connections 2024-08-17T02:24:52.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.547+0000 7f43d9400640 1 --2- 172.21.15.169:0/568752776 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43d4158ea0 0x7f43d409a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.547+0000 7f43d9400640 1 --2- 172.21.15.169:0/568752776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43d40d09a0 0x7f43d409d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.547+0000 7f43d9400640 1 --2- 172.21.15.169:0/568752776 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43d40caa00 0x7f43d40b1ab0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.548+0000 7f43d9400640 1 -- 172.21.15.169:0/568752776 >> 172.21.15.169:0/568752776 conn(0x7f43d406eb90 msgr2=0x7f43d4068c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:52.548 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.548+0000 7f43d9400640 1 -- 172.21.15.169:0/568752776 shutdown_connections 2024-08-17T02:24:52.549 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.548+0000 7f43d9400640 1 -- 172.21.15.169:0/568752776 wait complete. 2024-08-17T02:24:52.561 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new ea89b05e-87a2-4518-8dce-17e104366a9e 3 2024-08-17T02:24:52.626 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:52.625+0000 7faee8521ec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:24:52.706 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.706+0000 7f1f0be00640 1 Processor -- start 2024-08-17T02:24:52.707 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.707+0000 7f1f0be00640 1 -- start start 2024-08-17T02:24:52.708 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.708+0000 7f1f0be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f0c159b90 0x7f1f0c0ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.708+0000 7f1f0be00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1f0c0ca8a0 0x7f1f0c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.708+0000 7f1f0be00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f0c0cadc0 con 0x7f1f0c159f60 2024-08-17T02:24:52.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.708+0000 7f1f0be00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0c0cb880 con 0x7f1f0c159b90 2024-08-17T02:24:52.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.708+0000 7f1f0be00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f0c0cd6e0 con 0x7f1f0c0ca8a0 2024-08-17T02:24:52.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.708+0000 7f1f0a000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1f0c0ca8a0 0x7f1f0c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.708+0000 7f1f0a000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1f0c0ca8a0 0x7f1f0c0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:55264/0 (socket says 172.21.15.169:55264) 2024-08-17T02:24:52.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.708+0000 7f1f0a000640 1 -- 172.21.15.169:0/115237887 learned_addr learned my addr 172.21.15.169:0/115237887 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:52.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.708+0000 7f1f0aa00640 1 --2- 172.21.15.169:0/115237887 >> v2:172.21.15.45:3300/0 conn(0x7f1f0c159b90 0x7f1f0c0ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.708+0000 7f1f0a000640 1 -- 172.21.15.169:0/115237887 >> v2:172.21.15.45:3300/0 conn(0x7f1f0c159b90 msgr2=0x7f1f0c0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:52.709 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.708+0000 7f1f0a000640 1 --2- 172.21.15.169:0/115237887 >> v2:172.21.15.45:3300/0 conn(0x7f1f0c159b90 0x7f1f0c0ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.709+0000 7f1f0a000640 1 -- 172.21.15.169:0/115237887 >> v1:172.21.15.45:6789/0 conn(0x7f1f0c159f60 legacy=0x7f1f0c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.709+0000 7f1f0a000640 1 -- 172.21.15.169:0/115237887 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f0c0cb060 con 0x7f1f0c0ca8a0 2024-08-17T02:24:52.710 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.709+0000 7f1f0aa00640 1 --2- 172.21.15.169:0/115237887 >> v2:172.21.15.45:3300/0 conn(0x7f1f0c159b90 0x7f1f0c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:52.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.709+0000 7f1f0a000640 1 --2- 172.21.15.169:0/115237887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f0c0ca8a0 0x7f1f0c0cc590 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c09d9c0 tx=0x7f1ef80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b881b2a7b3ec6703 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:52.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.710+0000 7f1f09600640 1 -- 172.21.15.169:0/115237887 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef802ae80 con 0x7f1f0c0ca8a0 2024-08-17T02:24:52.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.710+0000 7f1f09600640 1 -- 172.21.15.169:0/115237887 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef8032440 con 0x7f1f0c0ca8a0 2024-08-17T02:24:52.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.710+0000 7f1f09600640 1 -- 172.21.15.169:0/115237887 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8032800 con 0x7f1f0c0ca8a0 2024-08-17T02:24:52.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.710+0000 7f1f0be00640 1 -- 172.21.15.169:0/115237887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f0c0ca8a0 msgr2=0x7f1f0c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.710+0000 7f1f0be00640 1 --2- 172.21.15.169:0/115237887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f0c0ca8a0 0x7f1f0c0cc590 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1f0c09d9c0 tx=0x7f1ef80091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.711+0000 7f1f0be00640 1 -- 172.21.15.169:0/115237887 shutdown_connections 2024-08-17T02:24:52.711 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.711+0000 7f1f0be00640 1 --2- 172.21.15.169:0/115237887 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f0c0ca8a0 0x7f1f0c0cc590 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.711+0000 7f1f0be00640 1 --2- 172.21.15.169:0/115237887 >> v2:172.21.15.45:3300/0 conn(0x7f1f0c159b90 0x7f1f0c0ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.711+0000 7f1f0be00640 1 -- 172.21.15.169:0/115237887 >> 172.21.15.169:0/115237887 conn(0x7f1f0c098e00 msgr2=0x7f1f0c06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:52.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.711+0000 7f1f0be00640 1 -- 172.21.15.169:0/115237887 shutdown_connections 2024-08-17T02:24:52.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.711+0000 7f1f0be00640 1 -- 172.21.15.169:0/115237887 wait complete. 2024-08-17T02:24:52.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.712+0000 7f1f0be00640 1 Processor -- start 2024-08-17T02:24:52.712 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.712+0000 7f1f0be00640 1 -- start start 2024-08-17T02:24:52.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.713+0000 7f1f0be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f0c0ca8a0 0x7f1f0c09cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.713+0000 7f1f0be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f0c159b90 0x7f1f0c0b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.713+0000 7f1f0be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f0c159f60 0x7f1f0c0b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.713+0000 7f1f0be00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c169fc0 con 0x7f1f0c0ca8a0 2024-08-17T02:24:52.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.713+0000 7f1f0be00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c16a320 con 0x7f1f0c159f60 2024-08-17T02:24:52.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.713+0000 7f1f0be00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f0c16a600 con 0x7f1f0c159b90 2024-08-17T02:24:52.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.713+0000 7f1f0a000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f0c159b90 0x7f1f0c0b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.713+0000 7f1f0aa00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f0c0ca8a0 0x7f1f0c09cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.713+0000 7f1f0a000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f0c159b90 0x7f1f0c0b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:46680/0 (socket says 172.21.15.169:46680) 2024-08-17T02:24:52.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.713+0000 7f1f0a000640 1 -- 172.21.15.169:0/1503734232 learned_addr learned my addr 172.21.15.169:0/1503734232 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:52.714 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.713+0000 7f1f0b400640 1 --2- 172.21.15.169:0/1503734232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f0c159f60 0x7f1f0c0b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.714+0000 7f1f0a000640 1 -- 172.21.15.169:0/1503734232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f0c159f60 msgr2=0x7f1f0c0b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.714+0000 7f1f0a000640 1 --2- 172.21.15.169:0/1503734232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f0c159f60 0x7f1f0c0b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.714+0000 7f1f0a000640 1 -- 172.21.15.169:0/1503734232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f0c0ca8a0 msgr2=0x7f1f0c09cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.714+0000 7f1f0a000640 1 --2- 172.21.15.169:0/1503734232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f0c0ca8a0 0x7f1f0c09cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.715 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.714+0000 7f1f0a000640 1 -- 172.21.15.169:0/1503734232 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef8009450 con 0x7f1f0c159b90 2024-08-17T02:24:52.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.714+0000 7f1f0a000640 1 --2- 172.21.15.169:0/1503734232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f0c159b90 0x7f1f0c0b4990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009210 tx=0x7f1ef8032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:52.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.714+0000 7f1f02000640 1 -- 172.21.15.169:0/1503734232 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8006b30 con 0x7f1f0c159b90 2024-08-17T02:24:52.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.714+0000 7f1f02000640 1 -- 172.21.15.169:0/1503734232 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ef8031a60 con 0x7f1f0c159b90 2024-08-17T02:24:52.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.714+0000 7f1f02000640 1 -- 172.21.15.169:0/1503734232 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ef8031e40 con 0x7f1f0c159b90 2024-08-17T02:24:52.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.714+0000 7f1f0be00640 1 -- 172.21.15.169:0/1503734232 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f0c16a8e0 con 0x7f1f0c159b90 2024-08-17T02:24:52.716 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.715+0000 7f1f0be00640 1 -- 172.21.15.169:0/1503734232 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f0c09d4a0 con 0x7f1f0c159b90 2024-08-17T02:24:52.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.715+0000 7f1f02000640 1 -- 172.21.15.169:0/1503734232 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f1ef8039040 con 0x7f1f0c159b90 2024-08-17T02:24:52.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.716+0000 7f1f02000640 1 -- 172.21.15.169:0/1503734232 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f1ef803d650 con 0x7f1f0c159b90 2024-08-17T02:24:52.717 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.716+0000 7f1f0be00640 1 -- 172.21.15.169:0/1503734232 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f0c071050 con 0x7f1f0c159b90 2024-08-17T02:24:52.718 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.718+0000 7f1f02000640 1 -- 172.21.15.169:0/1503734232 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f1ef8042070 con 0x7f1f0c159b90 2024-08-17T02:24:52.730 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:52.729+0000 7faee8521ec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:52.781 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:52.780+0000 7faee8521ec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:24:52.792 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.793+0000 7f1f0be00640 1 -- 172.21.15.169:0/1503734232 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ea89b05e-87a2-4518-8dce-17e104366a9e", "id": 3} v 0) v1 -- 0x7f1f0c0c32e0 con 0x7f1f0c159b90 2024-08-17T02:24:52.796 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.796+0000 7f1f02000640 1 -- 172.21.15.169:0/1503734232 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea89b05e-87a2-4518-8dce-17e104366a9e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1ef8037070 con 0x7f1f0c159b90 2024-08-17T02:24:52.797 INFO:teuthology.orchestra.run.smithi169.stdout:3 2024-08-17T02:24:52.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.797+0000 7f1f0be00640 1 -- 172.21.15.169:0/1503734232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f0c159b90 msgr2=0x7f1f0c0b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.797+0000 7f1f0be00640 1 --2- 172.21.15.169:0/1503734232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f0c159b90 0x7f1f0c0b4990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009210 tx=0x7f1ef8032000 comp rx=0 tx=0).stop 2024-08-17T02:24:52.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.797+0000 7f1f0be00640 1 -- 172.21.15.169:0/1503734232 shutdown_connections 2024-08-17T02:24:52.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.797+0000 7f1f0be00640 1 --2- 172.21.15.169:0/1503734232 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1f0c159f60 0x7f1f0c0b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.797+0000 7f1f0be00640 1 --2- 172.21.15.169:0/1503734232 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1f0c159b90 0x7f1f0c0b4990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.797+0000 7f1f0be00640 1 --2- 172.21.15.169:0/1503734232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f0c0ca8a0 0x7f1f0c09cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.797+0000 7f1f0be00640 1 -- 172.21.15.169:0/1503734232 >> 172.21.15.169:0/1503734232 conn(0x7f1f0c098e00 msgr2=0x7f1f0c068bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:52.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.798+0000 7f1f0be00640 1 -- 172.21.15.169:0/1503734232 shutdown_connections 2024-08-17T02:24:52.798 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.798+0000 7f1f0be00640 1 -- 172.21.15.169:0/1503734232 wait complete. 2024-08-17T02:24:52.811 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 46abe268-7497-409e-9161-a5a6b4753045 4 2024-08-17T02:24:52.932 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:52.932+0000 7fb907d6bec0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-17T02:24:52.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.956+0000 7f4010200640 1 Processor -- start 2024-08-17T02:24:52.956 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.956+0000 7f4010200640 1 -- start start 2024-08-17T02:24:52.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.958+0000 7f4010200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f40080ca2f0 0x7f40080ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.958+0000 7f4010200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f400806f240 con 0x7f40080c7370 2024-08-17T02:24:52.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.958+0000 7f4010200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40080cf410 con 0x7f4008158ea0 2024-08-17T02:24:52.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.958+0000 7f4010200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40080c6f20 con 0x7f40080ca2f0 2024-08-17T02:24:52.958 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.958+0000 7f400ce00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f40080ca2f0 0x7f40080ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.958+0000 7f400ce00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f40080ca2f0 0x7f40080ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:57592/0 (socket says 172.21.15.169:57592) 2024-08-17T02:24:52.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.958+0000 7f400ce00640 1 -- 172.21.15.169:0/4214096638 learned_addr learned my addr 172.21.15.169:0/4214096638 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:52.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.958+0000 7f400ce00640 1 -- 172.21.15.169:0/4214096638 >> v1:172.21.15.169:6789/0 conn(0x7f4008158ea0 legacy=0x7f40080d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.958+0000 7f400ce00640 1 -- 172.21.15.169:0/4214096638 >> v1:172.21.15.45:6789/0 conn(0x7f40080c7370 legacy=0x7f40080c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.959 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.958+0000 7f400ce00640 1 -- 172.21.15.169:0/4214096638 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080d0b70 con 0x7f40080ca2f0 2024-08-17T02:24:52.962 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:52.958+0000 7faee8521ec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:24:52.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.959+0000 7f400ce00640 1 --2- 172.21.15.169:0/4214096638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40080ca2f0 0x7f40080ca770 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009910 tx=0x7f3ff40091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8da96c12a9561c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:52.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.959+0000 7f4007e00640 1 -- 172.21.15.169:0/4214096638 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff402ae60 con 0x7f40080ca2f0 2024-08-17T02:24:52.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.960+0000 7f4007e00640 1 -- 172.21.15.169:0/4214096638 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff4032440 con 0x7f40080ca2f0 2024-08-17T02:24:52.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.960+0000 7f4007e00640 1 -- 172.21.15.169:0/4214096638 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff40327e0 con 0x7f40080ca2f0 2024-08-17T02:24:52.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.960+0000 7f4010200640 1 -- 172.21.15.169:0/4214096638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40080ca2f0 msgr2=0x7f40080ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.960+0000 7f4010200640 1 --2- 172.21.15.169:0/4214096638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40080ca2f0 0x7f40080ca770 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ff4009910 tx=0x7f3ff40091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.960+0000 7f4010200640 1 -- 172.21.15.169:0/4214096638 shutdown_connections 2024-08-17T02:24:52.965 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.960+0000 7f4010200640 1 --2- 172.21.15.169:0/4214096638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40080ca2f0 0x7f40080ca770 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.960+0000 7f4010200640 1 -- 172.21.15.169:0/4214096638 >> 172.21.15.169:0/4214096638 conn(0x7f400806eb90 msgr2=0x7f40080cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.960+0000 7f4010200640 1 -- 172.21.15.169:0/4214096638 shutdown_connections 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.960+0000 7f4010200640 1 -- 172.21.15.169:0/4214096638 wait complete. 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.962+0000 7f4010200640 1 Processor -- start 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.962+0000 7f4010200640 1 -- start start 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f4010200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40080c7370 0x7f40080b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f4010200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40080ca2f0 0x7f400809c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f4010200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4008158ea0 0x7f400809c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f4010200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40080b3e40 con 0x7f40080ca2f0 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f4010200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40080b4120 con 0x7f4008158ea0 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f4010200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40080b4400 con 0x7f40080c7370 2024-08-17T02:24:52.966 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f400e200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4008158ea0 0x7f400809c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f400ce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40080ca2f0 0x7f400809c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f400e200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4008158ea0 0x7f400809c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:57596/0 (socket says 172.21.15.169:57596) 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f400e200640 1 -- 172.21.15.169:0/3972270175 learned_addr learned my addr 172.21.15.169:0/3972270175 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f400d800640 1 --2- 172.21.15.169:0/3972270175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40080c7370 0x7f40080b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f400e200640 1 -- 172.21.15.169:0/3972270175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40080c7370 msgr2=0x7f40080b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f400e200640 1 --2- 172.21.15.169:0/3972270175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40080c7370 0x7f40080b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f400e200640 1 -- 172.21.15.169:0/3972270175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40080ca2f0 msgr2=0x7f400809c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f400e200640 1 --2- 172.21.15.169:0/3972270175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40080ca2f0 0x7f400809c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f400e200640 1 -- 172.21.15.169:0/3972270175 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff4009450 con 0x7f4008158ea0 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.963+0000 7f400ce00640 1 --2- 172.21.15.169:0/3972270175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40080ca2f0 0x7f400809c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.964+0000 7f400e200640 1 --2- 172.21.15.169:0/3972270175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4008158ea0 0x7f400809c610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f400000c7c0 tx=0x7f40000015f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:52.967 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.964+0000 7f4004c00640 1 -- 172.21.15.169:0/3972270175 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000a640 con 0x7f4008158ea0 2024-08-17T02:24:52.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.964+0000 7f4004c00640 1 -- 172.21.15.169:0/3972270175 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400000a7c0 con 0x7f4008158ea0 2024-08-17T02:24:52.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.964+0000 7f4010200640 1 -- 172.21.15.169:0/3972270175 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40080b46e0 con 0x7f4008158ea0 2024-08-17T02:24:52.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.964+0000 7f4004c00640 1 -- 172.21.15.169:0/3972270175 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000ab80 con 0x7f4008158ea0 2024-08-17T02:24:52.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.964+0000 7f4010200640 1 -- 172.21.15.169:0/3972270175 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40080b3b50 con 0x7f4008158ea0 2024-08-17T02:24:52.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.964+0000 7f4004c00640 1 -- 172.21.15.169:0/3972270175 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f4000003030 con 0x7f4008158ea0 2024-08-17T02:24:52.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.964+0000 7f4004c00640 1 -- 172.21.15.169:0/3972270175 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f4000012420 con 0x7f4008158ea0 2024-08-17T02:24:52.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.965+0000 7f4010200640 1 -- 172.21.15.169:0/3972270175 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4008071050 con 0x7f4008158ea0 2024-08-17T02:24:52.968 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:52.967+0000 7f4004c00640 1 -- 172.21.15.169:0/3972270175 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f4000012670 con 0x7f4008158ea0 2024-08-17T02:24:53.029 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:53.028+0000 7faee8521ec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:24:53.036 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:53.037+0000 7fb907d6bec0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:53.043 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.043+0000 7f4010200640 1 -- 172.21.15.169:0/3972270175 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46abe268-7497-409e-9161-a5a6b4753045", "id": 4} v 0) v1 -- 0x7f40080cf600 con 0x7f4008158ea0 2024-08-17T02:24:53.046 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.046+0000 7f4004c00640 1 -- 172.21.15.169:0/3972270175 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46abe268-7497-409e-9161-a5a6b4753045", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4000012ab0 con 0x7f4008158ea0 2024-08-17T02:24:53.047 INFO:teuthology.orchestra.run.smithi169.stdout:4 2024-08-17T02:24:53.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.047+0000 7f4010200640 1 -- 172.21.15.169:0/3972270175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4008158ea0 msgr2=0x7f400809c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.047+0000 7f4010200640 1 --2- 172.21.15.169:0/3972270175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4008158ea0 0x7f400809c610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f400000c7c0 tx=0x7f40000015f0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.048+0000 7f4010200640 1 -- 172.21.15.169:0/3972270175 shutdown_connections 2024-08-17T02:24:53.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.048+0000 7f4010200640 1 --2- 172.21.15.169:0/3972270175 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4008158ea0 0x7f400809c610 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.048+0000 7f4010200640 1 --2- 172.21.15.169:0/3972270175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40080ca2f0 0x7f400809c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.048+0000 7f4010200640 1 --2- 172.21.15.169:0/3972270175 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f40080c7370 0x7f40080b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.048+0000 7f4010200640 1 -- 172.21.15.169:0/3972270175 >> 172.21.15.169:0/3972270175 conn(0x7f400806eb90 msgr2=0x7f4008068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:53.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.048+0000 7f4010200640 1 -- 172.21.15.169:0/3972270175 shutdown_connections 2024-08-17T02:24:53.048 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.048+0000 7f4010200640 1 -- 172.21.15.169:0/3972270175 wait complete. 2024-08-17T02:24:53.061 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 2d2374fd-7006-4541-92c3-df5add5ca647 5 2024-08-17T02:24:53.090 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:53.091+0000 7fb907d6bec0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-17T02:24:53.093 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:53.092+0000 7faee8521ec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:24:53.205 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:53.204+0000 7faee8521ec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:53.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.206+0000 7fdbff200640 1 Processor -- start 2024-08-17T02:24:53.207 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.207+0000 7fdbff200640 1 -- start start 2024-08-17T02:24:53.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.208+0000 7fdbff200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc00159b90 0x7fdc000ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.208+0000 7fdbff200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc000cadc0 con 0x7fdc000ccca0 2024-08-17T02:24:53.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.208+0000 7fdbff200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc000cb060 con 0x7fdc000ca8a0 2024-08-17T02:24:53.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.208+0000 7fdbff200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000cb880 con 0x7fdc00159b90 2024-08-17T02:24:53.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.208+0000 7fdbfde00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc00159b90 0x7fdc000ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.208+0000 7fdbfd400640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fdc000ca8a0 0x7fdc000cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:39424/0 (socket says 172.21.15.169:39424) 2024-08-17T02:24:53.208 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.208+0000 7fdbfd400640 1 -- 172.21.15.169:0/3634013238 learned_addr learned my addr 172.21.15.169:0/3634013238 (peer_addr_for_me v1:172.21.15.169:0/0) 2024-08-17T02:24:53.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.208+0000 7fdbfde00640 1 -- 172.21.15.169:0/3634013238 >> v1:172.21.15.169:6789/0 conn(0x7fdc000ca8a0 legacy=0x7fdc000cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.208+0000 7fdbfde00640 1 -- 172.21.15.169:0/3634013238 >> v1:172.21.15.45:6789/0 conn(0x7fdc000ccca0 legacy=0x7fdc00162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:53.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.208+0000 7fdbfca00640 1 -- 172.21.15.169:0/3634013238 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462130823 0 0) 0x7fdc000cb060 con 0x7fdc000ca8a0 2024-08-17T02:24:53.209 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.208+0000 7fdbfde00640 1 -- 172.21.15.169:0/3634013238 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc000cb300 con 0x7fdc00159b90 2024-08-17T02:24:53.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.209+0000 7fdbfde00640 1 --2- 172.21.15.169:0/3634013238 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc00159b90 0x7fdc000ca360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009880 tx=0x7fdbf00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f8e7f592a5c0ece server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:53.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.210+0000 7fdbfca00640 1 -- 172.21.15.169:0/3634013238 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf002ad70 con 0x7fdc00159b90 2024-08-17T02:24:53.210 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.210+0000 7fdbfca00640 1 -- 172.21.15.169:0/3634013238 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf0032440 con 0x7fdc00159b90 2024-08-17T02:24:53.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.210+0000 7fdbfca00640 1 -- 172.21.15.169:0/3634013238 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00327e0 con 0x7fdc00159b90 2024-08-17T02:24:53.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.210+0000 7fdbff200640 1 -- 172.21.15.169:0/3634013238 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc00159b90 msgr2=0x7fdc000ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.210+0000 7fdbff200640 1 --2- 172.21.15.169:0/3634013238 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc00159b90 0x7fdc000ca360 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009880 tx=0x7fdbf00090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.210+0000 7fdbff200640 1 -- 172.21.15.169:0/3634013238 shutdown_connections 2024-08-17T02:24:53.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.210+0000 7fdbff200640 1 --2- 172.21.15.169:0/3634013238 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc00159b90 0x7fdc000ca360 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.210+0000 7fdbff200640 1 -- 172.21.15.169:0/3634013238 >> 172.21.15.169:0/3634013238 conn(0x7fdc00098e00 msgr2=0x7fdc0006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:53.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.210+0000 7fdbff200640 1 -- 172.21.15.169:0/3634013238 shutdown_connections 2024-08-17T02:24:53.211 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.210+0000 7fdbff200640 1 -- 172.21.15.169:0/3634013238 wait complete. 2024-08-17T02:24:53.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.212+0000 7fdbff200640 1 Processor -- start 2024-08-17T02:24:53.212 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.212+0000 7fdbff200640 1 -- start start 2024-08-17T02:24:53.214 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbff200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc000ca8a0 0x7fdc00168760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbff200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc000ccca0 0x7fdc0009ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbff200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc00159b90 0x7fdc0016c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbff200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc00099ab0 con 0x7fdc00159b90 2024-08-17T02:24:53.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbff200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0009bd90 con 0x7fdc000ccca0 2024-08-17T02:24:53.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbff200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0009c070 con 0x7fdc000ca8a0 2024-08-17T02:24:53.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbfde00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc000ca8a0 0x7fdc00168760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbfd400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc000ccca0 0x7fdc0009ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbfde00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc000ca8a0 0x7fdc00168760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:33360/0 (socket says 172.21.15.169:33360) 2024-08-17T02:24:53.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbfde00640 1 -- 172.21.15.169:0/1058155610 learned_addr learned my addr 172.21.15.169:0/1058155610 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:53.215 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbfe800640 1 --2- 172.21.15.169:0/1058155610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc00159b90 0x7fdc0016c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbfde00640 1 -- 172.21.15.169:0/1058155610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc000ccca0 msgr2=0x7fdc0009ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbfde00640 1 --2- 172.21.15.169:0/1058155610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc000ccca0 0x7fdc0009ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbfde00640 1 -- 172.21.15.169:0/1058155610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc00159b90 msgr2=0x7fdc0016c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbfde00640 1 --2- 172.21.15.169:0/1058155610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc00159b90 0x7fdc0016c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.213+0000 7fdbfde00640 1 -- 172.21.15.169:0/1058155610 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf0009390 con 0x7fdc000ca8a0 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.214+0000 7fdbfd400640 1 --2- 172.21.15.169:0/1058155610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc000ccca0 0x7fdc0009ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.214+0000 7fdbfde00640 1 --2- 172.21.15.169:0/1058155610 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc000ca8a0 0x7fdc00168760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009880 tx=0x7fdbf0032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.214+0000 7fdbf5600640 1 -- 172.21.15.169:0/1058155610 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0031b30 con 0x7fdc000ca8a0 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.214+0000 7fdbf5600640 1 -- 172.21.15.169:0/1058155610 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf0031cb0 con 0x7fdc000ca8a0 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.214+0000 7fdbf5600640 1 -- 172.21.15.169:0/1058155610 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0046680 con 0x7fdc000ca8a0 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.214+0000 7fdbff200640 1 -- 172.21.15.169:0/1058155610 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0009c350 con 0x7fdc000ca8a0 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.214+0000 7fdbff200640 1 -- 172.21.15.169:0/1058155610 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0009c910 con 0x7fdc000ca8a0 2024-08-17T02:24:53.216 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.214+0000 7fdbf5600640 1 -- 172.21.15.169:0/1058155610 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fdbf0039040 con 0x7fdc000ca8a0 2024-08-17T02:24:53.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.215+0000 7fdbf5600640 1 -- 172.21.15.169:0/1058155610 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fdbf0041030 con 0x7fdc000ca8a0 2024-08-17T02:24:53.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.215+0000 7fdbff200640 1 -- 172.21.15.169:0/1058155610 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc0009cb00 con 0x7fdc000ca8a0 2024-08-17T02:24:53.217 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.217+0000 7fdbf5600640 1 -- 172.21.15.169:0/1058155610 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fdbf004b060 con 0x7fdc000ca8a0 2024-08-17T02:24:53.266 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:53.267+0000 7fb907d6bec0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-17T02:24:53.291 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.291+0000 7fdbff200640 1 -- 172.21.15.169:0/1058155610 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2d2374fd-7006-4541-92c3-df5add5ca647", "id": 5} v 0) v1 -- 0x7fdc00071050 con 0x7fdc000ca8a0 2024-08-17T02:24:53.296 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.296+0000 7fdbf5600640 1 -- 172.21.15.169:0/1058155610 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2d2374fd-7006-4541-92c3-df5add5ca647", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdbf0037070 con 0x7fdc000ca8a0 2024-08-17T02:24:53.296 INFO:teuthology.orchestra.run.smithi169.stdout:5 2024-08-17T02:24:53.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.297+0000 7fdbff200640 1 -- 172.21.15.169:0/1058155610 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc000ca8a0 msgr2=0x7fdc00168760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.297+0000 7fdbff200640 1 --2- 172.21.15.169:0/1058155610 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc000ca8a0 0x7fdc00168760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdbf0009880 tx=0x7fdbf0032000 comp rx=0 tx=0).stop 2024-08-17T02:24:53.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.297+0000 7fdbff200640 1 -- 172.21.15.169:0/1058155610 shutdown_connections 2024-08-17T02:24:53.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.297+0000 7fdbff200640 1 --2- 172.21.15.169:0/1058155610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdc00159b90 0x7fdc0016c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.297 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.297+0000 7fdbff200640 1 --2- 172.21.15.169:0/1058155610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdc000ccca0 0x7fdc0009ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.297+0000 7fdbff200640 1 --2- 172.21.15.169:0/1058155610 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdc000ca8a0 0x7fdc00168760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.297+0000 7fdbff200640 1 -- 172.21.15.169:0/1058155610 >> 172.21.15.169:0/1058155610 conn(0x7fdc00098e00 msgr2=0x7fdc001585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:53.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.297+0000 7fdbff200640 1 -- 172.21.15.169:0/1058155610 shutdown_connections 2024-08-17T02:24:53.298 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.297+0000 7fdbff200640 1 -- 172.21.15.169:0/1058155610 wait complete. 2024-08-17T02:24:53.311 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 89b89c80-b07a-480a-8622-d7011718076b 6 2024-08-17T02:24:53.333 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:53.332+0000 7fb907d6bec0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-17T02:24:53.395 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:53.396+0000 7fb907d6bec0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-17T02:24:53.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.477+0000 7efff7200640 1 Processor -- start 2024-08-17T02:24:53.477 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.477+0000 7efff7200640 1 -- start start 2024-08-17T02:24:53.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.478+0000 7efff7200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efff0156990 0x7efff00b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.478+0000 7efff7200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efff0156d60 0x7efff00b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.478+0000 7efff7200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff015b030 con 0x7efff00ad7b0 2024-08-17T02:24:53.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.478+0000 7efff7200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff00af950 con 0x7efff0156990 2024-08-17T02:24:53.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.478+0000 7efff7200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff00cc2e0 con 0x7efff0156d60 2024-08-17T02:24:53.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.478+0000 7effefe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efff0156990 0x7efff00b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.479 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.479+0000 7effefe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efff0156990 0x7efff00b05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:57608/0 (socket says 172.21.15.169:57608) 2024-08-17T02:24:53.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.479+0000 7effefe00640 1 -- 172.21.15.169:0/1245275221 learned_addr learned my addr 172.21.15.169:0/1245275221 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:53.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.479+0000 7effef400640 1 --2- 172.21.15.169:0/1245275221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efff0156d60 0x7efff00b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.479+0000 7effefe00640 1 -- 172.21.15.169:0/1245275221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efff0156d60 msgr2=0x7efff00b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:53.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.479+0000 7effefe00640 1 --2- 172.21.15.169:0/1245275221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efff0156d60 0x7efff00b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.479+0000 7effefe00640 1 -- 172.21.15.169:0/1245275221 >> v1:172.21.15.45:6789/0 conn(0x7efff00ad7b0 legacy=0x7efff006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.480 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.479+0000 7effefe00640 1 -- 172.21.15.169:0/1245275221 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff00b1110 con 0x7efff0156990 2024-08-17T02:24:53.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.480+0000 7effefe00640 1 --2- 172.21.15.169:0/1245275221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff0156990 0x7efff00b05a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7effe0009910 tx=0x7effe00091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3921e064d9a050c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:53.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.480+0000 7effeea00640 1 -- 172.21.15.169:0/1245275221 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe002ae40 con 0x7efff0156990 2024-08-17T02:24:53.481 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.480+0000 7effeea00640 1 -- 172.21.15.169:0/1245275221 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe0032440 con 0x7efff0156990 2024-08-17T02:24:53.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.480+0000 7effeea00640 1 -- 172.21.15.169:0/1245275221 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe0032820 con 0x7efff0156990 2024-08-17T02:24:53.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.481+0000 7efff7200640 1 -- 172.21.15.169:0/1245275221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff0156990 msgr2=0x7efff00b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.481+0000 7efff7200640 1 --2- 172.21.15.169:0/1245275221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff0156990 0x7efff00b05a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7effe0009910 tx=0x7effe00091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.481+0000 7efff7200640 1 -- 172.21.15.169:0/1245275221 shutdown_connections 2024-08-17T02:24:53.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.481+0000 7efff7200640 1 --2- 172.21.15.169:0/1245275221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efff0156d60 0x7efff00b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.481+0000 7efff7200640 1 --2- 172.21.15.169:0/1245275221 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff0156990 0x7efff00b05a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.481+0000 7efff7200640 1 -- 172.21.15.169:0/1245275221 >> 172.21.15.169:0/1245275221 conn(0x7efff0067750 msgr2=0x7efff00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:53.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.481+0000 7efff7200640 1 -- 172.21.15.169:0/1245275221 shutdown_connections 2024-08-17T02:24:53.482 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.481+0000 7efff7200640 1 -- 172.21.15.169:0/1245275221 wait complete. 2024-08-17T02:24:53.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.482+0000 7efff7200640 1 Processor -- start 2024-08-17T02:24:53.483 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.483+0000 7efff7200640 1 -- start start 2024-08-17T02:24:53.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.483+0000 7efff7200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efff00ad7b0 0x7efff01693b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.483+0000 7efff7200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efff0156990 0x7efff00acf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.483+0000 7efff7200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff0156d60 0x7efff014d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.484 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.483+0000 7efff7200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0169990 con 0x7efff00ad7b0 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.483+0000 7efff7200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff0169c70 con 0x7efff0156d60 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.483+0000 7efff7200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff0169f50 con 0x7efff0156990 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7effef400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efff0156990 0x7efff00acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7efff5200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff0156d60 0x7efff014d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7effefe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efff00ad7b0 0x7efff01693b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7effefe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efff00ad7b0 0x7efff01693b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.169:43462/0 (socket says 172.21.15.169:43462) 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7effef400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efff0156990 0x7efff00acf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.169:33368/0 (socket says 172.21.15.169:33368) 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7effefe00640 1 -- 172.21.15.169:0/3929016514 learned_addr learned my addr 172.21.15.169:0/3929016514 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7efff5200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff0156d60 0x7efff014d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:57616/0 (socket says 172.21.15.169:57616) 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7efff5200640 1 -- 172.21.15.169:0/3929016514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efff0156990 msgr2=0x7efff00acf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7efff5200640 1 --2- 172.21.15.169:0/3929016514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efff0156990 0x7efff00acf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7efff5200640 1 -- 172.21.15.169:0/3929016514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efff00ad7b0 msgr2=0x7efff01693b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.485 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7efff5200640 1 --2- 172.21.15.169:0/3929016514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efff00ad7b0 0x7efff01693b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7efff5200640 1 -- 172.21.15.169:0/3929016514 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe0009450 con 0x7efff0156d60 2024-08-17T02:24:53.486 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.484+0000 7efff5200640 1 --2- 172.21.15.169:0/3929016514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff0156d60 0x7efff014d760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7effe800c790 tx=0x7effe8001560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:53.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.485+0000 7effe7400640 1 -- 172.21.15.169:0/3929016514 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe800a640 con 0x7efff0156d60 2024-08-17T02:24:53.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.485+0000 7effe7400640 1 -- 172.21.15.169:0/3929016514 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe800a7c0 con 0x7efff0156d60 2024-08-17T02:24:53.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.485+0000 7effe7400640 1 -- 172.21.15.169:0/3929016514 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe800ab80 con 0x7efff0156d60 2024-08-17T02:24:53.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.485+0000 7efff7200640 1 -- 172.21.15.169:0/3929016514 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff016a230 con 0x7efff0156d60 2024-08-17T02:24:53.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.485+0000 7efff7200640 1 -- 172.21.15.169:0/3929016514 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff00ad4a0 con 0x7efff0156d60 2024-08-17T02:24:53.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.485+0000 7effe7400640 1 -- 172.21.15.169:0/3929016514 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7effe8003030 con 0x7efff0156d60 2024-08-17T02:24:53.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.485+0000 7effe7400640 1 -- 172.21.15.169:0/3929016514 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7effe8012420 con 0x7efff0156d60 2024-08-17T02:24:53.487 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.486+0000 7efff7200640 1 -- 172.21.15.169:0/3929016514 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff0153ce0 con 0x7efff0156d60 2024-08-17T02:24:53.488 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.488+0000 7effe7400640 1 -- 172.21.15.169:0/3929016514 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7efff0153ce0 con 0x7efff0156d60 2024-08-17T02:24:53.508 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:53.508+0000 7fb907d6bec0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-17T02:24:53.562 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.561+0000 7efff7200640 1 -- 172.21.15.169:0/3929016514 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd new", "uuid": "89b89c80-b07a-480a-8622-d7011718076b", "id": 6} v 0) v1 -- 0x7efff0071050 con 0x7efff0156d60 2024-08-17T02:24:53.565 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.565+0000 7effe7400640 1 -- 172.21.15.169:0/3929016514 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89b89c80-b07a-480a-8622-d7011718076b", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7effe8012ab0 con 0x7efff0156d60 2024-08-17T02:24:53.565 INFO:teuthology.orchestra.run.smithi169.stdout:6 2024-08-17T02:24:53.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.566+0000 7efff7200640 1 -- 172.21.15.169:0/3929016514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff0156d60 msgr2=0x7efff014d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.566+0000 7efff7200640 1 --2- 172.21.15.169:0/3929016514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff0156d60 0x7efff014d760 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7effe800c790 tx=0x7effe8001560 comp rx=0 tx=0).stop 2024-08-17T02:24:53.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.566+0000 7efff7200640 1 -- 172.21.15.169:0/3929016514 shutdown_connections 2024-08-17T02:24:53.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.566+0000 7efff7200640 1 --2- 172.21.15.169:0/3929016514 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efff0156d60 0x7efff014d760 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.566+0000 7efff7200640 1 --2- 172.21.15.169:0/3929016514 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efff0156990 0x7efff00acf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.566+0000 7efff7200640 1 --2- 172.21.15.169:0/3929016514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efff00ad7b0 0x7efff01693b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.567 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.567+0000 7efff7200640 1 -- 172.21.15.169:0/3929016514 >> 172.21.15.169:0/3929016514 conn(0x7efff0067750 msgr2=0x7efff0150f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:53.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.567+0000 7efff7200640 1 -- 172.21.15.169:0/3929016514 shutdown_connections 2024-08-17T02:24:53.568 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.567+0000 7efff7200640 1 -- 172.21.15.169:0/3929016514 wait complete. 2024-08-17T02:24:53.581 DEBUG:teuthology.orchestra.run.smithi169:> sudo ceph --cluster ceph osd new 209e83ff-2e9c-45a4-9721-4ace887d2154 7 2024-08-17T02:24:53.683 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:53.683+0000 7faee8521ec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:24:53.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.727+0000 7f3288a00640 1 Processor -- start 2024-08-17T02:24:53.728 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.728+0000 7f3288a00640 1 -- start start 2024-08-17T02:24:53.729 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.729+0000 7f3288a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f32840ccca0 0x7f3284163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.729+0000 7f3288a00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32840cadc0 con 0x7f3284159f60 2024-08-17T02:24:53.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.729+0000 7f3288a00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32840cb060 con 0x7f3284159b90 2024-08-17T02:24:53.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.729+0000 7f3288a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840cb880 con 0x7f32840ccca0 2024-08-17T02:24:53.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.729+0000 7f3283e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f32840ccca0 0x7f3284163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.729+0000 7f3283e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f32840ccca0 0x7f3284163870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:57622/0 (socket says 172.21.15.169:57622) 2024-08-17T02:24:53.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.729+0000 7f3283e00640 1 -- 172.21.15.169:0/3604433710 learned_addr learned my addr 172.21.15.169:0/3604433710 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:53.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.729+0000 7f3283400640 1 --1- 172.21.15.169:0/3604433710 >> v1:172.21.15.169:6789/0 conn(0x7f3284159b90 0x7f32840ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.169:39438/0 (socket says 172.21.15.169:39438) 2024-08-17T02:24:53.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.729+0000 7f3283e00640 1 -- 172.21.15.169:0/3604433710 >> v1:172.21.15.169:6789/0 conn(0x7f3284159b90 legacy=0x7f32840ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.729+0000 7f3283e00640 1 -- 172.21.15.169:0/3604433710 >> v1:172.21.15.45:6789/0 conn(0x7f3284159f60 legacy=0x7f32840cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.730 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.729+0000 7f3283e00640 1 -- 172.21.15.169:0/3604433710 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840cb300 con 0x7f32840ccca0 2024-08-17T02:24:53.731 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.730+0000 7f3283e00640 1 --2- 172.21.15.169:0/3604433710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32840ccca0 0x7f3284163870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f327c009f20 tx=0x7f327c009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61004f8b32cccaec server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:53.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.731+0000 7f3282000640 1 -- 172.21.15.169:0/3604433710 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c032470 con 0x7f32840ccca0 2024-08-17T02:24:53.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.731+0000 7f3282000640 1 -- 172.21.15.169:0/3604433710 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c0325d0 con 0x7f32840ccca0 2024-08-17T02:24:53.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.731+0000 7f3282000640 1 -- 172.21.15.169:0/3604433710 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0329b0 con 0x7f32840ccca0 2024-08-17T02:24:53.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.731+0000 7f3288a00640 1 -- 172.21.15.169:0/3604433710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32840ccca0 msgr2=0x7f3284163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.731+0000 7f3288a00640 1 --2- 172.21.15.169:0/3604433710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32840ccca0 0x7f3284163870 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f327c009f20 tx=0x7f327c009840 comp rx=0 tx=0).stop 2024-08-17T02:24:53.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.731+0000 7f3288a00640 1 -- 172.21.15.169:0/3604433710 shutdown_connections 2024-08-17T02:24:53.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.731+0000 7f3288a00640 1 --2- 172.21.15.169:0/3604433710 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f32840ccca0 0x7f3284163870 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.731+0000 7f3288a00640 1 -- 172.21.15.169:0/3604433710 >> 172.21.15.169:0/3604433710 conn(0x7f3284098e00 msgr2=0x7f328406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:53.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.731+0000 7f3288a00640 1 -- 172.21.15.169:0/3604433710 shutdown_connections 2024-08-17T02:24:53.732 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.731+0000 7f3288a00640 1 -- 172.21.15.169:0/3604433710 wait complete. 2024-08-17T02:24:53.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.733+0000 7f3288a00640 1 Processor -- start 2024-08-17T02:24:53.733 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.733+0000 7f3288a00640 1 -- start start 2024-08-17T02:24:53.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.734+0000 7f3288a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32840ccca0 0x7f32840cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.734+0000 7f3288a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3284159b90 0x7f32840c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.734+0000 7f3288a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3284159f60 0x7f32840c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:53.734 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.734+0000 7f3288a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3284148680 con 0x7f32840ccca0 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.734+0000 7f3288a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3284168c40 con 0x7f3284159b90 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.734+0000 7f3288a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32840c99b0 con 0x7f3284159f60 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.734+0000 7f3282a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3284159b90 0x7f32840c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.734+0000 7f3283400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32840ccca0 0x7f32840cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.734+0000 7f3283e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3284159f60 0x7f32840c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.734+0000 7f3282a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3284159b90 0x7f32840c8c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.169:57632/0 (socket says 172.21.15.169:57632) 2024-08-17T02:24:53.735 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.734+0000 7f3282a00640 1 -- 172.21.15.169:0/518739763 learned_addr learned my addr 172.21.15.169:0/518739763 (peer_addr_for_me v2:172.21.15.169:0/0) 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f3283e00640 1 -- 172.21.15.169:0/518739763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3284159b90 msgr2=0x7f32840c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.736 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f3283e00640 1 --2- 172.21.15.169:0/518739763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3284159b90 0x7f32840c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f3283e00640 1 -- 172.21.15.169:0/518739763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32840ccca0 msgr2=0x7f32840cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f3283e00640 1 --2- 172.21.15.169:0/518739763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32840ccca0 0x7f32840cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f3283e00640 1 -- 172.21.15.169:0/518739763 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c009ae0 con 0x7f3284159f60 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f3282a00640 1 --2- 172.21.15.169:0/518739763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3284159b90 0x7f32840c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f3283400640 1 --2- 172.21.15.169:0/518739763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32840ccca0 0x7f32840cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f3283e00640 1 --2- 172.21.15.169:0/518739763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3284159f60 0x7f32840c9180 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f327c031000 tx=0x7f327c037000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f327aa00640 1 -- 172.21.15.169:0/518739763 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c008e50 con 0x7f3284159f60 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f327aa00640 1 -- 172.21.15.169:0/518739763 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c045410 con 0x7f3284159f60 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f327aa00640 1 -- 172.21.15.169:0/518739763 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c0457f0 con 0x7f3284159f60 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f3288a00640 1 -- 172.21.15.169:0/518739763 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32840c9c90 con 0x7f3284159f60 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.735+0000 7f3288a00640 1 -- 172.21.15.169:0/518739763 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32840ca250 con 0x7f3284159f60 2024-08-17T02:24:53.737 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.736+0000 7f327aa00640 1 -- 172.21.15.169:0/518739763 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f327c039050 con 0x7f3284159f60 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.736+0000 7f327aa00640 1 -- 172.21.15.169:0/518739763 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f327c03ca80 con 0x7f3284159f60 2024-08-17T02:24:53.738 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.737+0000 7f3288a00640 1 -- 172.21.15.169:0/518739763 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3284071050 con 0x7f3284159f60 2024-08-17T02:24:53.739 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.739+0000 7f327aa00640 1 -- 172.21.15.169:0/518739763 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f327c04a060 con 0x7f3284159f60 2024-08-17T02:24:53.813 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.813+0000 7f3288a00640 1 -- 172.21.15.169:0/518739763 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd new", "uuid": "209e83ff-2e9c-45a4-9721-4ace887d2154", "id": 7} v 0) v1 -- 0x7f32840d0570 con 0x7f3284159f60 2024-08-17T02:24:53.817 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.817+0000 7f327aa00640 1 -- 172.21.15.169:0/518739763 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "209e83ff-2e9c-45a4-9721-4ace887d2154", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f327c040030 con 0x7f3284159f60 2024-08-17T02:24:53.817 INFO:teuthology.orchestra.run.smithi169.stdout:7 2024-08-17T02:24:53.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.818+0000 7f3288a00640 1 -- 172.21.15.169:0/518739763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3284159f60 msgr2=0x7f32840c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:53.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.818+0000 7f3288a00640 1 --2- 172.21.15.169:0/518739763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3284159f60 0x7f32840c9180 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f327c031000 tx=0x7f327c037000 comp rx=0 tx=0).stop 2024-08-17T02:24:53.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.818+0000 7f3288a00640 1 -- 172.21.15.169:0/518739763 shutdown_connections 2024-08-17T02:24:53.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.818+0000 7f3288a00640 1 --2- 172.21.15.169:0/518739763 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3284159f60 0x7f32840c9180 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.818+0000 7f3288a00640 1 --2- 172.21.15.169:0/518739763 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3284159b90 0x7f32840c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.818+0000 7f3288a00640 1 --2- 172.21.15.169:0/518739763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f32840ccca0 0x7f32840cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:53.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.819+0000 7f3288a00640 1 -- 172.21.15.169:0/518739763 >> 172.21.15.169:0/518739763 conn(0x7f3284098e00 msgr2=0x7f32841579d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:53.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.819+0000 7f3288a00640 1 -- 172.21.15.169:0/518739763 shutdown_connections 2024-08-17T02:24:53.819 INFO:teuthology.orchestra.run.smithi169.stderr:2024-08-17T02:24:53.819+0000 7f3288a00640 1 -- 172.21.15.169:0/518739763 wait complete. 2024-08-17T02:24:53.833 INFO:tasks.ceph.osd.0:Restarting daemon 2024-08-17T02:24:53.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-08-17T02:24:53.837 INFO:tasks.ceph.osd.0:Started 2024-08-17T02:24:53.837 INFO:tasks.ceph.osd.1:Restarting daemon 2024-08-17T02:24:53.837 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-08-17T02:24:53.841 INFO:tasks.ceph.osd.1:Started 2024-08-17T02:24:53.841 INFO:tasks.ceph.osd.2:Restarting daemon 2024-08-17T02:24:53.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-08-17T02:24:53.845 INFO:tasks.ceph.osd.2:Started 2024-08-17T02:24:53.846 INFO:tasks.ceph.osd.3:Restarting daemon 2024-08-17T02:24:53.846 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-08-17T02:24:53.850 INFO:tasks.ceph.osd.3:Started 2024-08-17T02:24:53.850 INFO:tasks.ceph.osd.4:Restarting daemon 2024-08-17T02:24:53.850 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-08-17T02:24:53.855 INFO:tasks.ceph.osd.4:Started 2024-08-17T02:24:53.855 INFO:tasks.ceph.osd.5:Restarting daemon 2024-08-17T02:24:53.855 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-08-17T02:24:53.859 INFO:tasks.ceph.osd.5:Started 2024-08-17T02:24:53.859 INFO:tasks.ceph.osd.6:Restarting daemon 2024-08-17T02:24:53.859 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-08-17T02:24:53.863 INFO:tasks.ceph.osd.6:Started 2024-08-17T02:24:53.863 INFO:tasks.ceph.osd.7:Restarting daemon 2024-08-17T02:24:53.863 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-08-17T02:24:53.868 INFO:tasks.ceph.osd.7:Started 2024-08-17T02:24:53.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:54.031 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:54.030+0000 7faee8521ec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:24:54.042 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:54.042+0000 7fb907d6bec0 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-17T02:24:54.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.048+0000 7fa0b9800640 1 Processor -- start 2024-08-17T02:24:54.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.049+0000 7fa0b9800640 1 -- start start 2024-08-17T02:24:54.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.050+0000 7fa0b9800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0b4159ca0 0x7fa0b40ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.050+0000 7fa0b9800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 0x7fa0b40cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.050+0000 7fa0b9800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0b40cadc0 con 0x7fa0b40ccad0 2024-08-17T02:24:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.050+0000 7fa0b9800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0b40cd6e0 con 0x7fa0b4159ca0 2024-08-17T02:24:54.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.050+0000 7fa0b9800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40ccf70 con 0x7fa0b40ca8a0 2024-08-17T02:24:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.050+0000 7fa0b3e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0b4159ca0 0x7fa0b40ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.050+0000 7fa0b3400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 0x7fa0b40cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.050+0000 7fa0b3e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0b4159ca0 0x7fa0b40ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32936/0 (socket says 172.21.15.45:32936) 2024-08-17T02:24:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.050+0000 7fa0b3e00640 1 -- 172.21.15.45:0/2254487418 learned_addr learned my addr 172.21.15.45:0/2254487418 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:24:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.050+0000 7fa0b8e00640 1 --1- 172.21.15.45:0/2254487418 >> v1:172.21.15.45:6789/0 conn(0x7fa0b40ccad0 0x7fa0b40cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41868/0 (socket says 172.21.15.45:41868) 2024-08-17T02:24:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.051+0000 7fa0b3e00640 1 -- 172.21.15.45:0/2254487418 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 msgr2=0x7fa0b40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.051+0000 7fa0b2a00640 1 -- 172.21.15.45:0/2254487418 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 228134331 0 0) 0x7fa0b40cadc0 con 0x7fa0b40ccad0 2024-08-17T02:24:54.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.051+0000 7fa0b3e00640 1 --2- 172.21.15.45:0/2254487418 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 0x7fa0b40cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.051+0000 7fa0b3e00640 1 -- 172.21.15.45:0/2254487418 >> v1:172.21.15.45:6789/0 conn(0x7fa0b40ccad0 legacy=0x7fa0b40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.051+0000 7fa0b3e00640 1 -- 172.21.15.45:0/2254487418 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0b40cb060 con 0x7fa0b4159ca0 2024-08-17T02:24:54.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.051+0000 7fa0b3400640 1 --2- 172.21.15.45:0/2254487418 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 0x7fa0b40cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.052+0000 7fa0b3e00640 1 --2- 172.21.15.45:0/2254487418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0b4159ca0 0x7fa0b40ca360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009910 tx=0x7fa0a40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5b6b93107babfb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.052+0000 7fa0b2a00640 1 -- 172.21.15.45:0/2254487418 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a402ae40 con 0x7fa0b4159ca0 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.052+0000 7fa0b2a00640 1 -- 172.21.15.45:0/2254487418 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a4032440 con 0x7fa0b4159ca0 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.052+0000 7fa0b2a00640 1 -- 172.21.15.45:0/2254487418 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a40327e0 con 0x7fa0b4159ca0 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.053+0000 7fa0b9800640 1 -- 172.21.15.45:0/2254487418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0b4159ca0 msgr2=0x7fa0b40ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.053+0000 7fa0b9800640 1 --2- 172.21.15.45:0/2254487418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0b4159ca0 0x7fa0b40ca360 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa0a4009910 tx=0x7fa0a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.053+0000 7fa0b9800640 1 -- 172.21.15.45:0/2254487418 shutdown_connections 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.053+0000 7fa0b9800640 1 --2- 172.21.15.45:0/2254487418 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 0x7fa0b40cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.053+0000 7fa0b9800640 1 --2- 172.21.15.45:0/2254487418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0b4159ca0 0x7fa0b40ca360 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.053+0000 7fa0b9800640 1 -- 172.21.15.45:0/2254487418 >> 172.21.15.45:0/2254487418 conn(0x7fa0b4098e00 msgr2=0x7fa0b406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.053+0000 7fa0b9800640 1 -- 172.21.15.45:0/2254487418 shutdown_connections 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.053+0000 7fa0b9800640 1 -- 172.21.15.45:0/2254487418 wait complete. 2024-08-17T02:24:54.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.054+0000 7fa0b9800640 1 Processor -- start 2024-08-17T02:24:54.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.055+0000 7fa0b9800640 1 -- start start 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.055+0000 7fa0b9800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 0x7fa0b4155380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.055+0000 7fa0b9800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0b40ccad0 0x7fa0b40c4020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.055+0000 7fa0b9800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0b4159ca0 0x7fa0b41544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.055+0000 7fa0b9800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40c4b50 con 0x7fa0b40ccad0 2024-08-17T02:24:54.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.055+0000 7fa0b9800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40c4870 con 0x7fa0b4159ca0 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.055+0000 7fa0b9800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0b40c5310 con 0x7fa0b40ca8a0 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b3400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0b40ccad0 0x7fa0b40c4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b3400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0b40ccad0 0x7fa0b40c4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32942/0 (socket says 172.21.15.45:32942) 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b3400640 1 -- 172.21.15.45:0/754470940 learned_addr learned my addr 172.21.15.45:0/754470940 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b3e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 0x7fa0b4155380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b8e00640 1 --2- 172.21.15.45:0/754470940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0b4159ca0 0x7fa0b41544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b3400640 1 -- 172.21.15.45:0/754470940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 msgr2=0x7fa0b4155380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b3400640 1 --2- 172.21.15.45:0/754470940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 0x7fa0b4155380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b3400640 1 -- 172.21.15.45:0/754470940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0b4159ca0 msgr2=0x7fa0b41544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b3400640 1 --2- 172.21.15.45:0/754470940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0b4159ca0 0x7fa0b41544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b3400640 1 -- 172.21.15.45:0/754470940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a0009390 con 0x7fa0b40ccad0 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b8e00640 1 --2- 172.21.15.45:0/754470940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0b4159ca0 0x7fa0b41544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.056+0000 7fa0b3e00640 1 --2- 172.21.15.45:0/754470940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 0x7fa0b4155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:24:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.057+0000 7fa0b3400640 1 --2- 172.21.15.45:0/754470940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0b40ccad0 0x7fa0b40c4020 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000ec80 tx=0x7fa0a00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.057+0000 7fa0ab400640 1 -- 172.21.15.45:0/754470940 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a000eec0 con 0x7fa0b40ccad0 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.057+0000 7fa0ab400640 1 -- 172.21.15.45:0/754470940 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0a000cbc0 con 0x7fa0b40ccad0 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.057+0000 7fa0ab400640 1 -- 172.21.15.45:0/754470940 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a0013470 con 0x7fa0b40ccad0 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.057+0000 7fa0b9800640 1 -- 172.21.15.45:0/754470940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a4009450 con 0x7fa0b40ccad0 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.057+0000 7fa0b9800640 1 -- 172.21.15.45:0/754470940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0b40c58d0 con 0x7fa0b40ccad0 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.058+0000 7fa0ab400640 1 -- 172.21.15.45:0/754470940 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fa0a00137e0 con 0x7fa0b40ccad0 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.058+0000 7fa0ab400640 1 -- 172.21.15.45:0/754470940 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fa0a001cda0 con 0x7fa0b40ccad0 2024-08-17T02:24:54.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.058+0000 7fa0b9800640 1 -- 172.21.15.45:0/754470940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0b40c45c0 con 0x7fa0b40ccad0 2024-08-17T02:24:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.061+0000 7fa0ab400640 1 -- 172.21.15.45:0/754470940 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fa0a0021060 con 0x7fa0b40ccad0 2024-08-17T02:24:54.097 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:54.097+0000 7faee8521ec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:24:54.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.125+0000 7fa0b9800640 1 -- 172.21.15.45:0/754470940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0b4071050 con 0x7fa0b40ccad0 2024-08-17T02:24:54.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.125+0000 7fa0ab400640 1 -- 172.21.15.45:0/754470940 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fa0a0017070 con 0x7fa0b40ccad0 2024-08-17T02:24:54.126 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:24:54.126 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:24:53.814425+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:54.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.126+0000 7fa0b9800640 1 -- 172.21.15.45:0/754470940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0b40ccad0 msgr2=0x7fa0b40c4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.126+0000 7fa0b9800640 1 --2- 172.21.15.45:0/754470940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0b40ccad0 0x7fa0b40c4020 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fa0a000ec80 tx=0x7fa0a00090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.126+0000 7fa0b9800640 1 -- 172.21.15.45:0/754470940 shutdown_connections 2024-08-17T02:24:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.126+0000 7fa0b9800640 1 --2- 172.21.15.45:0/754470940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa0b4159ca0 0x7fa0b41544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.126+0000 7fa0b9800640 1 --2- 172.21.15.45:0/754470940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0b40ccad0 0x7fa0b40c4020 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.126+0000 7fa0b9800640 1 --2- 172.21.15.45:0/754470940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0b40ca8a0 0x7fa0b4155380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.126+0000 7fa0b9800640 1 -- 172.21.15.45:0/754470940 >> 172.21.15.45:0/754470940 conn(0x7fa0b4098e00 msgr2=0x7fa0b4157240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.127+0000 7fa0b9800640 1 -- 172.21.15.45:0/754470940 shutdown_connections 2024-08-17T02:24:54.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:24:54.127+0000 7fa0b9800640 1 -- 172.21.15.45:0/754470940 wait complete. 2024-08-17T02:24:54.142 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-08-17T02:24:54.142 INFO:tasks.ceph:Waiting for OSDs to come up 2024-08-17T02:24:54.216 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:54.215+0000 7faee8521ec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:24:54.311 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:54.311+0000 7fb907d6bec0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-17T02:24:54.369 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:54.370+0000 7fb907d6bec0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-17T02:24:54.479 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:54.479+0000 7fb907d6bec0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-17T02:24:54.513 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-08-17T02:24:54.513+0000 7f6fed24d2c0 -1 Falling back to public interface 2024-08-17T02:24:54.515 INFO:tasks.ceph.osd.2.smithi045.stderr:2024-08-17T02:24:54.515+0000 7fe06d4082c0 -1 Falling back to public interface 2024-08-17T02:24:54.516 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:54.516+0000 7faee8521ec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:24:54.526 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-08-17T02:24:54.526+0000 7f5c4891f2c0 -1 Falling back to public interface 2024-08-17T02:24:54.531 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-08-17T02:24:54.531+0000 7f6bc0a8b2c0 -1 Falling back to public interface 2024-08-17T02:24:54.541 INFO:tasks.ceph.osd.0.smithi045.stderr:2024-08-17T02:24:54.541+0000 7f2e28b1f2c0 -1 Falling back to public interface 2024-08-17T02:24:54.549 INFO:tasks.ceph.osd.1.smithi045.stderr:2024-08-17T02:24:54.549+0000 7fe17d3242c0 -1 Falling back to public interface 2024-08-17T02:24:54.566 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-08-17T02:24:54.566+0000 7f034103b2c0 -1 Falling back to public interface 2024-08-17T02:24:54.566 INFO:tasks.ceph.osd.3.smithi045.stderr:2024-08-17T02:24:54.565+0000 7fa9da0082c0 -1 Falling back to public interface 2024-08-17T02:24:54.576 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:54.575+0000 7faee8521ec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:24:54.764 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:54.763+0000 7faee8521ec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:24:54.765 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:54.765+0000 7fb907d6bec0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-17T02:24:54.820 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:54.820+0000 7fb907d6bec0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-17T02:24:54.824 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:54.823+0000 7faee8521ec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:24:54.908 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:54.907+0000 7faee8521ec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:54.948 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:24:54.961 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:54.961+0000 7faee8521ec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:24:54.999 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:54.999+0000 7fb907d6bec0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-17T02:24:55.056 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:55.057+0000 7fb907d6bec0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-17T02:24:55.082 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.081+0000 7f0c59600640 1 Processor -- start 2024-08-17T02:24:55.082 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.081+0000 7f0c59600640 1 -- start start 2024-08-17T02:24:55.084 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.082+0000 7f0c59600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 0x7f0c540ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.084 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.082+0000 7f0c59600640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0c54159350 0x7f0c540d04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.084 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.082+0000 7f0c59600640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c540c56a0 con 0x7f0c540cdba0 2024-08-17T02:24:55.084 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.083+0000 7f0c59600640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c540ce880 con 0x7f0c54159350 2024-08-17T02:24:55.084 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.083+0000 7f0c59600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c540ceb60 con 0x7f0c54158f80 2024-08-17T02:24:55.084 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.083+0000 7f0c53400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0c540cdba0 0x7f0c540ce020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41880/0 (socket says 172.21.15.45:41880) 2024-08-17T02:24:55.084 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.083+0000 7f0c53400640 1 -- 172.21.15.45:0/161834425 learned_addr learned my addr 172.21.15.45:0/161834425 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:24:55.084 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.083+0000 7f0c4be00640 1 --2- 172.21.15.45:0/161834425 >> v2:172.21.15.169:3300/0 conn(0x7f0c54159350 0x7f0c540d04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.084 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.083+0000 7f0c52a00640 1 --2- 172.21.15.45:0/161834425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 0x7f0c540ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.085 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.083+0000 7f0c52000640 1 -- 172.21.15.45:0/161834425 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973041848 0 0) 0x7f0c540c56a0 con 0x7f0c540cdba0 2024-08-17T02:24:55.086 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.083+0000 7f0c52a00640 1 -- 172.21.15.45:0/161834425 >> v2:172.21.15.169:3300/0 conn(0x7f0c54159350 msgr2=0x7f0c540d04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:24:55.086 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.083+0000 7f0c52a00640 1 --2- 172.21.15.45:0/161834425 >> v2:172.21.15.169:3300/0 conn(0x7f0c54159350 0x7f0c540d04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.086 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.083+0000 7f0c52a00640 1 -- 172.21.15.45:0/161834425 >> v1:172.21.15.45:6789/0 conn(0x7f0c540cdba0 legacy=0x7f0c540ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.086 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.083+0000 7f0c52a00640 1 -- 172.21.15.45:0/161834425 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c540c5940 con 0x7f0c54158f80 2024-08-17T02:24:55.087 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.084+0000 7f0c52a00640 1 --2- 172.21.15.45:0/161834425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 0x7f0c540ac870 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009850 tx=0x7f0c440090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50498b8157a6f0e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.087 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.085+0000 7f0c52000640 1 -- 172.21.15.45:0/161834425 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c4402ad00 con 0x7f0c54158f80 2024-08-17T02:24:55.087 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.085+0000 7f0c52000640 1 -- 172.21.15.45:0/161834425 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c4402ae60 con 0x7f0c54158f80 2024-08-17T02:24:55.087 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.085+0000 7f0c52000640 1 -- 172.21.15.45:0/161834425 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c44032670 con 0x7f0c54158f80 2024-08-17T02:24:55.088 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.085+0000 7f0c59600640 1 -- 172.21.15.45:0/161834425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 msgr2=0x7f0c540ac870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.088 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.085+0000 7f0c59600640 1 --2- 172.21.15.45:0/161834425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 0x7f0c540ac870 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c44009850 tx=0x7f0c440090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.088 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.086+0000 7f0c59600640 1 -- 172.21.15.45:0/161834425 shutdown_connections 2024-08-17T02:24:55.088 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.086+0000 7f0c59600640 1 --2- 172.21.15.45:0/161834425 >> v2:172.21.15.169:3300/0 conn(0x7f0c54159350 0x7f0c540d04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.088 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.086+0000 7f0c59600640 1 --2- 172.21.15.45:0/161834425 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 0x7f0c540ac870 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.089 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.086+0000 7f0c59600640 1 -- 172.21.15.45:0/161834425 >> 172.21.15.45:0/161834425 conn(0x7f0c5406ec50 msgr2=0x7f0c540cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.089 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.086+0000 7f0c59600640 1 -- 172.21.15.45:0/161834425 shutdown_connections 2024-08-17T02:24:55.089 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.086+0000 7f0c59600640 1 -- 172.21.15.45:0/161834425 wait complete. 2024-08-17T02:24:55.089 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.088+0000 7f0c59600640 1 Processor -- start 2024-08-17T02:24:55.089 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.088+0000 7f0c59600640 1 -- start start 2024-08-17T02:24:55.092 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c59600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c540cdba0 0x7f0c540b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.093 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c59600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 0x7f0c54154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.093 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c59600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c54159350 0x7f0c540ad360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:24:55.093 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c59600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5416c040 con 0x7f0c54159350 2024-08-17T02:24:55.093 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c59600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5416c290 con 0x7f0c540cdba0 2024-08-17T02:24:55.093 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c59600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5416c570 con 0x7f0c54158f80 2024-08-17T02:24:55.093 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c53400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c54159350 0x7f0c540ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.093 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c4be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 0x7f0c54154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.094 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c4be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 0x7f0c54154e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:58552/0 (socket says 172.21.15.45:58552) 2024-08-17T02:24:55.094 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c4be00640 1 -- 172.21.15.45:0/2766645529 learned_addr learned my addr 172.21.15.45:0/2766645529 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:24:55.094 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c52a00640 1 --2- 172.21.15.45:0/2766645529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c540cdba0 0x7f0c540b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:24:55.094 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c4be00640 1 -- 172.21.15.45:0/2766645529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c540cdba0 msgr2=0x7f0c540b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.094 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c4be00640 1 --2- 172.21.15.45:0/2766645529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c540cdba0 0x7f0c540b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.094 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c4be00640 1 -- 172.21.15.45:0/2766645529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c54159350 msgr2=0x7f0c540ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.094 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c4be00640 1 --2- 172.21.15.45:0/2766645529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c54159350 0x7f0c540ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.094 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c4be00640 1 -- 172.21.15.45:0/2766645529 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c44009390 con 0x7f0c54158f80 2024-08-17T02:24:55.094 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.090+0000 7f0c52a00640 1 --2- 172.21.15.45:0/2766645529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c540cdba0 0x7f0c540b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:24:55.094 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.091+0000 7f0c4be00640 1 --2- 172.21.15.45:0/2766645529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 0x7f0c54154e40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00e900 tx=0x7f0c3c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:24:55.094 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.091+0000 7f0c4a000640 1 -- 172.21.15.45:0/2766645529 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00c8e0 con 0x7f0c54158f80 2024-08-17T02:24:55.095 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.091+0000 7f0c4a000640 1 -- 172.21.15.45:0/2766645529 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3c00ca40 con 0x7f0c54158f80 2024-08-17T02:24:55.095 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.091+0000 7f0c4a000640 1 -- 172.21.15.45:0/2766645529 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c00cde0 con 0x7f0c54158f80 2024-08-17T02:24:55.095 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.091+0000 7f0c59600640 1 -- 172.21.15.45:0/2766645529 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c5416c850 con 0x7f0c54158f80 2024-08-17T02:24:55.095 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.091+0000 7f0c59600640 1 -- 172.21.15.45:0/2766645529 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5416ce10 con 0x7f0c54158f80 2024-08-17T02:24:55.095 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.091+0000 7f0c4a000640 1 -- 172.21.15.45:0/2766645529 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f0c3c005970 con 0x7f0c54158f80 2024-08-17T02:24:55.095 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.092+0000 7f0c4a000640 1 -- 172.21.15.45:0/2766645529 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f0c3c005c20 con 0x7f0c54158f80 2024-08-17T02:24:55.095 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.092+0000 7f0c59600640 1 -- 172.21.15.45:0/2766645529 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c54064a50 con 0x7f0c54158f80 2024-08-17T02:24:55.096 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.095+0000 7f0c4a000640 1 -- 172.21.15.45:0/2766645529 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f0c3c021060 con 0x7f0c54158f80 2024-08-17T02:24:55.138 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:55.138+0000 7fb907d6bec0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-17T02:24:55.160 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.159+0000 7f0c59600640 1 -- 172.21.15.45:0/2766645529 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c5405e7f0 con 0x7f0c54158f80 2024-08-17T02:24:55.161 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.160+0000 7f0c4a000640 1 -- 172.21.15.45:0/2766645529 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f0c3c029020 con 0x7f0c54158f80 2024-08-17T02:24:55.161 INFO:teuthology.misc.health.smithi045.stdout: 2024-08-17T02:24:55.161 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":10,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:24:53.814425+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:24:55.162 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.161+0000 7f0c59600640 1 -- 172.21.15.45:0/2766645529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 msgr2=0x7f0c54154e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:24:55.162 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.161+0000 7f0c59600640 1 --2- 172.21.15.45:0/2766645529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 0x7f0c54154e40 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00e900 tx=0x7f0c3c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.162 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.161+0000 7f0c59600640 1 -- 172.21.15.45:0/2766645529 shutdown_connections 2024-08-17T02:24:55.162 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.161+0000 7f0c59600640 1 --2- 172.21.15.45:0/2766645529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c54159350 0x7f0c540ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.163 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.161+0000 7f0c59600640 1 --2- 172.21.15.45:0/2766645529 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0c54158f80 0x7f0c54154e40 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.163 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.161+0000 7f0c59600640 1 --2- 172.21.15.45:0/2766645529 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0c540cdba0 0x7f0c540b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:24:55.163 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.161+0000 7f0c59600640 1 -- 172.21.15.45:0/2766645529 >> 172.21.15.45:0/2766645529 conn(0x7f0c5406ec50 msgr2=0x7f0c541557c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:24:55.163 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.161+0000 7f0c59600640 1 -- 172.21.15.45:0/2766645529 shutdown_connections 2024-08-17T02:24:55.163 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:24:55.161+0000 7f0c59600640 1 -- 172.21.15.45:0/2766645529 wait complete. 2024-08-17T02:24:55.174 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:24:55.190 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:55.190+0000 7fb907d6bec0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-17T02:24:55.521 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:55.520+0000 7faee8521ec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:24:55.636 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:55.635+0000 7faee8521ec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:24:55.722 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:55.722+0000 7fb907d6bec0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-17T02:24:55.831 INFO:tasks.ceph.mgr.x.smithi169.stderr:2024-08-17T02:24:55.831+0000 7fb907d6bec0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-17T02:24:56.657 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:56.656+0000 7faecd000640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-08-17T02:24:56.659 INFO:tasks.ceph.mgr.y.smithi045.stderr:2024-08-17T02:24:56.659+0000 7faecd000640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-08-17T02:24:58.027 INFO:tasks.ceph.osd.2.smithi045.stderr:2024-08-17T02:24:58.026+0000 7fe06d4082c0 -1 osd.2 0 log_to_monitors true 2024-08-17T02:24:58.046 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-08-17T02:24:58.045+0000 7f6fed24d2c0 -1 osd.6 0 log_to_monitors true 2024-08-17T02:24:58.096 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-08-17T02:24:58.095+0000 7f5c4891f2c0 -1 osd.5 0 log_to_monitors true 2024-08-17T02:24:58.158 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-08-17T02:24:58.156+0000 7f6bc0a8b2c0 -1 osd.7 0 log_to_monitors true 2024-08-17T02:24:58.172 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-08-17T02:24:58.171+0000 7f034103b2c0 -1 osd.4 0 log_to_monitors true 2024-08-17T02:24:58.178 INFO:tasks.ceph.osd.3.smithi045.stderr:2024-08-17T02:24:58.177+0000 7fa9da0082c0 -1 osd.3 0 log_to_monitors true 2024-08-17T02:24:58.179 INFO:tasks.ceph.osd.1.smithi045.stderr:2024-08-17T02:24:58.178+0000 7fe17d3242c0 -1 osd.1 0 log_to_monitors true 2024-08-17T02:24:58.182 INFO:tasks.ceph.osd.0.smithi045.stderr:2024-08-17T02:24:58.181+0000 7f2e28b1f2c0 -1 osd.0 0 log_to_monitors true 2024-08-17T02:25:01.431 INFO:tasks.ceph.osd.3.smithi045.stderr:2024-08-17T02:25:01.430+0000 7fa9d3400640 -1 osd.3 0 waiting for initial osdmap 2024-08-17T02:25:01.440 INFO:tasks.ceph.osd.3.smithi045.stderr:2024-08-17T02:25:01.440+0000 7fa9ca800640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:01.456 INFO:tasks.ceph.osd.0.smithi045.stderr:2024-08-17T02:25:01.455+0000 7f2e22200640 -1 osd.0 0 waiting for initial osdmap 2024-08-17T02:25:01.460 INFO:tasks.ceph.osd.2.smithi045.stderr:2024-08-17T02:25:01.459+0000 7fe068600640 -1 osd.2 0 waiting for initial osdmap 2024-08-17T02:25:01.463 INFO:tasks.ceph.osd.0.smithi045.stderr:2024-08-17T02:25:01.462+0000 7f2e19600640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:01.467 INFO:tasks.ceph.osd.2.smithi045.stderr:2024-08-17T02:25:01.466+0000 7fe05dc00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:01.478 INFO:tasks.ceph.osd.1.smithi045.stderr:2024-08-17T02:25:01.477+0000 7fe176a00640 -1 osd.1 0 waiting for initial osdmap 2024-08-17T02:25:01.482 INFO:tasks.ceph.osd.1.smithi045.stderr:2024-08-17T02:25:01.482+0000 7fe16de00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:01.981 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:02.005 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-08-17T02:25:02.004+0000 7f5c43e00640 -1 osd.5 0 waiting for initial osdmap 2024-08-17T02:25:02.011 INFO:tasks.ceph.osd.5.smithi169.stderr:2024-08-17T02:25:02.010+0000 7f5c39400640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:02.020 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-08-17T02:25:02.020+0000 7f033ae00640 -1 osd.4 0 waiting for initial osdmap 2024-08-17T02:25:02.023 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-08-17T02:25:02.022+0000 7f6bba800640 -1 osd.7 0 waiting for initial osdmap 2024-08-17T02:25:02.028 INFO:tasks.ceph.osd.4.smithi169.stderr:2024-08-17T02:25:02.027+0000 7f0332200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:02.030 INFO:tasks.ceph.osd.7.smithi169.stderr:2024-08-17T02:25:02.029+0000 7f6bb1c00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:02.056 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-08-17T02:25:02.055+0000 7f6fe6600640 -1 osd.6 0 waiting for initial osdmap 2024-08-17T02:25:02.062 INFO:tasks.ceph.osd.6.smithi169.stderr:2024-08-17T02:25:02.061+0000 7f6fdda00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-17T02:25:02.115 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.114+0000 7f54a3e00640 1 Processor -- start 2024-08-17T02:25:02.116 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.115+0000 7f54a3e00640 1 -- start start 2024-08-17T02:25:02.117 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.116+0000 7f54a3e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f54a41556f0 0x7f54a40af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.117 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.116+0000 7f54a3e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54a4155ac0 0x7f54a40ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.117 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.116+0000 7f54a3e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a40aefc0 con 0x7f54a40acc20 2024-08-17T02:25:02.118 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.116+0000 7f54a3e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a40ae140 con 0x7f54a4155ac0 2024-08-17T02:25:02.118 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.116+0000 7f54a3e00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a40ad250 con 0x7f54a41556f0 2024-08-17T02:25:02.118 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.116+0000 7f549be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54a4155ac0 0x7f54a40ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.118 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.116+0000 7f549be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54a4155ac0 0x7f54a40ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36060/0 (socket says 172.21.15.45:36060) 2024-08-17T02:25:02.118 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.116+0000 7f549be00640 1 -- 172.21.15.45:0/80977832 learned_addr learned my addr 172.21.15.45:0/80977832 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:02.118 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.116+0000 7f54a2a00640 1 --2- 172.21.15.45:0/80977832 >> v2:172.21.15.169:3300/0 conn(0x7f54a41556f0 0x7f54a40af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.118 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.117+0000 7f549be00640 1 -- 172.21.15.45:0/80977832 >> v2:172.21.15.169:3300/0 conn(0x7f54a41556f0 msgr2=0x7f54a40af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:02.118 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.117+0000 7f549be00640 1 --2- 172.21.15.45:0/80977832 >> v2:172.21.15.169:3300/0 conn(0x7f54a41556f0 0x7f54a40af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.118 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.117+0000 7f549be00640 1 -- 172.21.15.45:0/80977832 >> v1:172.21.15.169:6789/0 conn(0x7f54a40acc20 legacy=0x7f54a40b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.118 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.117+0000 7f549be00640 1 -- 172.21.15.45:0/80977832 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a40ad530 con 0x7f54a4155ac0 2024-08-17T02:25:02.120 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.117+0000 7f549be00640 1 --2- 172.21.15.45:0/80977832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a4155ac0 0x7f54a40ac6e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f54a406c180 tx=0x7f548c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edae4dfce6519a4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.120 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.118+0000 7f54a2000640 1 -- 172.21.15.45:0/80977832 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c02ae80 con 0x7f54a4155ac0 2024-08-17T02:25:02.120 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.118+0000 7f54a2000640 1 -- 172.21.15.45:0/80977832 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c032440 con 0x7f54a4155ac0 2024-08-17T02:25:02.120 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.118+0000 7f54a2000640 1 -- 172.21.15.45:0/80977832 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c032800 con 0x7f54a4155ac0 2024-08-17T02:25:02.120 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.118+0000 7f54a3e00640 1 -- 172.21.15.45:0/80977832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a4155ac0 msgr2=0x7f54a40ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.120 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.118+0000 7f54a3e00640 1 --2- 172.21.15.45:0/80977832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a4155ac0 0x7f54a40ac6e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f54a406c180 tx=0x7f548c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.120 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.118+0000 7f54a3e00640 1 -- 172.21.15.45:0/80977832 shutdown_connections 2024-08-17T02:25:02.121 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.118+0000 7f54a3e00640 1 --2- 172.21.15.45:0/80977832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a4155ac0 0x7f54a40ac6e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.121 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.118+0000 7f54a3e00640 1 --2- 172.21.15.45:0/80977832 >> v2:172.21.15.169:3300/0 conn(0x7f54a41556f0 0x7f54a40af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.121 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.118+0000 7f54a3e00640 1 -- 172.21.15.45:0/80977832 >> 172.21.15.45:0/80977832 conn(0x7f54a4066d90 msgr2=0x7f54a4067190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:02.121 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.118+0000 7f54a3e00640 1 -- 172.21.15.45:0/80977832 shutdown_connections 2024-08-17T02:25:02.121 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.118+0000 7f54a3e00640 1 -- 172.21.15.45:0/80977832 wait complete. 2024-08-17T02:25:02.124 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.120+0000 7f54a3e00640 1 Processor -- start 2024-08-17T02:25:02.124 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.120+0000 7f54a3e00640 1 -- start start 2024-08-17T02:25:02.124 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a40acc20 0x7f54a4141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.124 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a3e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41556f0 0x7f54a40ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.124 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a3e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54a4155ac0 0x7f54a41692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.124 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a3e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40abf30 con 0x7f54a40acc20 2024-08-17T02:25:02.124 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a3e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a4156140 con 0x7f54a41556f0 2024-08-17T02:25:02.124 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a3e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a4169810 con 0x7f54a4155ac0 2024-08-17T02:25:02.124 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a2a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a40acc20 0x7f54a4141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.125 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a2a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a40acc20 0x7f54a4141310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36074/0 (socket says 172.21.15.45:36074) 2024-08-17T02:25:02.125 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a2a00640 1 -- 172.21.15.45:0/2230306459 learned_addr learned my addr 172.21.15.45:0/2230306459 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:02.125 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f549be00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41556f0 0x7f54a40ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.125 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a3400640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54a4155ac0 0x7f54a41692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.125 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a2a00640 1 -- 172.21.15.45:0/2230306459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54a4155ac0 msgr2=0x7f54a41692d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.125 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a2a00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54a4155ac0 0x7f54a41692d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.125 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a2a00640 1 -- 172.21.15.45:0/2230306459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41556f0 msgr2=0x7f54a40ab9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.125 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a2a00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41556f0 0x7f54a40ab9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.125 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f54a2a00640 1 -- 172.21.15.45:0/2230306459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c009450 con 0x7f54a40acc20 2024-08-17T02:25:02.125 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.121+0000 7f549be00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41556f0 0x7f54a40ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:02.125 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.122+0000 7f54a2a00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a40acc20 0x7f54a4141310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f549400ea20 tx=0x7f54940090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.126 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.122+0000 7f549a000640 1 -- 172.21.15.45:0/2230306459 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549400ca10 con 0x7f54a40acc20 2024-08-17T02:25:02.126 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.122+0000 7f549a000640 1 -- 172.21.15.45:0/2230306459 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549400cb70 con 0x7f54a40acc20 2024-08-17T02:25:02.126 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.122+0000 7f549a000640 1 -- 172.21.15.45:0/2230306459 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5494013470 con 0x7f54a40acc20 2024-08-17T02:25:02.126 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.122+0000 7f54a3e00640 1 -- 172.21.15.45:0/2230306459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a4169ab0 con 0x7f54a40acc20 2024-08-17T02:25:02.126 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.122+0000 7f54a3e00640 1 -- 172.21.15.45:0/2230306459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a416a070 con 0x7f54a40acc20 2024-08-17T02:25:02.126 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.123+0000 7f54a3e00640 1 -- 172.21.15.45:0/2230306459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a4155f10 con 0x7f54a40acc20 2024-08-17T02:25:02.127 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.124+0000 7f549a000640 1 -- 172.21.15.45:0/2230306459 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 83364+0+0 (secure 0 0 0) 0x7f5494013860 con 0x7f54a40acc20 2024-08-17T02:25:02.127 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.125+0000 7f549a000640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f54800650c0 0x7f5480067570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:02.127 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.125+0000 7f549a000640 1 -- 172.21.15.45:0/2230306459 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f5494081890 con 0x7f54a40acc20 2024-08-17T02:25:02.127 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.125+0000 7f549be00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f54800650c0 0x7f5480067570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:02.127 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.126+0000 7f549be00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f54800650c0 0x7f5480067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f548c034000 tx=0x7f548c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:02.130 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.129+0000 7f549a000640 1 -- 172.21.15.45:0/2230306459 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f54940507d0 con 0x7f54a40acc20 2024-08-17T02:25:02.318 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.317+0000 7f54a3e00640 1 -- 172.21.15.45:0/2230306459 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54a416a260 con 0x7f54a40acc20 2024-08-17T02:25:02.318 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.318+0000 7f549a000640 1 -- 172.21.15.45:0/2230306459 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f5494053df0 con 0x7f54a40acc20 2024-08-17T02:25:02.318 INFO:teuthology.misc.health.smithi045.stdout: 2024-08-17T02:25:02.319 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":12,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:24:59.663078+0000","last_up_change":"0.000000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:02.321 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 -- 172.21.15.45:0/2230306459 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f54800650c0 msgr2=0x7f5480067570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.321 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f54800650c0 0x7f5480067570 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f548c034000 tx=0x7f548c032000 comp rx=0 tx=0).stop 2024-08-17T02:25:02.321 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 -- 172.21.15.45:0/2230306459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a40acc20 msgr2=0x7f54a4141310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:02.321 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a40acc20 0x7f54a4141310 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f549400ea20 tx=0x7f54940090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.321 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 -- 172.21.15.45:0/2230306459 shutdown_connections 2024-08-17T02:25:02.322 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f54800650c0 0x7f5480067570 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.322 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f54a4155ac0 0x7f54a41692d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.322 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f54a41556f0 0x7f54a40ab9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.322 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 --2- 172.21.15.45:0/2230306459 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a40acc20 0x7f54a4141310 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:02.322 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 -- 172.21.15.45:0/2230306459 >> 172.21.15.45:0/2230306459 conn(0x7f54a4066d90 msgr2=0x7f54a40c9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:02.322 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 -- 172.21.15.45:0/2230306459 shutdown_connections 2024-08-17T02:25:02.322 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:02.320+0000 7f54a3e00640 1 -- 172.21.15.45:0/2230306459 wait complete. 2024-08-17T02:25:02.333 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-08-17T02:25:09.140 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:09.281 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.281+0000 7f526f200640 1 Processor -- start 2024-08-17T02:25:09.282 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.281+0000 7f526f200640 1 -- start start 2024-08-17T02:25:09.283 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.282+0000 7f526f200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52700ac080 0x7f52700ac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.283 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.282+0000 7f526f200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f52700aee30 0x7f52700af220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.283 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.282+0000 7f526f200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52700af760 con 0x7f52700aa7d0 2024-08-17T02:25:09.283 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.282+0000 7f526f200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5270067ea0 con 0x7f52700ac080 2024-08-17T02:25:09.283 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.282+0000 7f526f200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5270068180 con 0x7f52700aee30 2024-08-17T02:25:09.283 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.282+0000 7f526de00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52700ac080 0x7f52700ac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.283 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.282+0000 7f526de00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f52700ac080 0x7f52700ac450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36114/0 (socket says 172.21.15.45:36114) 2024-08-17T02:25:09.284 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.282+0000 7f526de00640 1 -- 172.21.15.45:0/3400064224 learned_addr learned my addr 172.21.15.45:0/3400064224 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:09.284 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.282+0000 7f526e800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f52700aa7d0 0x7f52700aabd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41986/0 (socket says 172.21.15.45:41986) 2024-08-17T02:25:09.284 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.282+0000 7f5267e00640 1 --2- 172.21.15.45:0/3400064224 >> v2:172.21.15.169:3300/0 conn(0x7f52700aee30 0x7f52700af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.285 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.283+0000 7f526de00640 1 -- 172.21.15.45:0/3400064224 >> v2:172.21.15.169:3300/0 conn(0x7f52700aee30 msgr2=0x7f52700af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:09.285 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.283+0000 7f526de00640 1 --2- 172.21.15.45:0/3400064224 >> v2:172.21.15.169:3300/0 conn(0x7f52700aee30 0x7f52700af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.285 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.283+0000 7f526de00640 1 -- 172.21.15.45:0/3400064224 >> v1:172.21.15.45:6789/0 conn(0x7f52700aa7d0 legacy=0x7f52700aabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.285 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.283+0000 7f526de00640 1 -- 172.21.15.45:0/3400064224 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52700acdf0 con 0x7f52700ac080 2024-08-17T02:25:09.285 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.283+0000 7f526d400640 1 -- 172.21.15.45:0/3400064224 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1846156528 0 0) 0x7f52700af760 con 0x7f52700aa7d0 2024-08-17T02:25:09.285 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.284+0000 7f526de00640 1 --2- 172.21.15.45:0/3400064224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52700ac080 0x7f52700ac450 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f527006a610 tx=0x7f52600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97c4de859cf9c39 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:09.285 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.284+0000 7f526d400640 1 -- 172.21.15.45:0/3400064224 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526002ae80 con 0x7f52700ac080 2024-08-17T02:25:09.285 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.284+0000 7f526d400640 1 -- 172.21.15.45:0/3400064224 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5260032440 con 0x7f52700ac080 2024-08-17T02:25:09.285 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.284+0000 7f526d400640 1 -- 172.21.15.45:0/3400064224 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52600327c0 con 0x7f52700ac080 2024-08-17T02:25:09.286 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.285+0000 7f526f200640 1 -- 172.21.15.45:0/3400064224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52700ac080 msgr2=0x7f52700ac450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.286 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.285+0000 7f526f200640 1 --2- 172.21.15.45:0/3400064224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52700ac080 0x7f52700ac450 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f527006a610 tx=0x7f52600091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.286 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.285+0000 7f526f200640 1 -- 172.21.15.45:0/3400064224 shutdown_connections 2024-08-17T02:25:09.287 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.285+0000 7f526f200640 1 --2- 172.21.15.45:0/3400064224 >> v2:172.21.15.169:3300/0 conn(0x7f52700aee30 0x7f52700af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.287 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.285+0000 7f526f200640 1 --2- 172.21.15.45:0/3400064224 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52700ac080 0x7f52700ac450 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.287 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.285+0000 7f526f200640 1 -- 172.21.15.45:0/3400064224 >> 172.21.15.45:0/3400064224 conn(0x7f5270096a30 msgr2=0x7f5270096e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:09.287 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.285+0000 7f526f200640 1 -- 172.21.15.45:0/3400064224 shutdown_connections 2024-08-17T02:25:09.287 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.285+0000 7f526f200640 1 -- 172.21.15.45:0/3400064224 wait complete. 2024-08-17T02:25:09.287 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.286+0000 7f526f200640 1 Processor -- start 2024-08-17T02:25:09.287 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.286+0000 7f526f200640 1 -- start start 2024-08-17T02:25:09.289 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.287+0000 7f526f200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52700aa7d0 0x7f5270157190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.289 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.287+0000 7f526f200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52700ac080 0x7f52700c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.290 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.287+0000 7f526f200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52700aee30 0x7f52700c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.290 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.287+0000 7f526f200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527009b3a0 con 0x7f52700aee30 2024-08-17T02:25:09.290 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.287+0000 7f526f200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527009a790 con 0x7f52700ac080 2024-08-17T02:25:09.290 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.287+0000 7f526f200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f527009aa70 con 0x7f52700aa7d0 2024-08-17T02:25:09.290 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.288+0000 7f526e800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52700aee30 0x7f52700c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.290 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.288+0000 7f526e800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52700aee30 0x7f52700c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36118/0 (socket says 172.21.15.45:36118) 2024-08-17T02:25:09.290 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.288+0000 7f526e800640 1 -- 172.21.15.45:0/819373979 learned_addr learned my addr 172.21.15.45:0/819373979 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:09.290 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.288+0000 7f5267e00640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52700ac080 0x7f52700c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.290 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.288+0000 7f526de00640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52700aa7d0 0x7f5270157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.290 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.288+0000 7f526e800640 1 -- 172.21.15.45:0/819373979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52700aa7d0 msgr2=0x7f5270157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.290 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.288+0000 7f526e800640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52700aa7d0 0x7f5270157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.291 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.288+0000 7f526e800640 1 -- 172.21.15.45:0/819373979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52700ac080 msgr2=0x7f52700c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.291 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.288+0000 7f526e800640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52700ac080 0x7f52700c8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.291 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.288+0000 7f526e800640 1 -- 172.21.15.45:0/819373979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5260009450 con 0x7f52700aee30 2024-08-17T02:25:09.291 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.288+0000 7f526e800640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52700aee30 0x7f52700c9260 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f526800c860 tx=0x7f52680015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:09.291 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.289+0000 7f5265600640 1 -- 172.21.15.45:0/819373979 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800ce50 con 0x7f52700aee30 2024-08-17T02:25:09.291 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.289+0000 7f5265600640 1 -- 172.21.15.45:0/819373979 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5268005d60 con 0x7f52700aee30 2024-08-17T02:25:09.291 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.289+0000 7f5265600640 1 -- 172.21.15.45:0/819373979 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f526800a870 con 0x7f52700aee30 2024-08-17T02:25:09.291 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.289+0000 7f526f200640 1 -- 172.21.15.45:0/819373979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527009ad50 con 0x7f52700aee30 2024-08-17T02:25:09.291 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.289+0000 7f526f200640 1 -- 172.21.15.45:0/819373979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5270099a30 con 0x7f52700aee30 2024-08-17T02:25:09.292 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.290+0000 7f526f200640 1 -- 172.21.15.45:0/819373979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527009b550 con 0x7f52700aee30 2024-08-17T02:25:09.292 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.291+0000 7f5265600640 1 -- 172.21.15.45:0/819373979 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f526800ac60 con 0x7f52700aee30 2024-08-17T02:25:09.292 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.291+0000 7f5265600640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f524c065150 0x7f524c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.292 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.292+0000 7f5265600640 1 -- 172.21.15.45:0/819373979 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5268081eb0 con 0x7f52700aee30 2024-08-17T02:25:09.292 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.292+0000 7f526de00640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f524c065150 0x7f524c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.293 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.292+0000 7f526de00640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f524c065150 0x7f524c067600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5260034000 tx=0x7f5260032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:09.297 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.296+0000 7f5265600640 1 -- 172.21.15.45:0/819373979 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f527009b550 con 0x7f52700aee30 2024-08-17T02:25:09.480 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.479+0000 7f526f200640 1 -- 172.21.15.45:0/819373979 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5270071100 con 0x7f52700aee30 2024-08-17T02:25:09.481 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.480+0000 7f5265600640 1 -- 172.21.15.45:0/819373979 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f52680502a0 con 0x7f52700aee30 2024-08-17T02:25:09.481 INFO:teuthology.misc.health.smithi045.stdout: 2024-08-17T02:25:09.481 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":16,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:06.016838+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:09.484 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 -- 172.21.15.45:0/819373979 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f524c065150 msgr2=0x7f524c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.484 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f524c065150 0x7f524c067600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f5260034000 tx=0x7f5260032000 comp rx=0 tx=0).stop 2024-08-17T02:25:09.484 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 -- 172.21.15.45:0/819373979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52700aee30 msgr2=0x7f52700c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.484 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52700aee30 0x7f52700c9260 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f526800c860 tx=0x7f52680015f0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.484 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 -- 172.21.15.45:0/819373979 shutdown_connections 2024-08-17T02:25:09.484 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52700aee30 0x7f52700c9260 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.484 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f52700ac080 0x7f52700c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.484 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f524c065150 0x7f524c067600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.484 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 --2- 172.21.15.45:0/819373979 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f52700aa7d0 0x7f5270157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.484 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 -- 172.21.15.45:0/819373979 >> 172.21.15.45:0/819373979 conn(0x7f5270096a30 msgr2=0x7f527006b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:09.484 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 -- 172.21.15.45:0/819373979 shutdown_connections 2024-08-17T02:25:09.485 INFO:teuthology.misc.health.smithi045.stderr:2024-08-17T02:25:09.483+0000 7f526f200640 1 -- 172.21.15.45:0/819373979 wait complete. 2024-08-17T02:25:09.496 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-08-17T02:25:09.496 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-08-17T02:25:09.496 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:25:09.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:25:09.500 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:25:09.500 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:25:09.501 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:25:09.504 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:25:09.504 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:25:09.505 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:25:09.509 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:25:09.509 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:25:09.509 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:25:09.514 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:25:09.518 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-08-17T02:25:09.518 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:09.625 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2024-08-17T02:25:09.628 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2024-08-17T02:25:09.643 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-08-17T02:25:09.645 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-08-17T02:25:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.679+0000 7ff5cbe00640 1 Processor -- start 2024-08-17T02:25:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.679+0000 7ff5cbe00640 1 -- start start 2024-08-17T02:25:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.680+0000 7ff5cbe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff5c4158cb0 0x7ff5c40af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.680+0000 7ff5cbe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 0x7ff5c40ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.680+0000 7ff5cbe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5c40ac650 0x7ff5c40acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.680+0000 7ff5cbe00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c40abc80 con 0x7ff5c40ac650 2024-08-17T02:25:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.680+0000 7ff5cbe00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5c40ab070 con 0x7ff5c4158cb0 2024-08-17T02:25:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.680+0000 7ff5cbe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c40ab350 con 0x7ff5c40aa910 2024-08-17T02:25:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.681+0000 7ff5c9400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff5c4158cb0 0x7ff5c40af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.681+0000 7ff5c8a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 0x7ff5c40ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.681+0000 7ff5c8a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 0x7ff5c40ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:60516/0 (socket says 172.21.15.45:60516) 2024-08-17T02:25:09.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.681+0000 7ff5c8a00640 1 -- 172.21.15.45:0/758045741 learned_addr learned my addr 172.21.15.45:0/758045741 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:09.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.681+0000 7ff5c9e00640 1 --2- 172.21.15.45:0/758045741 >> v2:172.21.15.45:3300/0 conn(0x7ff5c40ac650 0x7ff5c40acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.681+0000 7ff5c8a00640 1 -- 172.21.15.45:0/758045741 >> v2:172.21.15.169:3300/0 conn(0x7ff5c4158cb0 msgr2=0x7ff5c40af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:09.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.681+0000 7ff5c8a00640 1 --2- 172.21.15.45:0/758045741 >> v2:172.21.15.169:3300/0 conn(0x7ff5c4158cb0 0x7ff5c40af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.681+0000 7ff5c8a00640 1 -- 172.21.15.45:0/758045741 >> v2:172.21.15.45:3300/0 conn(0x7ff5c40ac650 msgr2=0x7ff5c40acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:09.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.681+0000 7ff5c8a00640 1 --2- 172.21.15.45:0/758045741 >> v2:172.21.15.45:3300/0 conn(0x7ff5c40ac650 0x7ff5c40acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.681+0000 7ff5c8a00640 1 -- 172.21.15.45:0/758045741 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c40ab630 con 0x7ff5c40aa910 2024-08-17T02:25:09.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.682+0000 7ff5c8a00640 1 --2- 172.21.15.45:0/758045741 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 0x7ff5c40ac110 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff5c406d930 tx=0x7ff5b00091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35bcffce3f89579d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:09.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.682+0000 7ff5c3e00640 1 -- 172.21.15.45:0/758045741 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b002add0 con 0x7ff5c40aa910 2024-08-17T02:25:09.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.682+0000 7ff5c3e00640 1 -- 172.21.15.45:0/758045741 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b0032440 con 0x7ff5c40aa910 2024-08-17T02:25:09.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.682+0000 7ff5c3e00640 1 -- 172.21.15.45:0/758045741 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b0032820 con 0x7ff5c40aa910 2024-08-17T02:25:09.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.683+0000 7ff5cbe00640 1 -- 172.21.15.45:0/758045741 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 msgr2=0x7ff5c40ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.683+0000 7ff5cbe00640 1 --2- 172.21.15.45:0/758045741 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 0x7ff5c40ac110 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff5c406d930 tx=0x7ff5b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.683+0000 7ff5cbe00640 1 -- 172.21.15.45:0/758045741 shutdown_connections 2024-08-17T02:25:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.683+0000 7ff5cbe00640 1 --2- 172.21.15.45:0/758045741 >> v2:172.21.15.45:3300/0 conn(0x7ff5c40ac650 0x7ff5c40acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.683+0000 7ff5cbe00640 1 --2- 172.21.15.45:0/758045741 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 0x7ff5c40ac110 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.683+0000 7ff5cbe00640 1 --2- 172.21.15.45:0/758045741 >> v2:172.21.15.169:3300/0 conn(0x7ff5c4158cb0 0x7ff5c40af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.683+0000 7ff5cbe00640 1 -- 172.21.15.45:0/758045741 >> 172.21.15.45:0/758045741 conn(0x7ff5c4096a70 msgr2=0x7ff5c4096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.683+0000 7ff5cbe00640 1 -- 172.21.15.45:0/758045741 shutdown_connections 2024-08-17T02:25:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.683+0000 7ff5cbe00640 1 -- 172.21.15.45:0/758045741 wait complete. 2024-08-17T02:25:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.685+0000 7ff5cbe00640 1 Processor -- start 2024-08-17T02:25:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.685+0000 7ff5cbe00640 1 -- start start 2024-08-17T02:25:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5cbe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 0x7ff5c409ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5cbe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5c40ac650 0x7ff5c4099320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5cbe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c4158cb0 0x7ff5c40cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5cbe00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c409a3e0 con 0x7ff5c4158cb0 2024-08-17T02:25:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5cbe00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c416a160 con 0x7ff5c40ac650 2024-08-17T02:25:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5cbe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c4099b40 con 0x7ff5c40aa910 2024-08-17T02:25:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5c9e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c4158cb0 0x7ff5c40cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5c9e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c4158cb0 0x7ff5c40cc740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36174/0 (socket says 172.21.15.45:36174) 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5c8a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5c40ac650 0x7ff5c4099320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5c9e00640 1 -- 172.21.15.45:0/1741232340 learned_addr learned my addr 172.21.15.45:0/1741232340 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5c9400640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 0x7ff5c409ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5c9e00640 1 -- 172.21.15.45:0/1741232340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 msgr2=0x7ff5c409ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5c9e00640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 0x7ff5c409ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5c9e00640 1 -- 172.21.15.45:0/1741232340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5c40ac650 msgr2=0x7ff5c4099320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.686+0000 7ff5c9e00640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5c40ac650 0x7ff5c4099320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.687+0000 7ff5c9e00640 1 -- 172.21.15.45:0/1741232340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b0009450 con 0x7ff5c4158cb0 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.687+0000 7ff5c8a00640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5c40ac650 0x7ff5c4099320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.687+0000 7ff5c9e00640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c4158cb0 0x7ff5c40cc740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009fa0 tx=0x7ff5bc009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.687+0000 7ff5c0c00640 1 -- 172.21.15.45:0/1741232340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc00ee60 con 0x7ff5c4158cb0 2024-08-17T02:25:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.687+0000 7ff5c0c00640 1 -- 172.21.15.45:0/1741232340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5bc014420 con 0x7ff5c4158cb0 2024-08-17T02:25:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.687+0000 7ff5cbe00640 1 -- 172.21.15.45:0/1741232340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c4099e20 con 0x7ff5c4158cb0 2024-08-17T02:25:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.687+0000 7ff5c0c00640 1 -- 172.21.15.45:0/1741232340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5bc0147e0 con 0x7ff5c4158cb0 2024-08-17T02:25:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.687+0000 7ff5cbe00640 1 -- 172.21.15.45:0/1741232340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c4099860 con 0x7ff5c4158cb0 2024-08-17T02:25:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.688+0000 7ff5cbe00640 1 -- 172.21.15.45:0/1741232340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5c4169f10 con 0x7ff5c4158cb0 2024-08-17T02:25:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.689+0000 7ff5c0c00640 1 -- 172.21.15.45:0/1741232340 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff5bc014b50 con 0x7ff5c4158cb0 2024-08-17T02:25:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.690+0000 7ff5c0c00640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff5a4065150 0x7ff5a4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.690+0000 7ff5c0c00640 1 -- 172.21.15.45:0/1741232340 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff5bc082890 con 0x7ff5c4158cb0 2024-08-17T02:25:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.690+0000 7ff5c9400640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff5a4065150 0x7ff5a4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.691+0000 7ff5c9400640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff5a4065150 0x7ff5a4067600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4166950 tx=0x7ff5b80090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.694+0000 7ff5c0c00640 1 -- 172.21.15.45:0/1741232340 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff5bc050cb0 con 0x7ff5c4158cb0 2024-08-17T02:25:09.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.880+0000 7ff5cbe00640 1 -- 172.21.15.45:0/1741232340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5c416a2d0 con 0x7ff5c4158cb0 2024-08-17T02:25:09.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.881+0000 7ff5c0c00640 1 -- 172.21.15.45:0/1741232340 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7ff5bc0542d0 con 0x7ff5c4158cb0 2024-08-17T02:25:09.881 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:09.882 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:06.016838+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 -- 172.21.15.45:0/1741232340 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff5a4065150 msgr2=0x7ff5a4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff5a4065150 0x7ff5a4067600 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4166950 tx=0x7ff5b80090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 -- 172.21.15.45:0/1741232340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c4158cb0 msgr2=0x7ff5c40cc740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c4158cb0 0x7ff5c40cc740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc009fa0 tx=0x7ff5bc009900 comp rx=0 tx=0).stop 2024-08-17T02:25:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 -- 172.21.15.45:0/1741232340 shutdown_connections 2024-08-17T02:25:09.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5c4158cb0 0x7ff5c40cc740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff5c40ac650 0x7ff5c4099320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff5a4065150 0x7ff5a4067600 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 --2- 172.21.15.45:0/1741232340 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff5c40aa910 0x7ff5c409ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 -- 172.21.15.45:0/1741232340 >> 172.21.15.45:0/1741232340 conn(0x7ff5c4096a70 msgr2=0x7ff5c4068a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 -- 172.21.15.45:0/1741232340 shutdown_connections 2024-08-17T02:25:09.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:09.883+0000 7ff5cbe00640 1 -- 172.21.15.45:0/1741232340 wait complete. 2024-08-17T02:25:09.898 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:25:09.899 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:10.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.052+0000 7f8ccd800640 1 Processor -- start 2024-08-17T02:25:10.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.052+0000 7f8ccd800640 1 -- start start 2024-08-17T02:25:10.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.053+0000 7f8ccd800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8cc80accf0 0x7f8cc80b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.053+0000 7f8ccd800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cc80afd90 0x7f8cc8157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.053+0000 7f8ccd800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc80ae540 con 0x7f8cc8159610 2024-08-17T02:25:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.053+0000 7f8ccd800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc80ad930 con 0x7f8cc80afd90 2024-08-17T02:25:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.053+0000 7f8ccd800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc80adc10 con 0x7f8cc80accf0 2024-08-17T02:25:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.053+0000 7f8cc7400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cc80afd90 0x7f8cc8157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.053+0000 7f8cc7400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8cc80afd90 0x7f8cc8157690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36178/0 (socket says 172.21.15.45:36178) 2024-08-17T02:25:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.053+0000 7f8cc6a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8cc80accf0 0x7f8cc80b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.053+0000 7f8cc7400640 1 -- 172.21.15.45:0/648211132 learned_addr learned my addr 172.21.15.45:0/648211132 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.054+0000 7f8cc7400640 1 -- 172.21.15.45:0/648211132 >> v2:172.21.15.169:3300/0 conn(0x7f8cc80accf0 msgr2=0x7f8cc80b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.054+0000 7f8cc7400640 1 --2- 172.21.15.45:0/648211132 >> v2:172.21.15.169:3300/0 conn(0x7f8cc80accf0 0x7f8cc80b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.054+0000 7f8cc7400640 1 -- 172.21.15.45:0/648211132 >> v1:172.21.15.169:6789/0 conn(0x7f8cc8159610 legacy=0x7f8cc80af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.054+0000 7f8cc7400640 1 -- 172.21.15.45:0/648211132 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc80adef0 con 0x7f8cc80afd90 2024-08-17T02:25:10.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.055+0000 7f8cc7400640 1 --2- 172.21.15.45:0/648211132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cc80afd90 0x7f8cc8157690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8157190 tx=0x7f8cc0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68639cb5a5fde049 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.055+0000 7f8cc5600640 1 -- 172.21.15.45:0/648211132 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0032400 con 0x7f8cc80afd90 2024-08-17T02:25:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.055+0000 7f8cc5600640 1 -- 172.21.15.45:0/648211132 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc002e050 con 0x7f8cc80afd90 2024-08-17T02:25:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.055+0000 7f8cc5600640 1 -- 172.21.15.45:0/648211132 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00327f0 con 0x7f8cc80afd90 2024-08-17T02:25:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.055+0000 7f8ccd800640 1 -- 172.21.15.45:0/648211132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cc80afd90 msgr2=0x7f8cc8157690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.055+0000 7f8ccd800640 1 --2- 172.21.15.45:0/648211132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cc80afd90 0x7f8cc8157690 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8157190 tx=0x7f8cc0009840 comp rx=0 tx=0).stop 2024-08-17T02:25:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.056+0000 7f8ccd800640 1 -- 172.21.15.45:0/648211132 shutdown_connections 2024-08-17T02:25:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.056+0000 7f8ccd800640 1 --2- 172.21.15.45:0/648211132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cc80afd90 0x7f8cc8157690 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.056+0000 7f8ccd800640 1 --2- 172.21.15.45:0/648211132 >> v2:172.21.15.169:3300/0 conn(0x7f8cc80accf0 0x7f8cc80b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.056+0000 7f8ccd800640 1 -- 172.21.15.45:0/648211132 >> 172.21.15.45:0/648211132 conn(0x7f8cc8067750 msgr2=0x7f8cc80cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.056+0000 7f8ccd800640 1 -- 172.21.15.45:0/648211132 shutdown_connections 2024-08-17T02:25:10.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.056+0000 7f8ccd800640 1 -- 172.21.15.45:0/648211132 wait complete. 2024-08-17T02:25:10.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.057+0000 7f8ccd800640 1 Processor -- start 2024-08-17T02:25:10.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.057+0000 7f8ccd800640 1 -- start start 2024-08-17T02:25:10.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.058+0000 7f8ccd800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc80accf0 0x7f8cc8141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.058+0000 7f8ccd800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cc80afd90 0x7f8cc816c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.058+0000 7f8ccd800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cc8159610 0x7f8cc80aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.058+0000 7f8ccd800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc80c08c0 con 0x7f8cc8159610 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.058+0000 7f8ccd800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc816d110 con 0x7f8cc80afd90 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.058+0000 7f8ccd800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc816d3f0 con 0x7f8cc80accf0 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.058+0000 7f8cc7400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cc8159610 0x7f8cc80aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.058+0000 7f8cc7400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cc8159610 0x7f8cc80aa8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36190/0 (socket says 172.21.15.45:36190) 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.058+0000 7f8cc6000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cc80afd90 0x7f8cc816c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.058+0000 7f8cc7400640 1 -- 172.21.15.45:0/3579410075 learned_addr learned my addr 172.21.15.45:0/3579410075 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.058+0000 7f8cc6a00640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc80accf0 0x7f8cc8141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.059+0000 7f8cc7400640 1 -- 172.21.15.45:0/3579410075 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc80accf0 msgr2=0x7f8cc8141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.059+0000 7f8cc7400640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc80accf0 0x7f8cc8141920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.059+0000 7f8cc7400640 1 -- 172.21.15.45:0/3579410075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cc80afd90 msgr2=0x7f8cc816c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.059+0000 7f8cc7400640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cc80afd90 0x7f8cc816c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.059+0000 7f8cc7400640 1 -- 172.21.15.45:0/3579410075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc0009ae0 con 0x7f8cc8159610 2024-08-17T02:25:10.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.059+0000 7f8cc7400640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cc8159610 0x7f8cc80aa8b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009f50 tx=0x7f8cc0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.059+0000 7f8cbe000640 1 -- 172.21.15.45:0/3579410075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc00077e0 con 0x7f8cc8159610 2024-08-17T02:25:10.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.059+0000 7f8cbe000640 1 -- 172.21.15.45:0/3579410075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc0007960 con 0x7f8cc8159610 2024-08-17T02:25:10.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.059+0000 7f8cbe000640 1 -- 172.21.15.45:0/3579410075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0007d20 con 0x7f8cc8159610 2024-08-17T02:25:10.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.059+0000 7f8ccd800640 1 -- 172.21.15.45:0/3579410075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc80c0ad0 con 0x7f8cc8159610 2024-08-17T02:25:10.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.059+0000 7f8ccd800640 1 -- 172.21.15.45:0/3579410075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc8154660 con 0x7f8cc8159610 2024-08-17T02:25:10.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.061+0000 7f8ccd800640 1 -- 172.21.15.45:0/3579410075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc8064db0 con 0x7f8cc8159610 2024-08-17T02:25:10.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.061+0000 7f8cbe000640 1 -- 172.21.15.45:0/3579410075 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8cc0003040 con 0x7f8cc8159610 2024-08-17T02:25:10.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.062+0000 7f8cbe000640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8ca8065220 0x7f8ca80676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.063+0000 7f8cbe000640 1 -- 172.21.15.45:0/3579410075 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8cc00a25d0 con 0x7f8cc8159610 2024-08-17T02:25:10.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.063+0000 7f8cc6a00640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8ca8065220 0x7f8ca80676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.063+0000 7f8cc6a00640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8ca8065220 0x7f8ca80676d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8157010 tx=0x7f8cb80090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.067+0000 7f8cbe000640 1 -- 172.21.15.45:0/3579410075 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8cc0070a70 con 0x7f8cc8159610 2024-08-17T02:25:10.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.248+0000 7f8ccd800640 1 -- 172.21.15.45:0/3579410075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8cc80ab6e0 con 0x7f8cc8159610 2024-08-17T02:25:10.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.248+0000 7f8cbe000640 1 -- 172.21.15.45:0/3579410075 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8cc0074090 con 0x7f8cc8159610 2024-08-17T02:25:10.249 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:25:10.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 -- 172.21.15.45:0/3579410075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8ca8065220 msgr2=0x7f8ca80676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8ca8065220 0x7f8ca80676d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8157010 tx=0x7f8cb80090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 -- 172.21.15.45:0/3579410075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cc8159610 msgr2=0x7f8cc80aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cc8159610 0x7f8cc80aa8b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009f50 tx=0x7f8cc0037000 comp rx=0 tx=0).stop 2024-08-17T02:25:10.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 -- 172.21.15.45:0/3579410075 shutdown_connections 2024-08-17T02:25:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8cc8159610 0x7f8cc80aa8b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8cc80afd90 0x7f8cc816c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8ca8065220 0x7f8ca80676d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 --2- 172.21.15.45:0/3579410075 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8cc80accf0 0x7f8cc8141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 -- 172.21.15.45:0/3579410075 >> 172.21.15.45:0/3579410075 conn(0x7f8cc8067750 msgr2=0x7f8cc80abb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 -- 172.21.15.45:0/3579410075 shutdown_connections 2024-08-17T02:25:10.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.250+0000 7f8ccd800640 1 -- 172.21.15.45:0/3579410075 wait complete. 2024-08-17T02:25:10.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:10.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.415+0000 7f8431e00640 1 Processor -- start 2024-08-17T02:25:10.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.415+0000 7f8431e00640 1 -- start start 2024-08-17T02:25:10.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.416+0000 7f8431e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f842c0b1440 0x7f842c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.416+0000 7f8431e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f842c140580 0x7f842c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.416+0000 7f8431e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c0caa80 con 0x7f842c1401b0 2024-08-17T02:25:10.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.416+0000 7f8431e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842c0cb450 con 0x7f842c140580 2024-08-17T02:25:10.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.416+0000 7f8431e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0c9e70 con 0x7f842c0b1440 2024-08-17T02:25:10.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.417+0000 7f842b400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f842c140580 0x7f842c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.417+0000 7f842aa00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f842c1401b0 0x7f842c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41994/0 (socket says 172.21.15.45:41994) 2024-08-17T02:25:10.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.417+0000 7f842aa00640 1 -- 172.21.15.45:0/296094855 learned_addr learned my addr 172.21.15.45:0/296094855 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:10.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.417+0000 7f842a000640 1 --2- 172.21.15.45:0/296094855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f842c0b1440 0x7f842c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.417+0000 7f842b400640 1 -- 172.21.15.45:0/296094855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f842c0b1440 msgr2=0x7f842c0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:10.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.417+0000 7f842b400640 1 --2- 172.21.15.45:0/296094855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f842c0b1440 0x7f842c0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.417+0000 7f842b400640 1 -- 172.21.15.45:0/296094855 >> v1:172.21.15.45:6789/0 conn(0x7f842c1401b0 legacy=0x7f842c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.417+0000 7f842b400640 1 -- 172.21.15.45:0/296094855 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c0ca150 con 0x7f842c140580 2024-08-17T02:25:10.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.417+0000 7f8429600640 1 -- 172.21.15.45:0/296094855 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365550968 0 0) 0x7f842c0caa80 con 0x7f842c1401b0 2024-08-17T02:25:10.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.418+0000 7f842b400640 1 --2- 172.21.15.45:0/296094855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f842c140580 0x7f842c0c9040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8424009e60 tx=0x7f8424009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615b41a556fa14cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.418+0000 7f8429600640 1 -- 172.21.15.45:0/296094855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424007550 con 0x7f842c140580 2024-08-17T02:25:10.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.418+0000 7f8429600640 1 -- 172.21.15.45:0/296094855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842402d050 con 0x7f842c140580 2024-08-17T02:25:10.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.418+0000 7f8429600640 1 -- 172.21.15.45:0/296094855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84240078e0 con 0x7f842c140580 2024-08-17T02:25:10.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.419+0000 7f8431e00640 1 -- 172.21.15.45:0/296094855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f842c140580 msgr2=0x7f842c0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.419+0000 7f8431e00640 1 --2- 172.21.15.45:0/296094855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f842c140580 0x7f842c0c9040 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8424009e60 tx=0x7f8424009780 comp rx=0 tx=0).stop 2024-08-17T02:25:10.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.419+0000 7f8431e00640 1 -- 172.21.15.45:0/296094855 shutdown_connections 2024-08-17T02:25:10.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.419+0000 7f8431e00640 1 --2- 172.21.15.45:0/296094855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f842c140580 0x7f842c0c9040 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.419+0000 7f8431e00640 1 --2- 172.21.15.45:0/296094855 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f842c0b1440 0x7f842c0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.419+0000 7f8431e00640 1 -- 172.21.15.45:0/296094855 >> 172.21.15.45:0/296094855 conn(0x7f842c0cb9b0 msgr2=0x7f842c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:10.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.419+0000 7f8431e00640 1 -- 172.21.15.45:0/296094855 shutdown_connections 2024-08-17T02:25:10.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.419+0000 7f8431e00640 1 -- 172.21.15.45:0/296094855 wait complete. 2024-08-17T02:25:10.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.420+0000 7f8431e00640 1 Processor -- start 2024-08-17T02:25:10.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.421+0000 7f8431e00640 1 -- start start 2024-08-17T02:25:10.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.421+0000 7f8431e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f842c0b1440 0x7f842c13a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.421+0000 7f8431e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f842c1401b0 0x7f842c1567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.421+0000 7f8431e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f842c140580 0x7f842c15e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.421+0000 7f8431e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c13ba50 con 0x7f842c0b1440 2024-08-17T02:25:10.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.421+0000 7f8431e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c168ab0 con 0x7f842c1401b0 2024-08-17T02:25:10.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.421+0000 7f8431e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c13b1b0 con 0x7f842c140580 2024-08-17T02:25:10.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.422+0000 7f842aa00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f842c0b1440 0x7f842c13a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.422+0000 7f842aa00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f842c0b1440 0x7f842c13a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36208/0 (socket says 172.21.15.45:36208) 2024-08-17T02:25:10.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.422+0000 7f842aa00640 1 -- 172.21.15.45:0/1672749571 learned_addr learned my addr 172.21.15.45:0/1672749571 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:10.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.422+0000 7f842a000640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f842c1401b0 0x7f842c1567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.422+0000 7f842b400640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f842c140580 0x7f842c15e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.422+0000 7f842aa00640 1 -- 172.21.15.45:0/1672749571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f842c140580 msgr2=0x7f842c15e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.422+0000 7f842aa00640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f842c140580 0x7f842c15e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.422+0000 7f842aa00640 1 -- 172.21.15.45:0/1672749571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f842c1401b0 msgr2=0x7f842c1567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.422+0000 7f842aa00640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f842c1401b0 0x7f842c1567e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.422+0000 7f842aa00640 1 -- 172.21.15.45:0/1672749571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8424009a20 con 0x7f842c0b1440 2024-08-17T02:25:10.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.422+0000 7f842aa00640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f842c0b1440 0x7f842c13a910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c5e0 tx=0x7f841c007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.423+0000 7f8422000640 1 -- 172.21.15.45:0/1672749571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c005aa0 con 0x7f842c0b1440 2024-08-17T02:25:10.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.423+0000 7f8422000640 1 -- 172.21.15.45:0/1672749571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841c005c00 con 0x7f842c0b1440 2024-08-17T02:25:10.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.423+0000 7f8431e00640 1 -- 172.21.15.45:0/1672749571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c13b490 con 0x7f842c0b1440 2024-08-17T02:25:10.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.423+0000 7f8422000640 1 -- 172.21.15.45:0/1672749571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841c0070f0 con 0x7f842c0b1440 2024-08-17T02:25:10.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.423+0000 7f8431e00640 1 -- 172.21.15.45:0/1672749571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c168d00 con 0x7f842c0b1440 2024-08-17T02:25:10.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.424+0000 7f8431e00640 1 -- 172.21.15.45:0/1672749571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842c064db0 con 0x7f842c0b1440 2024-08-17T02:25:10.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.425+0000 7f8422000640 1 -- 172.21.15.45:0/1672749571 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f841c0074a0 con 0x7f842c0b1440 2024-08-17T02:25:10.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.426+0000 7f8422000640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f840c065150 0x7f840c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.426+0000 7f8422000640 1 -- 172.21.15.45:0/1672749571 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f841c081a00 con 0x7f842c0b1440 2024-08-17T02:25:10.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.426+0000 7f842a000640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f840c065150 0x7f840c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.427+0000 7f842a000640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f840c065150 0x7f840c067600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f842c13bd40 tx=0x7f8418008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.429+0000 7f8422000640 1 -- 172.21.15.45:0/1672749571 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f841c04fea0 con 0x7f842c0b1440 2024-08-17T02:25:10.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.651+0000 7f8431e00640 1 -- 172.21.15.45:0/1672749571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f842c0cbf20 con 0x7f842c0b1440 2024-08-17T02:25:10.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.651+0000 7f8422000640 1 -- 172.21.15.45:0/1672749571 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7f841c0534c0 con 0x7f842c0b1440 2024-08-17T02:25:10.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:10.653 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1637538519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1637538519},{"type":"v1","addr":"172.21.15.45:6837","nonce":1637538519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1027153973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1027153973},{"type":"v1","addr":"172.21.15.169:6835","nonce":1027153973}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2482387224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2482387224},{"type":"v1","addr":"172.21.15.45:6835","nonce":2482387224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4291,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/911178485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":911178485},{"type":"v1","addr":"172.21.15.169:6834","nonce":911178485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-08-17T02:25:10.653 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2024-08-17T02:25:10.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.653+0000 7f8431e00640 1 -- 172.21.15.45:0/1672749571 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f840c065150 msgr2=0x7f840c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.653+0000 7f8431e00640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f840c065150 0x7f840c067600 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f842c13bd40 tx=0x7f8418008040 comp rx=0 tx=0).stop 2024-08-17T02:25:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.653+0000 7f8431e00640 1 -- 172.21.15.45:0/1672749571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f842c0b1440 msgr2=0x7f842c13a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.653+0000 7f8431e00640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f842c0b1440 0x7f842c13a910 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f841c00c5e0 tx=0x7f841c007d60 comp rx=0 tx=0).stop 2024-08-17T02:25:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.653+0000 7f8431e00640 1 -- 172.21.15.45:0/1672749571 shutdown_connections 2024-08-17T02:25:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.653+0000 7f8431e00640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f840c065150 0x7f840c067600 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.653+0000 7f8431e00640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f842c140580 0x7f842c15e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.653+0000 7f8431e00640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f842c1401b0 0x7f842c1567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.653+0000 7f8431e00640 1 --2- 172.21.15.45:0/1672749571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f842c0b1440 0x7f842c13a910 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.653+0000 7f8431e00640 1 -- 172.21.15.45:0/1672749571 >> 172.21.15.45:0/1672749571 conn(0x7f842c0cb9b0 msgr2=0x7f842c06df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.653+0000 7f8431e00640 1 -- 172.21.15.45:0/1672749571 shutdown_connections 2024-08-17T02:25:10.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.654+0000 7f8431e00640 1 -- 172.21.15.45:0/1672749571 wait complete. 2024-08-17T02:25:10.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:10.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.820+0000 7f3a37000640 1 Processor -- start 2024-08-17T02:25:10.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.820+0000 7f3a37000640 1 -- start start 2024-08-17T02:25:10.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.821+0000 7f3a37000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a30159ca0 0x7f3a300ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.821+0000 7f3a37000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a300cadc0 con 0x7f3a300ccca0 2024-08-17T02:25:10.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.821+0000 7f3a37000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a300cb060 con 0x7f3a300ca8a0 2024-08-17T02:25:10.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.821+0000 7f3a37000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300cd6e0 con 0x7f3a30159ca0 2024-08-17T02:25:10.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.821+0000 7f3a35c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a30159ca0 0x7f3a300ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.821+0000 7f3a36600640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3a300ccca0 0x7f3a30162860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41996/0 (socket says 172.21.15.45:41996) 2024-08-17T02:25:10.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.821+0000 7f3a36600640 1 -- 172.21.15.45:0/2694945129 learned_addr learned my addr 172.21.15.45:0/2694945129 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:10.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.822+0000 7f3a35c00640 1 -- 172.21.15.45:0/2694945129 >> v1:172.21.15.169:6789/0 conn(0x7f3a300ca8a0 legacy=0x7f3a300cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.822+0000 7f3a35c00640 1 -- 172.21.15.45:0/2694945129 >> v1:172.21.15.45:6789/0 conn(0x7f3a300ccca0 legacy=0x7f3a30162860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.822+0000 7f3a35c00640 1 -- 172.21.15.45:0/2694945129 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a300cb300 con 0x7f3a30159ca0 2024-08-17T02:25:10.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.822+0000 7f3a2fe00640 1 -- 172.21.15.45:0/2694945129 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727151217 0 0) 0x7f3a300cadc0 con 0x7f3a300ccca0 2024-08-17T02:25:10.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.823+0000 7f3a35c00640 1 --2- 172.21.15.45:0/2694945129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a30159ca0 0x7f3a300ca360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009850 tx=0x7f3a240090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83afc623036ca43 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.823+0000 7f3a2fe00640 1 -- 172.21.15.45:0/2694945129 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2402ae20 con 0x7f3a30159ca0 2024-08-17T02:25:10.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.823+0000 7f3a2fe00640 1 -- 172.21.15.45:0/2694945129 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a24032440 con 0x7f3a30159ca0 2024-08-17T02:25:10.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.823+0000 7f3a2fe00640 1 -- 172.21.15.45:0/2694945129 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a240327e0 con 0x7f3a30159ca0 2024-08-17T02:25:10.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.823+0000 7f3a37000640 1 -- 172.21.15.45:0/2694945129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a30159ca0 msgr2=0x7f3a300ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.823+0000 7f3a37000640 1 --2- 172.21.15.45:0/2694945129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a30159ca0 0x7f3a300ca360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3a24009850 tx=0x7f3a240090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.824+0000 7f3a37000640 1 -- 172.21.15.45:0/2694945129 shutdown_connections 2024-08-17T02:25:10.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.824+0000 7f3a37000640 1 --2- 172.21.15.45:0/2694945129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a30159ca0 0x7f3a300ca360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.824+0000 7f3a37000640 1 -- 172.21.15.45:0/2694945129 >> 172.21.15.45:0/2694945129 conn(0x7f3a30098e00 msgr2=0x7f3a3006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:10.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.824+0000 7f3a37000640 1 -- 172.21.15.45:0/2694945129 shutdown_connections 2024-08-17T02:25:10.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.824+0000 7f3a37000640 1 -- 172.21.15.45:0/2694945129 wait complete. 2024-08-17T02:25:10.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.825+0000 7f3a37000640 1 Processor -- start 2024-08-17T02:25:10.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.825+0000 7f3a37000640 1 -- start start 2024-08-17T02:25:10.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.826+0000 7f3a37000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a300ca8a0 0x7f3a300c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.826+0000 7f3a37000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a300ccca0 0x7f3a300b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.826+0000 7f3a37000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a30159ca0 0x7f3a3016c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.826+0000 7f3a37000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300b4050 con 0x7f3a300ccca0 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.826+0000 7f3a37000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300b3440 con 0x7f3a30159ca0 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.826+0000 7f3a37000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300b3720 con 0x7f3a300ca8a0 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.826+0000 7f3a35200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a300ccca0 0x7f3a300b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.826+0000 7f3a35200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a300ccca0 0x7f3a300b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36234/0 (socket says 172.21.15.45:36234) 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.826+0000 7f3a35200640 1 -- 172.21.15.45:0/4117812512 learned_addr learned my addr 172.21.15.45:0/4117812512 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.826+0000 7f3a35c00640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a300ca8a0 0x7f3a300c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.827+0000 7f3a36600640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a30159ca0 0x7f3a3016c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.827+0000 7f3a35200640 1 -- 172.21.15.45:0/4117812512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a300ca8a0 msgr2=0x7f3a300c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.827+0000 7f3a35200640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a300ca8a0 0x7f3a300c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.827+0000 7f3a35200640 1 -- 172.21.15.45:0/4117812512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a30159ca0 msgr2=0x7f3a3016c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.827+0000 7f3a35200640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a30159ca0 0x7f3a3016c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.827+0000 7f3a35200640 1 -- 172.21.15.45:0/4117812512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a24009390 con 0x7f3a300ccca0 2024-08-17T02:25:10.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.827+0000 7f3a35200640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a300ccca0 0x7f3a300b2980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00c560 tx=0x7f3a1c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.827+0000 7f3a2cc00640 1 -- 172.21.15.45:0/4117812512 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c011590 con 0x7f3a300ccca0 2024-08-17T02:25:10.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.827+0000 7f3a2cc00640 1 -- 172.21.15.45:0/4117812512 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a1c011710 con 0x7f3a300ccca0 2024-08-17T02:25:10.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.827+0000 7f3a2cc00640 1 -- 172.21.15.45:0/4117812512 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c011ad0 con 0x7f3a300ccca0 2024-08-17T02:25:10.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.827+0000 7f3a37000640 1 -- 172.21.15.45:0/4117812512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a300b3a00 con 0x7f3a300ccca0 2024-08-17T02:25:10.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.828+0000 7f3a37000640 1 -- 172.21.15.45:0/4117812512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a300c9580 con 0x7f3a300ccca0 2024-08-17T02:25:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.828+0000 7f3a37000640 1 -- 172.21.15.45:0/4117812512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a30088da0 con 0x7f3a300ccca0 2024-08-17T02:25:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.829+0000 7f3a2cc00640 1 -- 172.21.15.45:0/4117812512 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3a1c01b3b0 con 0x7f3a300ccca0 2024-08-17T02:25:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.830+0000 7f3a2cc00640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3a10065150 0x7f3a10067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.830+0000 7f3a2cc00640 1 -- 172.21.15.45:0/4117812512 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3a1c081660 con 0x7f3a300ccca0 2024-08-17T02:25:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.830+0000 7f3a35c00640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3a10065150 0x7f3a10067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.831+0000 7f3a35c00640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3a10065150 0x7f3a10067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a24034000 tx=0x7f3a24032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:10.834+0000 7f3a2cc00640 1 -- 172.21.15.45:0/4117812512 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3a30088da0 con 0x7f3a300ccca0 2024-08-17T02:25:11.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.015+0000 7f3a37000640 1 -- 172.21.15.45:0/4117812512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a30088da0 con 0x7f3a300ccca0 2024-08-17T02:25:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.016+0000 7f3a2cc00640 1 -- 172.21.15.45:0/4117812512 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12127 (secure 0 0 0) 0x7f3a1c068e60 con 0x7f3a300ccca0 2024-08-17T02:25:11.017 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:11.017 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:06.016838+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 -- 172.21.15.45:0/4117812512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3a10065150 msgr2=0x7f3a10067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3a10065150 0x7f3a10067600 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3a24034000 tx=0x7f3a24032000 comp rx=0 tx=0).stop 2024-08-17T02:25:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 -- 172.21.15.45:0/4117812512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a300ccca0 msgr2=0x7f3a300b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a300ccca0 0x7f3a300b2980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c00c560 tx=0x7f3a1c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 -- 172.21.15.45:0/4117812512 shutdown_connections 2024-08-17T02:25:11.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a30159ca0 0x7f3a3016c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a300ccca0 0x7f3a300b2980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3a10065150 0x7f3a10067600 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 --2- 172.21.15.45:0/4117812512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a300ca8a0 0x7f3a300c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 -- 172.21.15.45:0/4117812512 >> 172.21.15.45:0/4117812512 conn(0x7f3a30098e00 msgr2=0x7f3a300cc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:11.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 -- 172.21.15.45:0/4117812512 shutdown_connections 2024-08-17T02:25:11.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.018+0000 7f3a37000640 1 -- 172.21.15.45:0/4117812512 wait complete. 2024-08-17T02:25:11.034 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:25:11.034 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.186+0000 7ff6e7200640 1 Processor -- start 2024-08-17T02:25:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.186+0000 7ff6e7200640 1 -- start start 2024-08-17T02:25:11.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.187+0000 7ff6e7200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6e815a0e0 0x7ff6e806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.187+0000 7ff6e7200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff6e80ab010 0x7ff6e80ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.187+0000 7ff6e7200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e80af5f0 con 0x7ff6e806df00 2024-08-17T02:25:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.187+0000 7ff6e7200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e8159600 con 0x7ff6e80ab010 2024-08-17T02:25:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.187+0000 7ff6e7200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e81598e0 con 0x7ff6e815a0e0 2024-08-17T02:25:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6e5e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff6e806df00 0x7ff6e80aa900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42006/0 (socket says 172.21.15.45:42006) 2024-08-17T02:25:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6e5e00640 1 -- 172.21.15.45:0/2146575300 learned_addr learned my addr 172.21.15.45:0/2146575300 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:11.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6dfe00640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6e815a0e0 0x7ff6e806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6e6800640 1 --2- 172.21.15.45:0/2146575300 >> v2:172.21.15.169:3300/0 conn(0x7ff6e80ab010 0x7ff6e80ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227172871 0 0) 0x7ff6e80af5f0 con 0x7ff6e806df00 2024-08-17T02:25:11.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6cc0034e0 con 0x7ff6e806df00 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1513728468 0 0) 0x7ff6cc0034e0 con 0x7ff6e806df00 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6e815a0e0 msgr2=0x7ff6e806e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6e5400640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6e815a0e0 0x7ff6e806e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 >> v2:172.21.15.169:3300/0 conn(0x7ff6e80ab010 msgr2=0x7ff6e80ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6e5400640 1 --2- 172.21.15.45:0/2146575300 >> v2:172.21.15.169:3300/0 conn(0x7ff6e80ab010 0x7ff6e80ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.188+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8159bc0 con 0x7ff6e806df00 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7ff6d8001470 con 0x7ff6e806df00 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 >> v1:172.21.15.45:6789/0 conn(0x7ff6e806df00 legacy=0x7ff6e80aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5400640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6cc003a50 0x7ff6cc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5400640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6cc004780 0x7ff6cc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5400640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6e815a0e0 0x7ff6cc005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e8159600 con 0x7ff6cc004780 2024-08-17T02:25:11.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e81598e0 con 0x7ff6cc003a50 2024-08-17T02:25:11.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc00dcc0 con 0x7ff6e815a0e0 2024-08-17T02:25:11.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5e00640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6cc003a50 0x7ff6cc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6dfe00640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6cc004780 0x7ff6cc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e6800640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6e815a0e0 0x7ff6cc005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5e00640 1 -- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6e815a0e0 msgr2=0x7ff6cc005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:11.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5e00640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6e815a0e0 0x7ff6cc005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5e00640 1 -- 172.21.15.45:0/2146575300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6cc004780 msgr2=0x7ff6cc004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:11.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5e00640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6cc004780 0x7ff6cc004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6e5e00640 1 -- 172.21.15.45:0/2146575300 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0034e0 con 0x7ff6cc003a50 2024-08-17T02:25:11.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.189+0000 7ff6dfe00640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6cc004780 0x7ff6cc004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:11.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.190+0000 7ff6e5e00640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6cc003a50 0x7ff6cc003e60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c210 tx=0x7ff6d8001dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5af9fe5c396e4028 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.191+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8005890 con 0x7ff6cc003a50 2024-08-17T02:25:11.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.191+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d8005a10 con 0x7ff6cc003a50 2024-08-17T02:25:11.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.191+0000 7ff6e5400640 1 -- 172.21.15.45:0/2146575300 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8005dd0 con 0x7ff6cc003a50 2024-08-17T02:25:11.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.191+0000 7ff6e7200640 1 -- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6cc003a50 msgr2=0x7ff6cc003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.191+0000 7ff6e7200640 1 --2- 172.21.15.45:0/2146575300 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6cc003a50 0x7ff6cc003e60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800c210 tx=0x7ff6d8001dc0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.191+0000 7ff6e6800640 1 -- 172.21.15.45:0/2146575300 reap_dead start 2024-08-17T02:25:11.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.191+0000 7ff6e7200640 1 -- 172.21.15.45:0/2146575300 shutdown_connections 2024-08-17T02:25:11.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.191+0000 7ff6e7200640 1 -- 172.21.15.45:0/2146575300 >> 172.21.15.45:0/2146575300 conn(0x7ff6e8067750 msgr2=0x7ff6e806c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:11.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.191+0000 7ff6e7200640 1 -- 172.21.15.45:0/2146575300 shutdown_connections 2024-08-17T02:25:11.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.191+0000 7ff6e7200640 1 -- 172.21.15.45:0/2146575300 wait complete. 2024-08-17T02:25:11.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.193+0000 7ff6e7200640 1 Processor -- start 2024-08-17T02:25:11.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.193+0000 7ff6e7200640 1 -- start start 2024-08-17T02:25:11.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e7200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6cc003a50 0x7ff6e8158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e7200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6e815f4e0 0x7ff6e8153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e7200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6e815bf50 0x7ff6e8154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e7200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e815bac0 con 0x7ff6e815bf50 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e7200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e815f950 con 0x7ff6e815f4e0 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e7200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e8158820 con 0x7ff6cc003a50 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e6800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6e815bf50 0x7ff6e8154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e6800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6e815bf50 0x7ff6e8154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36256/0 (socket says 172.21.15.45:36256) 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e6800640 1 -- 172.21.15.45:0/3995912087 learned_addr learned my addr 172.21.15.45:0/3995912087 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6dfe00640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6e815f4e0 0x7ff6e8153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e5e00640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6cc003a50 0x7ff6e8158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e6800640 1 -- 172.21.15.45:0/3995912087 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6cc003a50 msgr2=0x7ff6e8158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e6800640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6cc003a50 0x7ff6e8158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e6800640 1 -- 172.21.15.45:0/3995912087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6e815f4e0 msgr2=0x7ff6e8153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e6800640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6e815f4e0 0x7ff6e8153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.194+0000 7ff6e6800640 1 -- 172.21.15.45:0/3995912087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8158b00 con 0x7ff6e815bf50 2024-08-17T02:25:11.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.195+0000 7ff6e6800640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6e815bf50 0x7ff6e8154d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80766c0 tx=0x7ff6e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.195+0000 7ff6dd600640 1 -- 172.21.15.45:0/3995912087 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e000e040 con 0x7ff6e815bf50 2024-08-17T02:25:11.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.195+0000 7ff6dd600640 1 -- 172.21.15.45:0/3995912087 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e000f040 con 0x7ff6e815bf50 2024-08-17T02:25:11.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.195+0000 7ff6e7200640 1 -- 172.21.15.45:0/3995912087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e815b750 con 0x7ff6e815bf50 2024-08-17T02:25:11.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.195+0000 7ff6dd600640 1 -- 172.21.15.45:0/3995912087 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0015920 con 0x7ff6e815bf50 2024-08-17T02:25:11.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.195+0000 7ff6e7200640 1 -- 172.21.15.45:0/3995912087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e815c3c0 con 0x7ff6e815bf50 2024-08-17T02:25:11.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.196+0000 7ff6e7200640 1 -- 172.21.15.45:0/3995912087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e815c640 con 0x7ff6e815bf50 2024-08-17T02:25:11.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.197+0000 7ff6dd600640 1 -- 172.21.15.45:0/3995912087 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff6e0015d10 con 0x7ff6e815bf50 2024-08-17T02:25:11.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.198+0000 7ff6dd600640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff6c4065180 0x7ff6c4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.198+0000 7ff6dd600640 1 -- 172.21.15.45:0/3995912087 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff6e00822b0 con 0x7ff6e815bf50 2024-08-17T02:25:11.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.198+0000 7ff6e5e00640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff6c4065180 0x7ff6c4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.199+0000 7ff6e5e00640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff6c4065180 0x7ff6c4067630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8032000 tx=0x7ff6d8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.202+0000 7ff6dd600640 1 -- 172.21.15.45:0/3995912087 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff6e00506d0 con 0x7ff6e815bf50 2024-08-17T02:25:11.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.384+0000 7ff6e7200640 1 -- 172.21.15.45:0/3995912087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff6e8071050 con 0x7ff6e815bf50 2024-08-17T02:25:11.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.385+0000 7ff6dd600640 1 -- 172.21.15.45:0/3995912087 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6e0053cf0 con 0x7ff6e815bf50 2024-08-17T02:25:11.386 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.386+0000 7ff6e7200640 1 -- 172.21.15.45:0/3995912087 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff6c4065180 msgr2=0x7ff6c4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.387+0000 7ff6e7200640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff6c4065180 0x7ff6c4067630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8032000 tx=0x7ff6d8030000 comp rx=0 tx=0).stop 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.387+0000 7ff6e7200640 1 -- 172.21.15.45:0/3995912087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6e815bf50 msgr2=0x7ff6e8154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.387+0000 7ff6e7200640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6e815bf50 0x7ff6e8154d10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80766c0 tx=0x7ff6e000b040 comp rx=0 tx=0).stop 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.387+0000 7ff6e7200640 1 -- 172.21.15.45:0/3995912087 shutdown_connections 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.387+0000 7ff6e7200640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6e815bf50 0x7ff6e8154d10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.387+0000 7ff6e7200640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff6e815f4e0 0x7ff6e8153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.387+0000 7ff6e7200640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff6c4065180 0x7ff6c4067630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.387+0000 7ff6e7200640 1 --2- 172.21.15.45:0/3995912087 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff6cc003a50 0x7ff6e8158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.387+0000 7ff6e7200640 1 -- 172.21.15.45:0/3995912087 >> 172.21.15.45:0/3995912087 conn(0x7ff6e8067750 msgr2=0x7ff6e80ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.387+0000 7ff6e7200640 1 -- 172.21.15.45:0/3995912087 shutdown_connections 2024-08-17T02:25:11.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.387+0000 7ff6e7200640 1 -- 172.21.15.45:0/3995912087 wait complete. 2024-08-17T02:25:11.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:25:11.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.552+0000 7fe1c4c00640 1 Processor -- start 2024-08-17T02:25:11.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.552+0000 7fe1c4c00640 1 -- start start 2024-08-17T02:25:11.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.553+0000 7fe1c4c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe1c00aed50 0x7fe1c00ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.553+0000 7fe1c4c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00ce6d0 0x7fe1c00ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.553+0000 7fe1c4c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1c00cc890 con 0x7fe1c00cacf0 2024-08-17T02:25:11.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.553+0000 7fe1c4c00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1c00ceb20 con 0x7fe1c00aed50 2024-08-17T02:25:11.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.553+0000 7fe1c4c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00cb4c0 con 0x7fe1c00ce6d0 2024-08-17T02:25:11.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.553+0000 7fe1bfe00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe1c00cacf0 0x7fe1c00c4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42018/0 (socket says 172.21.15.45:42018) 2024-08-17T02:25:11.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.553+0000 7fe1bfe00640 1 -- 172.21.15.45:0/971503447 learned_addr learned my addr 172.21.15.45:0/971503447 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:11.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.553+0000 7fe1bf400640 1 --2- 172.21.15.45:0/971503447 >> v2:172.21.15.45:3300/0 conn(0x7fe1c00aed50 0x7fe1c00ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.553+0000 7fe1b7e00640 1 --2- 172.21.15.45:0/971503447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00ce6d0 0x7fe1c00ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.554+0000 7fe1bf400640 1 -- 172.21.15.45:0/971503447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00ce6d0 msgr2=0x7fe1c00ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:11.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.554+0000 7fe1bf400640 1 --2- 172.21.15.45:0/971503447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00ce6d0 0x7fe1c00ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.554+0000 7fe1bf400640 1 -- 172.21.15.45:0/971503447 >> v1:172.21.15.45:6789/0 conn(0x7fe1c00cacf0 legacy=0x7fe1c00c4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.554+0000 7fe1bf400640 1 -- 172.21.15.45:0/971503447 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c00cb7a0 con 0x7fe1c00aed50 2024-08-17T02:25:11.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.554+0000 7fe1bea00640 1 -- 172.21.15.45:0/971503447 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3976453843 0 0) 0x7fe1c00cc890 con 0x7fe1c00cacf0 2024-08-17T02:25:11.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.555+0000 7fe1bf400640 1 --2- 172.21.15.45:0/971503447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1c00aed50 0x7fe1c00ce190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009850 tx=0x7fe1b00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6065a289dfc353b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.555+0000 7fe1bea00640 1 -- 172.21.15.45:0/971503447 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b002ad90 con 0x7fe1c00aed50 2024-08-17T02:25:11.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.555+0000 7fe1bea00640 1 -- 172.21.15.45:0/971503447 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b0032440 con 0x7fe1c00aed50 2024-08-17T02:25:11.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.555+0000 7fe1bea00640 1 -- 172.21.15.45:0/971503447 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00327e0 con 0x7fe1c00aed50 2024-08-17T02:25:11.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.556+0000 7fe1c4c00640 1 -- 172.21.15.45:0/971503447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1c00aed50 msgr2=0x7fe1c00ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.556+0000 7fe1c4c00640 1 --2- 172.21.15.45:0/971503447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1c00aed50 0x7fe1c00ce190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009850 tx=0x7fe1b00090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.556+0000 7fe1c4c00640 1 -- 172.21.15.45:0/971503447 shutdown_connections 2024-08-17T02:25:11.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.556+0000 7fe1c4c00640 1 --2- 172.21.15.45:0/971503447 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00ce6d0 0x7fe1c00ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.556+0000 7fe1c4c00640 1 --2- 172.21.15.45:0/971503447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1c00aed50 0x7fe1c00ce190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.556+0000 7fe1c4c00640 1 -- 172.21.15.45:0/971503447 >> 172.21.15.45:0/971503447 conn(0x7fe1c0098e30 msgr2=0x7fe1c006eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:11.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.556+0000 7fe1c4c00640 1 -- 172.21.15.45:0/971503447 shutdown_connections 2024-08-17T02:25:11.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.556+0000 7fe1c4c00640 1 -- 172.21.15.45:0/971503447 wait complete. 2024-08-17T02:25:11.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.557+0000 7fe1c4c00640 1 Processor -- start 2024-08-17T02:25:11.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.557+0000 7fe1c4c00640 1 -- start start 2024-08-17T02:25:11.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.558+0000 7fe1c4c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1c00aed50 0x7fe1c01691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.558+0000 7fe1c4c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00cacf0 0x7fe1c00c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.558+0000 7fe1c4c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1c00ce6d0 0x7fe1c01562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.558+0000 7fe1c4c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01696f0 con 0x7fe1c00aed50 2024-08-17T02:25:11.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.558+0000 7fe1c4c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00c6580 con 0x7fe1c00ce6d0 2024-08-17T02:25:11.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.558+0000 7fe1c4c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c00c4fa0 con 0x7fe1c00cacf0 2024-08-17T02:25:11.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.558+0000 7fe1bf400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1c00aed50 0x7fe1c01691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.558+0000 7fe1bf400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1c00aed50 0x7fe1c01691b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36276/0 (socket says 172.21.15.45:36276) 2024-08-17T02:25:11.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1bf400640 1 -- 172.21.15.45:0/3233135163 learned_addr learned my addr 172.21.15.45:0/3233135163 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:11.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1b7e00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00cacf0 0x7fe1c00c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1bfe00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1c00ce6d0 0x7fe1c01562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1bf400640 1 -- 172.21.15.45:0/3233135163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00cacf0 msgr2=0x7fe1c00c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1bf400640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00cacf0 0x7fe1c00c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1bf400640 1 -- 172.21.15.45:0/3233135163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1c00ce6d0 msgr2=0x7fe1c01562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1bf400640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1c00ce6d0 0x7fe1c01562b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1bf400640 1 -- 172.21.15.45:0/3233135163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b0009390 con 0x7fe1c00aed50 2024-08-17T02:25:11.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1bfe00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1c00ce6d0 0x7fe1c01562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:11.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1bf400640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1c00aed50 0x7fe1c01691b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009360 tx=0x7fe1b0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1b6a00640 1 -- 172.21.15.45:0/3233135163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0000d10 con 0x7fe1c00aed50 2024-08-17T02:25:11.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1b6a00640 1 -- 172.21.15.45:0/3233135163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b0031e00 con 0x7fe1c00aed50 2024-08-17T02:25:11.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1b6a00640 1 -- 172.21.15.45:0/3233135163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b003d670 con 0x7fe1c00aed50 2024-08-17T02:25:11.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.559+0000 7fe1c4c00640 1 -- 172.21.15.45:0/3233135163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c00c5280 con 0x7fe1c00aed50 2024-08-17T02:25:11.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.560+0000 7fe1c4c00640 1 -- 172.21.15.45:0/3233135163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c00c5840 con 0x7fe1c00aed50 2024-08-17T02:25:11.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.561+0000 7fe1c4c00640 1 -- 172.21.15.45:0/3233135163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1c0071050 con 0x7fe1c00aed50 2024-08-17T02:25:11.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.561+0000 7fe1b6a00640 1 -- 172.21.15.45:0/3233135163 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe1b0039040 con 0x7fe1c00aed50 2024-08-17T02:25:11.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.562+0000 7fe1b6a00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe19c065150 0x7fe19c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.562+0000 7fe1b6a00640 1 -- 172.21.15.45:0/3233135163 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe1b00a1fe0 con 0x7fe1c00aed50 2024-08-17T02:25:11.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.563+0000 7fe1b7e00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe19c065150 0x7fe19c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.563+0000 7fe1b7e00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe19c065150 0x7fe19c067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00651c0 tx=0x7fe1a80090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.566+0000 7fe1b6a00640 1 -- 172.21.15.45:0/3233135163 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe1b0070460 con 0x7fe1c00aed50 2024-08-17T02:25:11.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.756+0000 7fe1c4c00640 1 -- 172.21.15.45:0/3233135163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe1c0070430 con 0x7fe1c00aed50 2024-08-17T02:25:11.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.756+0000 7fe1b6a00640 1 -- 172.21.15.45:0/3233135163 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe1b0073a80 con 0x7fe1c00aed50 2024-08-17T02:25:11.757 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:11.757 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2024-08-17T02:25:11.757 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:25:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2024-08-17T02:25:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2024-08-17T02:25:11.758 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:25:11.758 INFO:teuthology.orchestra.run.smithi045.stdout:] 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.758+0000 7fe1c4c00640 1 -- 172.21.15.45:0/3233135163 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe19c065150 msgr2=0x7fe19c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.758+0000 7fe1c4c00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe19c065150 0x7fe19c067600 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe1c00651c0 tx=0x7fe1a80090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.758+0000 7fe1c4c00640 1 -- 172.21.15.45:0/3233135163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1c00aed50 msgr2=0x7fe1c01691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.758+0000 7fe1c4c00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1c00aed50 0x7fe1c01691b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0009360 tx=0x7fe1b0032000 comp rx=0 tx=0).stop 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.758+0000 7fe1c4c00640 1 -- 172.21.15.45:0/3233135163 shutdown_connections 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.759+0000 7fe1c4c00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe1c00ce6d0 0x7fe1c01562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.759+0000 7fe1c4c00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe19c065150 0x7fe19c067600 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.759+0000 7fe1c4c00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe1c00cacf0 0x7fe1c00c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.759+0000 7fe1c4c00640 1 --2- 172.21.15.45:0/3233135163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe1c00aed50 0x7fe1c01691b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.759+0000 7fe1c4c00640 1 -- 172.21.15.45:0/3233135163 >> 172.21.15.45:0/3233135163 conn(0x7fe1c0098e30 msgr2=0x7fe1c0158250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.759+0000 7fe1c4c00640 1 -- 172.21.15.45:0/3233135163 shutdown_connections 2024-08-17T02:25:11.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.759+0000 7fe1c4c00640 1 -- 172.21.15.45:0/3233135163 wait complete. 2024-08-17T02:25:11.774 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:25:11.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:25:11.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.929+0000 7f82a9400640 1 Processor -- start 2024-08-17T02:25:11.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.930+0000 7f82a9400640 1 -- start start 2024-08-17T02:25:11.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a9400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82a40cee50 0x7f82a40b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a9400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f82a406ef90 0x7f82a40b2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a9400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82a40cf220 0x7f82a40b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a9400640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a40b2300 con 0x7f82a40cf220 2024-08-17T02:25:11.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a9400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a40b1710 con 0x7f82a406ef90 2024-08-17T02:25:11.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a9400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40b19d0 con 0x7f82a40cee50 2024-08-17T02:25:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a8a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82a40cf220 0x7f82a40b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a8a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82a40cf220 0x7f82a40b2eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34196/0 (socket says 172.21.15.45:34196) 2024-08-17T02:25:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a8a00640 1 -- 172.21.15.45:0/1271722203 learned_addr learned my addr 172.21.15.45:0/1271722203 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f829b400640 1 --2- 172.21.15.45:0/1271722203 >> v2:172.21.15.169:3300/0 conn(0x7f82a406ef90 0x7f82a40b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a3e00640 1 --2- 172.21.15.45:0/1271722203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82a40cee50 0x7f82a40b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a8a00640 1 -- 172.21.15.45:0/1271722203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82a40cee50 msgr2=0x7f82a40b54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a8a00640 1 --2- 172.21.15.45:0/1271722203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82a40cee50 0x7f82a40b54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a8a00640 1 -- 172.21.15.45:0/1271722203 >> v2:172.21.15.169:3300/0 conn(0x7f82a406ef90 msgr2=0x7f82a40b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a8a00640 1 --2- 172.21.15.45:0/1271722203 >> v2:172.21.15.169:3300/0 conn(0x7f82a406ef90 0x7f82a40b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a8a00640 1 -- 172.21.15.45:0/1271722203 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a40b1cb0 con 0x7f82a40cf220 2024-08-17T02:25:11.933 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.931+0000 7f82a3e00640 1 --2- 172.21.15.45:0/1271722203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82a40cee50 0x7f82a40b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.932+0000 7f82a8a00640 1 --2- 172.21.15.45:0/1271722203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a40cf220 0x7f82a40b2eb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f82a4088aa0 tx=0x7f829c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd918bdce6bb659 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a3400640 1 -- 172.21.15.45:0/1271722203 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c031400 con 0x7f82a40cf220 2024-08-17T02:25:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a3400640 1 -- 172.21.15.45:0/1271722203 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f829c02d050 con 0x7f82a40cf220 2024-08-17T02:25:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a3400640 1 -- 172.21.15.45:0/1271722203 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c0317d0 con 0x7f82a40cf220 2024-08-17T02:25:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a9400640 1 -- 172.21.15.45:0/1271722203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a40cf220 msgr2=0x7f82a40b2eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a9400640 1 --2- 172.21.15.45:0/1271722203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a40cf220 0x7f82a40b2eb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f82a4088aa0 tx=0x7f829c009840 comp rx=0 tx=0).stop 2024-08-17T02:25:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a9400640 1 -- 172.21.15.45:0/1271722203 shutdown_connections 2024-08-17T02:25:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a9400640 1 --2- 172.21.15.45:0/1271722203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a40cf220 0x7f82a40b2eb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a9400640 1 --2- 172.21.15.45:0/1271722203 >> v2:172.21.15.169:3300/0 conn(0x7f82a406ef90 0x7f82a40b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a9400640 1 --2- 172.21.15.45:0/1271722203 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82a40cee50 0x7f82a40b54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a9400640 1 -- 172.21.15.45:0/1271722203 >> 172.21.15.45:0/1271722203 conn(0x7f82a406eb90 msgr2=0x7f82a40cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a9400640 1 -- 172.21.15.45:0/1271722203 shutdown_connections 2024-08-17T02:25:11.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.933+0000 7f82a9400640 1 -- 172.21.15.45:0/1271722203 wait complete. 2024-08-17T02:25:11.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.935+0000 7f82a9400640 1 Processor -- start 2024-08-17T02:25:11.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.935+0000 7f82a9400640 1 -- start start 2024-08-17T02:25:11.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f82a9400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82a406ef90 0x7f82a40ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f82a9400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a40cee50 0x7f82a4067a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f82a9400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82a40cf220 0x7f82a4159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f82a9400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40ad660 con 0x7f82a40cee50 2024-08-17T02:25:11.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f82a9400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40ad8b0 con 0x7f82a40cf220 2024-08-17T02:25:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f82a9400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a40adb90 con 0x7f82a406ef90 2024-08-17T02:25:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f829b400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a40cee50 0x7f82a4067a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f829b400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a40cee50 0x7f82a4067a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34202/0 (socket says 172.21.15.45:34202) 2024-08-17T02:25:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f829b400640 1 -- 172.21.15.45:0/252379295 learned_addr learned my addr 172.21.15.45:0/252379295 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f82a3e00640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82a406ef90 0x7f82a40ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f829b400640 1 -- 172.21.15.45:0/252379295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82a406ef90 msgr2=0x7f82a40ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f829b400640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82a406ef90 0x7f82a40ae650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f829b400640 1 -- 172.21.15.45:0/252379295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82a40cf220 msgr2=0x7f82a4159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f829b400640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82a40cf220 0x7f82a4159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.936+0000 7f829b400640 1 -- 172.21.15.45:0/252379295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c009ae0 con 0x7f82a40cee50 2024-08-17T02:25:11.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.937+0000 7f829b400640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a40cee50 0x7f82a4067a20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f828c00e8d0 tx=0x7f828c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.937+0000 7f829be00640 1 -- 172.21.15.45:0/252379295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00eec0 con 0x7f82a40cee50 2024-08-17T02:25:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.937+0000 7f829be00640 1 -- 172.21.15.45:0/252379295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828c00c8e0 con 0x7f82a40cee50 2024-08-17T02:25:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.937+0000 7f82a9400640 1 -- 172.21.15.45:0/252379295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a40ade70 con 0x7f82a40cee50 2024-08-17T02:25:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.937+0000 7f829be00640 1 -- 172.21.15.45:0/252379295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f828c00cc80 con 0x7f82a40cee50 2024-08-17T02:25:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.937+0000 7f82a9400640 1 -- 172.21.15.45:0/252379295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a4067f60 con 0x7f82a40cee50 2024-08-17T02:25:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.938+0000 7f82a9400640 1 -- 172.21.15.45:0/252379295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a4068240 con 0x7f82a40cee50 2024-08-17T02:25:11.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.939+0000 7f829be00640 1 -- 172.21.15.45:0/252379295 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f828c013680 con 0x7f82a40cee50 2024-08-17T02:25:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.940+0000 7f829be00640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8280065150 0x7f8280067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.940+0000 7f829be00640 1 -- 172.21.15.45:0/252379295 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f828c0820e0 con 0x7f82a40cee50 2024-08-17T02:25:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.940+0000 7f82a3e00640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8280065150 0x7f8280067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:11.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.940+0000 7f82a3e00640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8280065150 0x7f8280067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8294006e70 tx=0x7f8294008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:11.943+0000 7f829be00640 1 -- 172.21.15.45:0/252379295 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f828c050450 con 0x7f82a40cee50 2024-08-17T02:25:12.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.125+0000 7f82a9400640 1 -- 172.21.15.45:0/252379295 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f82a4071050 con 0x7f82a40cee50 2024-08-17T02:25:12.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.649+0000 7f829be00640 1 -- 172.21.15.45:0/252379295 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f828c053a70 con 0x7f82a40cee50 2024-08-17T02:25:12.650 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2024-08-17T02:25:12.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.652+0000 7f82a9400640 1 -- 172.21.15.45:0/252379295 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8280065150 msgr2=0x7f8280067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.652+0000 7f82a9400640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8280065150 0x7f8280067600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8294006e70 tx=0x7f8294008040 comp rx=0 tx=0).stop 2024-08-17T02:25:12.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.652+0000 7f82a9400640 1 -- 172.21.15.45:0/252379295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a40cee50 msgr2=0x7f82a4067a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.653+0000 7f82a9400640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a40cee50 0x7f82a4067a20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f828c00e8d0 tx=0x7f828c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.653+0000 7f82a9400640 1 -- 172.21.15.45:0/252379295 shutdown_connections 2024-08-17T02:25:12.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.653+0000 7f82a9400640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82a40cf220 0x7f82a4159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.653+0000 7f82a9400640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82a40cee50 0x7f82a4067a20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.653+0000 7f82a9400640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8280065150 0x7f8280067600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.653+0000 7f82a9400640 1 --2- 172.21.15.45:0/252379295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82a406ef90 0x7f82a40ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.653+0000 7f82a9400640 1 -- 172.21.15.45:0/252379295 >> 172.21.15.45:0/252379295 conn(0x7f82a406eb90 msgr2=0x7f82a40af450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:12.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.653+0000 7f82a9400640 1 -- 172.21.15.45:0/252379295 shutdown_connections 2024-08-17T02:25:12.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.654+0000 7f82a9400640 1 -- 172.21.15.45:0/252379295 wait complete. 2024-08-17T02:25:12.675 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:25:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.834+0000 7f2173e00640 1 Processor -- start 2024-08-17T02:25:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.834+0000 7f2173e00640 1 -- start start 2024-08-17T02:25:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.835+0000 7f2173e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21741510b0 0x7f21740af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.836+0000 7f2173e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21740aec80 con 0x7f21740ad4a0 2024-08-17T02:25:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.836+0000 7f2173e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21740cc6a0 con 0x7f2174157850 2024-08-17T02:25:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.836+0000 7f2173e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21740af650 con 0x7f21741510b0 2024-08-17T02:25:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.836+0000 7f2172a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f21741510b0 0x7f21740af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.836+0000 7f216be00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f21740ad4a0 0x7f2174157140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49130/0 (socket says 172.21.15.45:49130) 2024-08-17T02:25:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.836+0000 7f216be00640 1 -- 172.21.15.45:0/2372294384 learned_addr learned my addr 172.21.15.45:0/2372294384 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.836+0000 7f2172a00640 1 -- 172.21.15.45:0/2372294384 >> v1:172.21.15.169:6789/0 conn(0x7f2174157850 legacy=0x7f2174158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.836+0000 7f2172a00640 1 -- 172.21.15.45:0/2372294384 >> v1:172.21.15.45:6789/0 conn(0x7f21740ad4a0 legacy=0x7f2174157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.836+0000 7f2172a00640 1 -- 172.21.15.45:0/2372294384 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2174157d70 con 0x7f21741510b0 2024-08-17T02:25:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.837+0000 7f2172a00640 1 --2- 172.21.15.45:0/2372294384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21741510b0 0x7f21740af110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2164009850 tx=0x7f21640090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5ec519884146df9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.838+0000 7f2172000640 1 -- 172.21.15.45:0/2372294384 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216402ae20 con 0x7f21741510b0 2024-08-17T02:25:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.838+0000 7f2172000640 1 -- 172.21.15.45:0/2372294384 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2164032440 con 0x7f21741510b0 2024-08-17T02:25:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.838+0000 7f2172000640 1 -- 172.21.15.45:0/2372294384 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164032820 con 0x7f21741510b0 2024-08-17T02:25:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.838+0000 7f2173e00640 1 -- 172.21.15.45:0/2372294384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21741510b0 msgr2=0x7f21740af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.838+0000 7f2173e00640 1 --2- 172.21.15.45:0/2372294384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21741510b0 0x7f21740af110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2164009850 tx=0x7f21640090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.838+0000 7f2173e00640 1 -- 172.21.15.45:0/2372294384 shutdown_connections 2024-08-17T02:25:12.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.838+0000 7f2173e00640 1 --2- 172.21.15.45:0/2372294384 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21741510b0 0x7f21740af110 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.838+0000 7f2173e00640 1 -- 172.21.15.45:0/2372294384 >> 172.21.15.45:0/2372294384 conn(0x7f2174067750 msgr2=0x7f21740cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:12.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.838+0000 7f2173e00640 1 -- 172.21.15.45:0/2372294384 shutdown_connections 2024-08-17T02:25:12.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.838+0000 7f2173e00640 1 -- 172.21.15.45:0/2372294384 wait complete. 2024-08-17T02:25:12.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.840+0000 7f2173e00640 1 Processor -- start 2024-08-17T02:25:12.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.840+0000 7f2173e00640 1 -- start start 2024-08-17T02:25:12.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21740ad4a0 0x7f217416a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f21741510b0 0x7f2174169220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2174157850 0x7f21740ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2174169760 con 0x7f2174157850 2024-08-17T02:25:12.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217416a220 con 0x7f21740ad4a0 2024-08-17T02:25:12.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21740c8ea0 con 0x7f21741510b0 2024-08-17T02:25:12.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2174157850 0x7f21740ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2174157850 0x7f21740ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34220/0 (socket says 172.21.15.45:34220) 2024-08-17T02:25:12.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173400640 1 -- 172.21.15.45:0/3833931268 learned_addr learned my addr 172.21.15.45:0/3833931268 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:12.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2172a00640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21740ad4a0 0x7f217416a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f216be00640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f21741510b0 0x7f2174169220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173400640 1 -- 172.21.15.45:0/3833931268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f21741510b0 msgr2=0x7f2174169220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173400640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f21741510b0 0x7f2174169220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173400640 1 -- 172.21.15.45:0/3833931268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21740ad4a0 msgr2=0x7f217416a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173400640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21740ad4a0 0x7f217416a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.841+0000 7f2173400640 1 -- 172.21.15.45:0/3833931268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2164009390 con 0x7f2174157850 2024-08-17T02:25:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.842+0000 7f2173400640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2174157850 0x7f21740ac470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c7c0 tx=0x7f216c0015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.842+0000 7f216a000640 1 -- 172.21.15.45:0/3833931268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00a640 con 0x7f2174157850 2024-08-17T02:25:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.842+0000 7f216a000640 1 -- 172.21.15.45:0/3833931268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c00a7c0 con 0x7f2174157850 2024-08-17T02:25:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.842+0000 7f216a000640 1 -- 172.21.15.45:0/3833931268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00ab80 con 0x7f2174157850 2024-08-17T02:25:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.842+0000 7f2173e00640 1 -- 172.21.15.45:0/3833931268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21740ac9b0 con 0x7f2174157850 2024-08-17T02:25:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.842+0000 7f2173e00640 1 -- 172.21.15.45:0/3833931268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2174169c60 con 0x7f2174157850 2024-08-17T02:25:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.843+0000 7f2173e00640 1 -- 172.21.15.45:0/3833931268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21740c9030 con 0x7f2174157850 2024-08-17T02:25:12.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.844+0000 7f216a000640 1 -- 172.21.15.45:0/3833931268 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f216c003030 con 0x7f2174157850 2024-08-17T02:25:12.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.845+0000 7f216a000640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2150065150 0x7f2150067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:12.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.845+0000 7f216a000640 1 -- 172.21.15.45:0/3833931268 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f216c0820e0 con 0x7f2174157850 2024-08-17T02:25:12.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.845+0000 7f2172a00640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2150065150 0x7f2150067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:12.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.846+0000 7f2172a00640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2150065150 0x7f2150067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2164034000 tx=0x7f2164032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:12.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:12.850+0000 7f216a000640 1 -- 172.21.15.45:0/3833931268 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f216c050390 con 0x7f2174157850 2024-08-17T02:25:13.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.031+0000 7f2173e00640 1 -- 172.21.15.45:0/3833931268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2174071050 con 0x7f2174157850 2024-08-17T02:25:13.656 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2024-08-17T02:25:13.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.653+0000 7f216a000640 1 -- 172.21.15.45:0/3833931268 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f216c0539b0 con 0x7f2174157850 2024-08-17T02:25:13.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.658+0000 7f2173e00640 1 -- 172.21.15.45:0/3833931268 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2150065150 msgr2=0x7f2150067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.658+0000 7f2173e00640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2150065150 0x7f2150067600 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2164034000 tx=0x7f2164032000 comp rx=0 tx=0).stop 2024-08-17T02:25:13.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.658+0000 7f2173e00640 1 -- 172.21.15.45:0/3833931268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2174157850 msgr2=0x7f21740ac470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.658+0000 7f2173e00640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2174157850 0x7f21740ac470 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f216c00c7c0 tx=0x7f216c0015f0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.663+0000 7f2173e00640 1 -- 172.21.15.45:0/3833931268 shutdown_connections 2024-08-17T02:25:13.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.663+0000 7f2173e00640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2174157850 0x7f21740ac470 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.663+0000 7f2173e00640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2150065150 0x7f2150067600 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.663+0000 7f2173e00640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f21741510b0 0x7f2174169220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.663+0000 7f2173e00640 1 --2- 172.21.15.45:0/3833931268 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f21740ad4a0 0x7f217416a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.663+0000 7f2173e00640 1 -- 172.21.15.45:0/3833931268 >> 172.21.15.45:0/3833931268 conn(0x7f2174067750 msgr2=0x7f21740685c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:13.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.663+0000 7f2173e00640 1 -- 172.21.15.45:0/3833931268 shutdown_connections 2024-08-17T02:25:13.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.663+0000 7f2173e00640 1 -- 172.21.15.45:0/3833931268 wait complete. 2024-08-17T02:25:13.696 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:25:13.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:13.790 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.856+0000 7f88d4400640 1 Processor -- start 2024-08-17T02:25:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.856+0000 7f88d4400640 1 -- start start 2024-08-17T02:25:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.857+0000 7f88d4400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88cc158ea0 0x7f88cc0d0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.857+0000 7f88d4400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88cc0d09a0 0x7f88cc0ca2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.857+0000 7f88d4400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f88cc0ca830 0x7f88cc0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.857+0000 7f88d4400640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88cc0c6f20 con 0x7f88cc0d09a0 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.857+0000 7f88d4400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88cc0cacb0 con 0x7f88cc0ca830 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.857+0000 7f88d4400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc06f240 con 0x7f88cc158ea0 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.857+0000 7f88d1000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88cc0d09a0 0x7f88cc0ca2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.857+0000 7f88d1000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88cc0d09a0 0x7f88cc0ca2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34222/0 (socket says 172.21.15.45:34222) 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.857+0000 7f88d1000640 1 -- 172.21.15.45:0/3291936633 learned_addr learned my addr 172.21.15.45:0/3291936633 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.857+0000 7f88d1a00640 1 --2- 172.21.15.45:0/3291936633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88cc158ea0 0x7f88cc0d0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.857+0000 7f88d2400640 1 --2- 172.21.15.45:0/3291936633 >> v2:172.21.15.169:3300/0 conn(0x7f88cc0ca830 0x7f88cc0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.858+0000 7f88d1000640 1 -- 172.21.15.45:0/3291936633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88cc158ea0 msgr2=0x7f88cc0d0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.858+0000 7f88d1000640 1 --2- 172.21.15.45:0/3291936633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88cc158ea0 0x7f88cc0d0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.858+0000 7f88d1000640 1 -- 172.21.15.45:0/3291936633 >> v2:172.21.15.169:3300/0 conn(0x7f88cc0ca830 msgr2=0x7f88cc0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:13.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.858+0000 7f88d1000640 1 --2- 172.21.15.45:0/3291936633 >> v2:172.21.15.169:3300/0 conn(0x7f88cc0ca830 0x7f88cc0cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.858+0000 7f88d1000640 1 -- 172.21.15.45:0/3291936633 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc0cf410 con 0x7f88cc0d09a0 2024-08-17T02:25:13.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.859+0000 7f88d1000640 1 --2- 172.21.15.45:0/3291936633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88cc0d09a0 0x7f88cc0ca2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0895f0 tx=0x7f88b80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97fd0ad5ebb30b4e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.859+0000 7f88cbe00640 1 -- 172.21.15.45:0/3291936633 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b802ad40 con 0x7f88cc0d09a0 2024-08-17T02:25:13.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.859+0000 7f88cbe00640 1 -- 172.21.15.45:0/3291936633 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b8032440 con 0x7f88cc0d09a0 2024-08-17T02:25:13.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.859+0000 7f88cbe00640 1 -- 172.21.15.45:0/3291936633 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b802aea0 con 0x7f88cc0d09a0 2024-08-17T02:25:13.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.859+0000 7f88d4400640 1 -- 172.21.15.45:0/3291936633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88cc0d09a0 msgr2=0x7f88cc0ca2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.859+0000 7f88d4400640 1 --2- 172.21.15.45:0/3291936633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88cc0d09a0 0x7f88cc0ca2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f88cc0895f0 tx=0x7f88b80091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.860+0000 7f88d4400640 1 -- 172.21.15.45:0/3291936633 shutdown_connections 2024-08-17T02:25:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.860+0000 7f88d4400640 1 --2- 172.21.15.45:0/3291936633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88cc0d09a0 0x7f88cc0ca2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.860+0000 7f88d4400640 1 --2- 172.21.15.45:0/3291936633 >> v2:172.21.15.169:3300/0 conn(0x7f88cc0ca830 0x7f88cc0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.860+0000 7f88d4400640 1 --2- 172.21.15.45:0/3291936633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88cc158ea0 0x7f88cc0d0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.860+0000 7f88d4400640 1 -- 172.21.15.45:0/3291936633 >> 172.21.15.45:0/3291936633 conn(0x7f88cc06eb90 msgr2=0x7f88cc0cfd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.860+0000 7f88d4400640 1 -- 172.21.15.45:0/3291936633 shutdown_connections 2024-08-17T02:25:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.860+0000 7f88d4400640 1 -- 172.21.15.45:0/3291936633 wait complete. 2024-08-17T02:25:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.861+0000 7f88d4400640 1 Processor -- start 2024-08-17T02:25:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.861+0000 7f88d4400640 1 -- start start 2024-08-17T02:25:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.862+0000 7f88d4400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88cc0ca830 0x7f88cc155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.862+0000 7f88d4400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88cc0d09a0 0x7f88cc0b54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.862+0000 7f88d4400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88cc158ea0 0x7f88cc068880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.862+0000 7f88d4400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0b4e60 con 0x7f88cc0d09a0 2024-08-17T02:25:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.862+0000 7f88d4400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0c5080 con 0x7f88cc0ca830 2024-08-17T02:25:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.862+0000 7f88d4400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc0c4470 con 0x7f88cc158ea0 2024-08-17T02:25:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88d1a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88cc0ca830 0x7f88cc155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88d1a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88cc0ca830 0x7f88cc155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:48996/0 (socket says 172.21.15.45:48996) 2024-08-17T02:25:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88d1a00640 1 -- 172.21.15.45:0/1481690536 learned_addr learned my addr 172.21.15.45:0/1481690536 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88d1000640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88cc0d09a0 0x7f88cc0b54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88d2400640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88cc158ea0 0x7f88cc068880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88d1a00640 1 -- 172.21.15.45:0/1481690536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88cc158ea0 msgr2=0x7f88cc068880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88d1a00640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88cc158ea0 0x7f88cc068880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88d1a00640 1 -- 172.21.15.45:0/1481690536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88cc0d09a0 msgr2=0x7f88cc0b54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88d1a00640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88cc0d09a0 0x7f88cc0b54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88d1a00640 1 -- 172.21.15.45:0/1481690536 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8009450 con 0x7f88cc0ca830 2024-08-17T02:25:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88d1a00640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88cc0ca830 0x7f88cc155de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88c000ea20 tx=0x7f88c00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.863+0000 7f88c8c00640 1 -- 172.21.15.45:0/1481690536 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c000ca10 con 0x7f88cc0ca830 2024-08-17T02:25:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.864+0000 7f88c8c00640 1 -- 172.21.15.45:0/1481690536 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c000cb70 con 0x7f88cc0ca830 2024-08-17T02:25:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.864+0000 7f88c8c00640 1 -- 172.21.15.45:0/1481690536 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0013470 con 0x7f88cc0ca830 2024-08-17T02:25:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.864+0000 7f88d4400640 1 -- 172.21.15.45:0/1481690536 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88cc0c4750 con 0x7f88cc0ca830 2024-08-17T02:25:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.864+0000 7f88d4400640 1 -- 172.21.15.45:0/1481690536 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88cc0c4d90 con 0x7f88cc0ca830 2024-08-17T02:25:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.865+0000 7f88d4400640 1 -- 172.21.15.45:0/1481690536 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88cc071050 con 0x7f88cc0ca830 2024-08-17T02:25:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.866+0000 7f88c8c00640 1 -- 172.21.15.45:0/1481690536 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f88c0013860 con 0x7f88cc0ca830 2024-08-17T02:25:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.866+0000 7f88c8c00640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f88ac065150 0x7f88ac067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.866+0000 7f88c8c00640 1 -- 172.21.15.45:0/1481690536 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f88c0082770 con 0x7f88cc0ca830 2024-08-17T02:25:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.867+0000 7f88d1000640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f88ac065150 0x7f88ac067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.867+0000 7f88d1000640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f88ac065150 0x7f88ac067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f88b8034000 tx=0x7f88b8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:13.871+0000 7f88c8c00640 1 -- 172.21.15.45:0/1481690536 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f88c00508a0 con 0x7f88cc0ca830 2024-08-17T02:25:14.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.092+0000 7f88d4400640 1 -- 172.21.15.45:0/1481690536 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f88cc0cf600 con 0x7f88cc0ca830 2024-08-17T02:25:14.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.671+0000 7f88c8c00640 1 -- 172.21.15.45:0/1481690536 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f88c0053ec0 con 0x7f88cc0ca830 2024-08-17T02:25:14.672 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 2 and data pool 3 2024-08-17T02:25:14.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.675+0000 7f88d4400640 1 -- 172.21.15.45:0/1481690536 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f88ac065150 msgr2=0x7f88ac067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.675+0000 7f88d4400640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f88ac065150 0x7f88ac067600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f88b8034000 tx=0x7f88b8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:14.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.675+0000 7f88d4400640 1 -- 172.21.15.45:0/1481690536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88cc0ca830 msgr2=0x7f88cc155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.675+0000 7f88d4400640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88cc0ca830 0x7f88cc155de0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f88c000ea20 tx=0x7f88c00090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.675+0000 7f88d4400640 1 -- 172.21.15.45:0/1481690536 shutdown_connections 2024-08-17T02:25:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.675+0000 7f88d4400640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f88ac065150 0x7f88ac067600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.675+0000 7f88d4400640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f88cc158ea0 0x7f88cc068880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.675+0000 7f88d4400640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88cc0d09a0 0x7f88cc0b54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.675+0000 7f88d4400640 1 --2- 172.21.15.45:0/1481690536 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f88cc0ca830 0x7f88cc155de0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.675+0000 7f88d4400640 1 -- 172.21.15.45:0/1481690536 >> 172.21.15.45:0/1481690536 conn(0x7f88cc06eb90 msgr2=0x7f88cc0674d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.676+0000 7f88d4400640 1 -- 172.21.15.45:0/1481690536 shutdown_connections 2024-08-17T02:25:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.677+0000 7f88d4400640 1 -- 172.21.15.45:0/1481690536 wait complete. 2024-08-17T02:25:14.703 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:14.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.853+0000 7f6f6ec00640 1 Processor -- start 2024-08-17T02:25:14.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.854+0000 7f6f6ec00640 1 -- start start 2024-08-17T02:25:14.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.855+0000 7f6f6ec00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6f68069710 0x7f6f680ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.855+0000 7f6f6ec00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f680aec20 con 0x7f6f68158bd0 2024-08-17T02:25:14.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.855+0000 7f6f6ec00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f680ae330 con 0x7f6f680ac540 2024-08-17T02:25:14.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.855+0000 7f6f6ec00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f680acd30 con 0x7f6f68069710 2024-08-17T02:25:14.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.855+0000 7f6f6d800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f68158bd0 0x7f6f68069000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49144/0 (socket says 172.21.15.45:49144) 2024-08-17T02:25:14.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.855+0000 7f6f6d800640 1 -- 172.21.15.45:0/568813108 learned_addr learned my addr 172.21.15.45:0/568813108 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:14.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.855+0000 7f6f6ce00640 1 --2- 172.21.15.45:0/568813108 >> v2:172.21.15.169:3300/0 conn(0x7f6f68069710 0x7f6f680ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.855+0000 7f6f67e00640 1 -- 172.21.15.45:0/568813108 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817682996 0 0) 0x7f6f680aec20 con 0x7f6f68158bd0 2024-08-17T02:25:14.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.856+0000 7f6f67e00640 1 -- 172.21.15.45:0/568813108 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f500034e0 con 0x7f6f68158bd0 2024-08-17T02:25:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.856+0000 7f6f67e00640 1 -- 172.21.15.45:0/568813108 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1258250808 0 0) 0x7f6f680ae330 con 0x7f6f680ac540 2024-08-17T02:25:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.856+0000 7f6f67e00640 1 -- 172.21.15.45:0/568813108 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f680aec20 con 0x7f6f680ac540 2024-08-17T02:25:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.856+0000 7f6f6ce00640 1 -- 172.21.15.45:0/568813108 >> v1:172.21.15.169:6789/0 conn(0x7f6f680ac540 legacy=0x7f6f680af0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.856+0000 7f6f6ce00640 1 -- 172.21.15.45:0/568813108 >> v1:172.21.15.45:6789/0 conn(0x7f6f68158bd0 legacy=0x7f6f68069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.856+0000 7f6f6ce00640 1 -- 172.21.15.45:0/568813108 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f680ae5d0 con 0x7f6f68069710 2024-08-17T02:25:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.857+0000 7f6f6ce00640 1 --2- 172.21.15.45:0/568813108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f68069710 0x7f6f680ac000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009850 tx=0x7f6f540090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2093b294ff15897 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.857+0000 7f6f67e00640 1 -- 172.21.15.45:0/568813108 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5402ad00 con 0x7f6f68069710 2024-08-17T02:25:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.857+0000 7f6f67e00640 1 -- 172.21.15.45:0/568813108 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5402ae60 con 0x7f6f68069710 2024-08-17T02:25:14.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.857+0000 7f6f67e00640 1 -- 172.21.15.45:0/568813108 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f54032670 con 0x7f6f68069710 2024-08-17T02:25:14.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.857+0000 7f6f6ec00640 1 -- 172.21.15.45:0/568813108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f68069710 msgr2=0x7f6f680ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.857+0000 7f6f6ec00640 1 --2- 172.21.15.45:0/568813108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f68069710 0x7f6f680ac000 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009850 tx=0x7f6f540090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.858+0000 7f6f6ec00640 1 -- 172.21.15.45:0/568813108 shutdown_connections 2024-08-17T02:25:14.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.858+0000 7f6f6ec00640 1 --2- 172.21.15.45:0/568813108 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f68069710 0x7f6f680ac000 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.858+0000 7f6f6ec00640 1 -- 172.21.15.45:0/568813108 >> 172.21.15.45:0/568813108 conn(0x7f6f68096a70 msgr2=0x7f6f680cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:14.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.858+0000 7f6f6ec00640 1 -- 172.21.15.45:0/568813108 shutdown_connections 2024-08-17T02:25:14.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.858+0000 7f6f6ec00640 1 -- 172.21.15.45:0/568813108 wait complete. 2024-08-17T02:25:14.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.859+0000 7f6f6ec00640 1 Processor -- start 2024-08-17T02:25:14.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.859+0000 7f6f6ec00640 1 -- start start 2024-08-17T02:25:14.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.860+0000 7f6f6ec00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f68069710 0x7f6f680c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.860+0000 7f6f6ec00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f680ac540 0x7f6f68152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.860+0000 7f6f6ec00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f68158bd0 0x7f6f680b1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.860+0000 7f6f6ec00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680c9960 con 0x7f6f680ac540 2024-08-17T02:25:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.860+0000 7f6f6ec00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680ccaa0 con 0x7f6f68158bd0 2024-08-17T02:25:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.860+0000 7f6f6ec00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f680ccd80 con 0x7f6f68069710 2024-08-17T02:25:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.860+0000 7f6f6ce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f680ac540 0x7f6f68152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.860+0000 7f6f6ce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f680ac540 0x7f6f68152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34228/0 (socket says 172.21.15.45:34228) 2024-08-17T02:25:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.860+0000 7f6f6ce00640 1 -- 172.21.15.45:0/2112034951 learned_addr learned my addr 172.21.15.45:0/2112034951 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.860+0000 7f6f6d800640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f68069710 0x7f6f680c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.861+0000 7f6f6e200640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f68158bd0 0x7f6f680b1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.861+0000 7f6f6ce00640 1 -- 172.21.15.45:0/2112034951 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f68069710 msgr2=0x7f6f680c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.861+0000 7f6f6ce00640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f68069710 0x7f6f680c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.861+0000 7f6f6ce00640 1 -- 172.21.15.45:0/2112034951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f68158bd0 msgr2=0x7f6f680b1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.861+0000 7f6f6ce00640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f68158bd0 0x7f6f680b1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.861+0000 7f6f6ce00640 1 -- 172.21.15.45:0/2112034951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f54009390 con 0x7f6f680ac540 2024-08-17T02:25:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.861+0000 7f6f6ce00640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f680ac540 0x7f6f68152ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009360 tx=0x7f6f54032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.861+0000 7f6f64c00640 1 -- 172.21.15.45:0/2112034951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5403b6e0 con 0x7f6f680ac540 2024-08-17T02:25:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.861+0000 7f6f64c00640 1 -- 172.21.15.45:0/2112034951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5403b840 con 0x7f6f680ac540 2024-08-17T02:25:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.861+0000 7f6f64c00640 1 -- 172.21.15.45:0/2112034951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5403bbe0 con 0x7f6f680ac540 2024-08-17T02:25:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.861+0000 7f6f6ec00640 1 -- 172.21.15.45:0/2112034951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f680cd060 con 0x7f6f680ac540 2024-08-17T02:25:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.862+0000 7f6f6ec00640 1 -- 172.21.15.45:0/2112034951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f680cd620 con 0x7f6f680ac540 2024-08-17T02:25:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.863+0000 7f6f6ec00640 1 -- 172.21.15.45:0/2112034951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f680ccec0 con 0x7f6f680ac540 2024-08-17T02:25:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.864+0000 7f6f64c00640 1 -- 172.21.15.45:0/2112034951 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6f54043030 con 0x7f6f680ac540 2024-08-17T02:25:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.864+0000 7f6f64c00640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f48065150 0x7f6f48067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.864+0000 7f6f64c00640 1 -- 172.21.15.45:0/2112034951 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6f54041070 con 0x7f6f680ac540 2024-08-17T02:25:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.865+0000 7f6f6d800640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f48065150 0x7f6f48067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:14.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.865+0000 7f6f6d800640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f48065150 0x7f6f48067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c005840 tx=0x7f6f5c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:14.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:14.869+0000 7f6f64c00640 1 -- 172.21.15.45:0/2112034951 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6f680ccec0 con 0x7f6f680ac540 2024-08-17T02:25:15.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.052+0000 7f6f6ec00640 1 -- 172.21.15.45:0/2112034951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f680c6ae0 con 0x7f6f680ac540 2024-08-17T02:25:15.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.053+0000 7f6f64c00640 1 -- 172.21.15.45:0/2112034951 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f6f680c6ae0 con 0x7f6f680ac540 2024-08-17T02:25:15.054 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:15.054 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":19,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:14.094716+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.054+0000 7f6f6ec00640 1 -- 172.21.15.45:0/2112034951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f48065150 msgr2=0x7f6f48067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.055+0000 7f6f6ec00640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f48065150 0x7f6f48067600 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c005840 tx=0x7f6f5c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.055+0000 7f6f6ec00640 1 -- 172.21.15.45:0/2112034951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f680ac540 msgr2=0x7f6f68152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.055+0000 7f6f6ec00640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f680ac540 0x7f6f68152ff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6f54009360 tx=0x7f6f54032000 comp rx=0 tx=0).stop 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.055+0000 7f6f6ec00640 1 -- 172.21.15.45:0/2112034951 shutdown_connections 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.055+0000 7f6f6ec00640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f68158bd0 0x7f6f680b1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.055+0000 7f6f6ec00640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f680ac540 0x7f6f68152ff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.055+0000 7f6f6ec00640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f48065150 0x7f6f48067600 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.055+0000 7f6f6ec00640 1 --2- 172.21.15.45:0/2112034951 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f68069710 0x7f6f680c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.055+0000 7f6f6ec00640 1 -- 172.21.15.45:0/2112034951 >> 172.21.15.45:0/2112034951 conn(0x7f6f68096a70 msgr2=0x7f6f680ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.055+0000 7f6f6ec00640 1 -- 172.21.15.45:0/2112034951 shutdown_connections 2024-08-17T02:25:15.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.055+0000 7f6f6ec00640 1 -- 172.21.15.45:0/2112034951 wait complete. 2024-08-17T02:25:15.071 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:15.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.221+0000 7f436d800640 1 Processor -- start 2024-08-17T02:25:15.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.222+0000 7f436d800640 1 -- start start 2024-08-17T02:25:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.223+0000 7f436d800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4368159ca0 0x7f43680ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.223+0000 7f436d800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f43680ca8a0 0x7f43680cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.223+0000 7f436d800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43680ccf30 con 0x7f43680ccad0 2024-08-17T02:25:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.223+0000 7f436d800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680cd6e0 con 0x7f4368159ca0 2024-08-17T02:25:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.223+0000 7f436d800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680cadc0 con 0x7f43680ca8a0 2024-08-17T02:25:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.223+0000 7f4367e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4368159ca0 0x7f43680ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.223+0000 7f436ce00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f43680ccad0 0x7f43680cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49152/0 (socket says 172.21.15.45:49152) 2024-08-17T02:25:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.223+0000 7f436ce00640 1 -- 172.21.15.45:0/2067889677 learned_addr learned my addr 172.21.15.45:0/2067889677 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:15.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.223+0000 7f4367400640 1 --2- 172.21.15.45:0/2067889677 >> v2:172.21.15.169:3300/0 conn(0x7f43680ca8a0 0x7f43680cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.223+0000 7f4367e00640 1 -- 172.21.15.45:0/2067889677 >> v2:172.21.15.169:3300/0 conn(0x7f43680ca8a0 msgr2=0x7f43680cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.224+0000 7f4367e00640 1 --2- 172.21.15.45:0/2067889677 >> v2:172.21.15.169:3300/0 conn(0x7f43680ca8a0 0x7f43680cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.224+0000 7f4367e00640 1 -- 172.21.15.45:0/2067889677 >> v1:172.21.15.45:6789/0 conn(0x7f43680ccad0 legacy=0x7f43680cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.224+0000 7f4367e00640 1 -- 172.21.15.45:0/2067889677 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680cb060 con 0x7f4368159ca0 2024-08-17T02:25:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.224+0000 7f4366a00640 1 -- 172.21.15.45:0/2067889677 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507343117 0 0) 0x7f43680ccf30 con 0x7f43680ccad0 2024-08-17T02:25:15.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.225+0000 7f4367e00640 1 --2- 172.21.15.45:0/2067889677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4368159ca0 0x7f43680ca360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f436808a060 tx=0x7f43580090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89ee0c68af2b68bb server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.225+0000 7f4366a00640 1 -- 172.21.15.45:0/2067889677 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435802adb0 con 0x7f4368159ca0 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.225+0000 7f4366a00640 1 -- 172.21.15.45:0/2067889677 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4358032440 con 0x7f4368159ca0 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.225+0000 7f4366a00640 1 -- 172.21.15.45:0/2067889677 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43580327e0 con 0x7f4368159ca0 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.225+0000 7f436d800640 1 -- 172.21.15.45:0/2067889677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4368159ca0 msgr2=0x7f43680ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.225+0000 7f436d800640 1 --2- 172.21.15.45:0/2067889677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4368159ca0 0x7f43680ca360 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f436808a060 tx=0x7f43580090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.225+0000 7f436d800640 1 -- 172.21.15.45:0/2067889677 shutdown_connections 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.225+0000 7f436d800640 1 --2- 172.21.15.45:0/2067889677 >> v2:172.21.15.169:3300/0 conn(0x7f43680ca8a0 0x7f43680cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.225+0000 7f436d800640 1 --2- 172.21.15.45:0/2067889677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4368159ca0 0x7f43680ca360 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.225+0000 7f436d800640 1 -- 172.21.15.45:0/2067889677 >> 172.21.15.45:0/2067889677 conn(0x7f4368098e00 msgr2=0x7f436806eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.226+0000 7f436d800640 1 -- 172.21.15.45:0/2067889677 shutdown_connections 2024-08-17T02:25:15.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.226+0000 7f436d800640 1 -- 172.21.15.45:0/2067889677 wait complete. 2024-08-17T02:25:15.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.227+0000 7f436d800640 1 Processor -- start 2024-08-17T02:25:15.228 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.227+0000 7f436d800640 1 -- start start 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.228+0000 7f436d800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43680ca8a0 0x7f43680c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.228+0000 7f436d800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43680ccad0 0x7f436815c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.228+0000 7f436d800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4368159ca0 0x7f4368155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.228+0000 7f436d800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680b47c0 con 0x7f4368159ca0 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.228+0000 7f436d800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680c4cb0 con 0x7f43680ccad0 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.228+0000 7f436d800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43680b3eb0 con 0x7f43680ca8a0 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.228+0000 7f436ce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4368159ca0 0x7f4368155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.228+0000 7f4367e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43680ca8a0 0x7f43680c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.228+0000 7f436ce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4368159ca0 0x7f4368155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34256/0 (socket says 172.21.15.45:34256) 2024-08-17T02:25:15.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.228+0000 7f436ce00640 1 -- 172.21.15.45:0/2833150186 learned_addr learned my addr 172.21.15.45:0/2833150186 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:15.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.228+0000 7f4367400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43680ccad0 0x7f436815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.229+0000 7f436ce00640 1 -- 172.21.15.45:0/2833150186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43680ca8a0 msgr2=0x7f43680c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.229+0000 7f436ce00640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43680ca8a0 0x7f43680c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.229+0000 7f436ce00640 1 -- 172.21.15.45:0/2833150186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43680ccad0 msgr2=0x7f436815c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.229+0000 7f436ce00640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43680ccad0 0x7f436815c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.229+0000 7f436ce00640 1 -- 172.21.15.45:0/2833150186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4358009390 con 0x7f4368159ca0 2024-08-17T02:25:15.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.229+0000 7f436ce00640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4368159ca0 0x7f4368155180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f436000ccc0 tx=0x7f4360001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.229+0000 7f435f400640 1 -- 172.21.15.45:0/2833150186 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436000ce80 con 0x7f4368159ca0 2024-08-17T02:25:15.231 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.229+0000 7f435f400640 1 -- 172.21.15.45:0/2833150186 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f436000a850 con 0x7f4368159ca0 2024-08-17T02:25:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.229+0000 7f436d800640 1 -- 172.21.15.45:0/2833150186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43680b4170 con 0x7f4368159ca0 2024-08-17T02:25:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.229+0000 7f435f400640 1 -- 172.21.15.45:0/2833150186 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f436000ac50 con 0x7f4368159ca0 2024-08-17T02:25:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.229+0000 7f436d800640 1 -- 172.21.15.45:0/2833150186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43680c6630 con 0x7f4368159ca0 2024-08-17T02:25:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.230+0000 7f436d800640 1 -- 172.21.15.45:0/2833150186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43680b4970 con 0x7f4368159ca0 2024-08-17T02:25:15.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.231+0000 7f435f400640 1 -- 172.21.15.45:0/2833150186 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4360007300 con 0x7f4368159ca0 2024-08-17T02:25:15.233 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.232+0000 7f435f400640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4348065150 0x7f4348067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.232+0000 7f435f400640 1 -- 172.21.15.45:0/2833150186 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4360082570 con 0x7f4368159ca0 2024-08-17T02:25:15.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.232+0000 7f4367e00640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4348065150 0x7f4348067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.233+0000 7f4367e00640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4348065150 0x7f4348067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4358034000 tx=0x7f4358032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.236+0000 7f435f400640 1 -- 172.21.15.45:0/2833150186 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f43680b4970 con 0x7f4368159ca0 2024-08-17T02:25:15.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.419+0000 7f436d800640 1 -- 172.21.15.45:0/2833150186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4368071050 con 0x7f4368159ca0 2024-08-17T02:25:15.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.420+0000 7f435f400640 1 -- 172.21.15.45:0/2833150186 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f4360050630 con 0x7f4368159ca0 2024-08-17T02:25:15.421 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:15.421 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":19,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:14.094716+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:15.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.422+0000 7f436d800640 1 -- 172.21.15.45:0/2833150186 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4348065150 msgr2=0x7f4348067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.422+0000 7f436d800640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4348065150 0x7f4348067600 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4358034000 tx=0x7f4358032000 comp rx=0 tx=0).stop 2024-08-17T02:25:15.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.422+0000 7f436d800640 1 -- 172.21.15.45:0/2833150186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4368159ca0 msgr2=0x7f4368155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.422+0000 7f436d800640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4368159ca0 0x7f4368155180 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f436000ccc0 tx=0x7f4360001a00 comp rx=0 tx=0).stop 2024-08-17T02:25:15.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.422+0000 7f436d800640 1 -- 172.21.15.45:0/2833150186 shutdown_connections 2024-08-17T02:25:15.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.422+0000 7f436d800640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4368159ca0 0x7f4368155180 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.422+0000 7f436d800640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f43680ccad0 0x7f436815c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.422+0000 7f436d800640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4348065150 0x7f4348067600 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.422+0000 7f436d800640 1 --2- 172.21.15.45:0/2833150186 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f43680ca8a0 0x7f43680c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.422+0000 7f436d800640 1 -- 172.21.15.45:0/2833150186 >> 172.21.15.45:0/2833150186 conn(0x7f4368098e00 msgr2=0x7f4368158720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.423+0000 7f436d800640 1 -- 172.21.15.45:0/2833150186 shutdown_connections 2024-08-17T02:25:15.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.423+0000 7f436d800640 1 -- 172.21.15.45:0/2833150186 wait complete. 2024-08-17T02:25:15.439 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:25:15.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.592+0000 7f4aaca00640 1 Processor -- start 2024-08-17T02:25:15.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.592+0000 7f4aaca00640 1 -- start start 2024-08-17T02:25:15.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.593+0000 7f4aaca00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4aa815be50 0x7f4aa80ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.593+0000 7f4aaca00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa806d4a0 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.593+0000 7f4aaca00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa806c890 con 0x7f4aa80aec90 2024-08-17T02:25:15.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.593+0000 7f4aaca00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa80b05b0 con 0x7f4aa815be50 2024-08-17T02:25:15.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.594+0000 7f4aa7200640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4aa80aaeb0 0x7f4aa806d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49168/0 (socket says 172.21.15.45:49168) 2024-08-17T02:25:15.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.594+0000 7f4aa7200640 1 -- 172.21.15.45:0/4179177705 learned_addr learned my addr 172.21.15.45:0/4179177705 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:15.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.594+0000 7f4aa6800640 1 --2- 172.21.15.45:0/4179177705 >> v2:172.21.15.169:3300/0 conn(0x7f4aa815be50 0x7f4aa80ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.594+0000 7f4aa5400640 1 -- 172.21.15.45:0/4179177705 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2766204538 0 0) 0x7f4aa806d4a0 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.594+0000 7f4aa5400640 1 -- 172.21.15.45:0/4179177705 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a8c0034e0 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.594+0000 7f4aa6800640 1 -- 172.21.15.45:0/4179177705 >> v1:172.21.15.169:6789/0 conn(0x7f4aa80aec90 legacy=0x7f4aa80aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.594+0000 7f4aa6800640 1 -- 172.21.15.45:0/4179177705 >> v1:172.21.15.45:6789/0 conn(0x7f4aa80aaeb0 legacy=0x7f4aa806d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.594+0000 7f4aa5400640 1 -- 172.21.15.45:0/4179177705 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 502158780 0 0) 0x7f4a8c0034e0 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.594+0000 7f4aa6800640 1 -- 172.21.15.45:0/4179177705 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa806cb70 con 0x7f4aa815be50 2024-08-17T02:25:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.595+0000 7f4aa6800640 1 --2- 172.21.15.45:0/4179177705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa815be50 0x7f4aa80ae750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009880 tx=0x7f4a980090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f94573e01862f093 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.596+0000 7f4aa5400640 1 -- 172.21.15.45:0/4179177705 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa00017f0 con 0x7f4aa815be50 2024-08-17T02:25:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.596+0000 7f4aa5400640 1 -- 172.21.15.45:0/4179177705 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9802ab20 con 0x7f4aa815be50 2024-08-17T02:25:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.596+0000 7f4aa5400640 1 -- 172.21.15.45:0/4179177705 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98032440 con 0x7f4aa815be50 2024-08-17T02:25:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.596+0000 7f4aaca00640 1 -- 172.21.15.45:0/4179177705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa815be50 msgr2=0x7f4aa80ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.596+0000 7f4aaca00640 1 --2- 172.21.15.45:0/4179177705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa815be50 0x7f4aa80ae750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009880 tx=0x7f4a980090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.596+0000 7f4aaca00640 1 -- 172.21.15.45:0/4179177705 shutdown_connections 2024-08-17T02:25:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.596+0000 7f4aaca00640 1 --2- 172.21.15.45:0/4179177705 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa815be50 0x7f4aa80ae750 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.596+0000 7f4aaca00640 1 -- 172.21.15.45:0/4179177705 >> 172.21.15.45:0/4179177705 conn(0x7f4aa8066cd0 msgr2=0x7f4aa80670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.596+0000 7f4aaca00640 1 -- 172.21.15.45:0/4179177705 shutdown_connections 2024-08-17T02:25:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.596+0000 7f4aaca00640 1 -- 172.21.15.45:0/4179177705 wait complete. 2024-08-17T02:25:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.598+0000 7f4aaca00640 1 Processor -- start 2024-08-17T02:25:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.598+0000 7f4aaca00640 1 -- start start 2024-08-17T02:25:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.599+0000 7f4aaca00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aa80aaeb0 0x7f4aa8150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.599+0000 7f4aaca00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80aec90 0x7f4aa8150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.599+0000 7f4aaca00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4aa815be50 0x7f4aa8168e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.599+0000 7f4aaca00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa813ef80 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.599+0000 7f4aaca00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa815ac70 con 0x7f4aa80aec90 2024-08-17T02:25:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.599+0000 7f4aaca00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa8151a70 con 0x7f4aa815be50 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.599+0000 7f4aa6800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aa80aaeb0 0x7f4aa8150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.599+0000 7f4aa6800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aa80aaeb0 0x7f4aa8150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34268/0 (socket says 172.21.15.45:34268) 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.599+0000 7f4aa6800640 1 -- 172.21.15.45:0/589276468 learned_addr learned my addr 172.21.15.45:0/589276468 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.599+0000 7f4aa5e00640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80aec90 0x7f4aa8150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.599+0000 7f4aa7200640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4aa815be50 0x7f4aa8168e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.600+0000 7f4aa6800640 1 -- 172.21.15.45:0/589276468 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4aa815be50 msgr2=0x7f4aa8168e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.600+0000 7f4aa6800640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4aa815be50 0x7f4aa8168e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.600+0000 7f4aa6800640 1 -- 172.21.15.45:0/589276468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80aec90 msgr2=0x7f4aa8150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.600+0000 7f4aa6800640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80aec90 0x7f4aa8150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.600+0000 7f4aa6800640 1 -- 172.21.15.45:0/589276468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a98009390 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.600+0000 7f4aa6800640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aa80aaeb0 0x7f4aa8150740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009880 tx=0x7f4a98032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.600+0000 7f4a9e000640 1 -- 172.21.15.45:0/589276468 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98031800 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.600+0000 7f4a9e000640 1 -- 172.21.15.45:0/589276468 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a98031960 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.600+0000 7f4aaca00640 1 -- 172.21.15.45:0/589276468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa8169f70 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.600+0000 7f4a9e000640 1 -- 172.21.15.45:0/589276468 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98031d20 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.600+0000 7f4aaca00640 1 -- 172.21.15.45:0/589276468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa8151790 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.601+0000 7f4aaca00640 1 -- 172.21.15.45:0/589276468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa8071050 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.602+0000 7f4a9e000640 1 -- 172.21.15.45:0/589276468 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4a98043030 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.603+0000 7f4a9e000640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a88065150 0x7f4a88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.603+0000 7f4a9e000640 1 -- 172.21.15.45:0/589276468 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a98041070 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.603+0000 7f4aa5e00640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a88065150 0x7f4a88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.604+0000 7f4aa5e00640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a88065150 0x7f4a88067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4aa80cac20 tx=0x7f4a94007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:15.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.607+0000 7f4a9e000640 1 -- 172.21.15.45:0/589276468 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4a98070ba0 con 0x7f4aa80aaeb0 2024-08-17T02:25:15.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:15.830+0000 7f4aaca00640 1 -- 172.21.15.45:0/589276468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4aa80aa4f0 con 0x7f4aa80aaeb0 2024-08-17T02:25:16.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.687+0000 7f4a9e000640 1 -- 172.21.15.45:0/589276468 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4a980370b0 con 0x7f4aa80aaeb0 2024-08-17T02:25:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 -- 172.21.15.45:0/589276468 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a88065150 msgr2=0x7f4a88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a88065150 0x7f4a88067600 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4aa80cac20 tx=0x7f4a94007e30 comp rx=0 tx=0).stop 2024-08-17T02:25:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 -- 172.21.15.45:0/589276468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aa80aaeb0 msgr2=0x7f4aa8150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aa80aaeb0 0x7f4aa8150740 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009880 tx=0x7f4a98032000 comp rx=0 tx=0).stop 2024-08-17T02:25:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 -- 172.21.15.45:0/589276468 shutdown_connections 2024-08-17T02:25:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a88065150 0x7f4a88067600 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4aa815be50 0x7f4aa8168e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4aa80aec90 0x7f4aa8150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 --2- 172.21.15.45:0/589276468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4aa80aaeb0 0x7f4aa8150740 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 -- 172.21.15.45:0/589276468 >> 172.21.15.45:0/589276468 conn(0x7f4aa8066cd0 msgr2=0x7f4aa80a98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 -- 172.21.15.45:0/589276468 shutdown_connections 2024-08-17T02:25:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.690+0000 7f4aaca00640 1 -- 172.21.15.45:0/589276468 wait complete. 2024-08-17T02:25:16.708 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:25:16.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.866+0000 7f3498600640 1 Processor -- start 2024-08-17T02:25:16.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.866+0000 7f3498600640 1 -- start start 2024-08-17T02:25:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.867+0000 7f3498600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34900adcf0 0x7f34900ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.867+0000 7f3498600640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34900ab130 con 0x7f3490156c50 2024-08-17T02:25:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.867+0000 7f3498600640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34900ae5a0 con 0x7f34900abb00 2024-08-17T02:25:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.867+0000 7f3498600640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34900ae2c0 con 0x7f34900adcf0 2024-08-17T02:25:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.868+0000 7f3495c00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3490156c50 0x7f34900c7cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49174/0 (socket says 172.21.15.45:49174) 2024-08-17T02:25:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.868+0000 7f3495200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34900adcf0 0x7f34900ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.868+0000 7f3495c00640 1 -- 172.21.15.45:0/3837657945 learned_addr learned my addr 172.21.15.45:0/3837657945 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.868+0000 7f3495200640 1 -- 172.21.15.45:0/3837657945 >> v1:172.21.15.169:6789/0 conn(0x7f34900abb00 legacy=0x7f34900c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.868+0000 7f3495200640 1 -- 172.21.15.45:0/3837657945 >> v1:172.21.15.45:6789/0 conn(0x7f3490156c50 legacy=0x7f34900c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.868+0000 7f3495200640 1 -- 172.21.15.45:0/3837657945 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34900aaae0 con 0x7f34900adcf0 2024-08-17T02:25:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.868+0000 7f348fe00640 1 -- 172.21.15.45:0/3837657945 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459457205 0 0) 0x7f34900ab130 con 0x7f3490156c50 2024-08-17T02:25:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.869+0000 7f3495200640 1 --2- 172.21.15.45:0/3837657945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34900adcf0 0x7f34900ab5c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f347c009850 tx=0x7f347c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7513740cccad75 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.869+0000 7f348fe00640 1 -- 172.21.15.45:0/3837657945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c02ad00 con 0x7f34900adcf0 2024-08-17T02:25:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.869+0000 7f348fe00640 1 -- 172.21.15.45:0/3837657945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c02ae60 con 0x7f34900adcf0 2024-08-17T02:25:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.869+0000 7f348fe00640 1 -- 172.21.15.45:0/3837657945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c032670 con 0x7f34900adcf0 2024-08-17T02:25:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.870+0000 7f3498600640 1 -- 172.21.15.45:0/3837657945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34900adcf0 msgr2=0x7f34900ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.870+0000 7f3498600640 1 --2- 172.21.15.45:0/3837657945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34900adcf0 0x7f34900ab5c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f347c009850 tx=0x7f347c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.870+0000 7f3498600640 1 -- 172.21.15.45:0/3837657945 shutdown_connections 2024-08-17T02:25:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.870+0000 7f3498600640 1 --2- 172.21.15.45:0/3837657945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34900adcf0 0x7f34900ab5c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.870+0000 7f3498600640 1 -- 172.21.15.45:0/3837657945 >> 172.21.15.45:0/3837657945 conn(0x7f3490067750 msgr2=0x7f34900c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:16.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.870+0000 7f3498600640 1 -- 172.21.15.45:0/3837657945 shutdown_connections 2024-08-17T02:25:16.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.870+0000 7f3498600640 1 -- 172.21.15.45:0/3837657945 wait complete. 2024-08-17T02:25:16.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.872+0000 7f3498600640 1 Processor -- start 2024-08-17T02:25:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.872+0000 7f3498600640 1 -- start start 2024-08-17T02:25:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.873+0000 7f3498600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34900abb00 0x7f34900a6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.873+0000 7f3498600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34900adcf0 0x7f3490151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.873+0000 7f3498600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3490156c50 0x7f3490155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.873+0000 7f3498600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3490155730 con 0x7f3490156c50 2024-08-17T02:25:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.873+0000 7f3498600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3490156100 con 0x7f34900abb00 2024-08-17T02:25:16.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.873+0000 7f3498600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34900a69d0 con 0x7f34900adcf0 2024-08-17T02:25:16.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.873+0000 7f3496600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3490156c50 0x7f3490155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.873+0000 7f3495200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34900adcf0 0x7f3490151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.873+0000 7f3495c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34900abb00 0x7f34900a6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.873+0000 7f3495200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34900adcf0 0x7f3490151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:47418/0 (socket says 172.21.15.45:47418) 2024-08-17T02:25:16.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.873+0000 7f3495200640 1 -- 172.21.15.45:0/3734985464 learned_addr learned my addr 172.21.15.45:0/3734985464 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:16.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f3496600640 1 -- 172.21.15.45:0/3734985464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34900adcf0 msgr2=0x7f3490151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f3496600640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34900adcf0 0x7f3490151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f3496600640 1 -- 172.21.15.45:0/3734985464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34900abb00 msgr2=0x7f34900a6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:16.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f3496600640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34900abb00 0x7f34900a6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f3496600640 1 -- 172.21.15.45:0/3734985464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c009390 con 0x7f3490156c50 2024-08-17T02:25:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f3495c00640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34900abb00 0x7f34900a6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f3495200640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34900adcf0 0x7f3490151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f3496600640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3490156c50 0x7f3490155bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f348800c790 tx=0x7f3488001610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f348cc00640 1 -- 172.21.15.45:0/3734985464 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348800a640 con 0x7f3490156c50 2024-08-17T02:25:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f348cc00640 1 -- 172.21.15.45:0/3734985464 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348800a7a0 con 0x7f3490156c50 2024-08-17T02:25:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f348cc00640 1 -- 172.21.15.45:0/3734985464 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348800ab60 con 0x7f3490156c50 2024-08-17T02:25:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.874+0000 7f3498600640 1 -- 172.21.15.45:0/3734985464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34900a6cb0 con 0x7f3490156c50 2024-08-17T02:25:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.875+0000 7f3498600640 1 -- 172.21.15.45:0/3734985464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34900aa230 con 0x7f3490156c50 2024-08-17T02:25:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.875+0000 7f3498600640 1 -- 172.21.15.45:0/3734985464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34901558a0 con 0x7f3490156c50 2024-08-17T02:25:16.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.876+0000 7f348cc00640 1 -- 172.21.15.45:0/3734985464 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3488012420 con 0x7f3490156c50 2024-08-17T02:25:16.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.877+0000 7f348cc00640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3470065150 0x7f3470067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:16.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.877+0000 7f348cc00640 1 -- 172.21.15.45:0/3734985464 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34880825c0 con 0x7f3490156c50 2024-08-17T02:25:16.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.877+0000 7f3495c00640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3470065150 0x7f3470067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:16.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.878+0000 7f3495c00640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3470065150 0x7f3470067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3484000c00 tx=0x7f3484007f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:16.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:16.881+0000 7f348cc00640 1 -- 172.21.15.45:0/3734985464 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3488050690 con 0x7f3490156c50 2024-08-17T02:25:17.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.103+0000 7f3498600640 1 -- 172.21.15.45:0/3734985464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f34900a6ea0 con 0x7f3490156c50 2024-08-17T02:25:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.694+0000 7f348cc00640 1 -- 172.21.15.45:0/3734985464 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3488080e60 con 0x7f3490156c50 2024-08-17T02:25:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 -- 172.21.15.45:0/3734985464 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3470065150 msgr2=0x7f3470067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3470065150 0x7f3470067600 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f3484000c00 tx=0x7f3484007f30 comp rx=0 tx=0).stop 2024-08-17T02:25:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 -- 172.21.15.45:0/3734985464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3490156c50 msgr2=0x7f3490155bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3490156c50 0x7f3490155bc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f348800c790 tx=0x7f3488001610 comp rx=0 tx=0).stop 2024-08-17T02:25:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 -- 172.21.15.45:0/3734985464 shutdown_connections 2024-08-17T02:25:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3490156c50 0x7f3490155bc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3470065150 0x7f3470067600 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f34900adcf0 0x7f3490151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 --2- 172.21.15.45:0/3734985464 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f34900abb00 0x7f34900a6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 -- 172.21.15.45:0/3734985464 >> 172.21.15.45:0/3734985464 conn(0x7f3490067750 msgr2=0x7f349006a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 -- 172.21.15.45:0/3734985464 shutdown_connections 2024-08-17T02:25:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.697+0000 7f3498600640 1 -- 172.21.15.45:0/3734985464 wait complete. 2024-08-17T02:25:17.715 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:17.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.871+0000 7fd651a00640 1 Processor -- start 2024-08-17T02:25:17.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.871+0000 7fd651a00640 1 -- start start 2024-08-17T02:25:17.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.872+0000 7fd651a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd64c158f80 0x7fd64c0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.872+0000 7fd651a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd64c0cf280 0x7fd64c0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.872+0000 7fd651a00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64c0cb560 con 0x7fd64c159350 2024-08-17T02:25:17.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.872+0000 7fd651a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64c0cf7e0 con 0x7fd64c0cf280 2024-08-17T02:25:17.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.872+0000 7fd651a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64c0cfac0 con 0x7fd64c158f80 2024-08-17T02:25:17.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.873+0000 7fd64b400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd64c0cf280 0x7fd64c0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.873+0000 7fd643e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd64c159350 0x7fd64c0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49184/0 (socket says 172.21.15.45:49184) 2024-08-17T02:25:17.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.873+0000 7fd643e00640 1 -- 172.21.15.45:0/3306006114 learned_addr learned my addr 172.21.15.45:0/3306006114 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:17.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.873+0000 7fd64aa00640 1 --2- 172.21.15.45:0/3306006114 >> v2:172.21.15.169:3300/0 conn(0x7fd64c158f80 0x7fd64c0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.873+0000 7fd64b400640 1 -- 172.21.15.45:0/3306006114 >> v2:172.21.15.169:3300/0 conn(0x7fd64c158f80 msgr2=0x7fd64c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:17.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.873+0000 7fd64b400640 1 --2- 172.21.15.45:0/3306006114 >> v2:172.21.15.169:3300/0 conn(0x7fd64c158f80 0x7fd64c0ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.873+0000 7fd64b400640 1 -- 172.21.15.45:0/3306006114 >> v1:172.21.15.45:6789/0 conn(0x7fd64c159350 legacy=0x7fd64c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.873+0000 7fd64b400640 1 -- 172.21.15.45:0/3306006114 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c0caf10 con 0x7fd64c0cf280 2024-08-17T02:25:17.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.873+0000 7fd64a000640 1 -- 172.21.15.45:0/3306006114 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245051514 0 0) 0x7fd64c0cb560 con 0x7fd64c159350 2024-08-17T02:25:17.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.874+0000 7fd64b400640 1 --2- 172.21.15.45:0/3306006114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cf280 0x7fd64c0ade50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd64c064190 tx=0x7fd644009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ee36c972e85da6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.874+0000 7fd64a000640 1 -- 172.21.15.45:0/3306006114 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644007550 con 0x7fd64c0cf280 2024-08-17T02:25:17.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.874+0000 7fd64a000640 1 -- 172.21.15.45:0/3306006114 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64402d050 con 0x7fd64c0cf280 2024-08-17T02:25:17.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.874+0000 7fd64a000640 1 -- 172.21.15.45:0/3306006114 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6440078e0 con 0x7fd64c0cf280 2024-08-17T02:25:17.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.875+0000 7fd651a00640 1 -- 172.21.15.45:0/3306006114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cf280 msgr2=0x7fd64c0ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.875+0000 7fd651a00640 1 --2- 172.21.15.45:0/3306006114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cf280 0x7fd64c0ade50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd64c064190 tx=0x7fd644009780 comp rx=0 tx=0).stop 2024-08-17T02:25:17.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.875+0000 7fd651a00640 1 -- 172.21.15.45:0/3306006114 shutdown_connections 2024-08-17T02:25:17.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.875+0000 7fd651a00640 1 --2- 172.21.15.45:0/3306006114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c0cf280 0x7fd64c0ade50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.875+0000 7fd651a00640 1 --2- 172.21.15.45:0/3306006114 >> v2:172.21.15.169:3300/0 conn(0x7fd64c158f80 0x7fd64c0ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.875+0000 7fd651a00640 1 -- 172.21.15.45:0/3306006114 >> 172.21.15.45:0/3306006114 conn(0x7fd64c0cfd90 msgr2=0x7fd64c0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:17.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.875+0000 7fd651a00640 1 -- 172.21.15.45:0/3306006114 shutdown_connections 2024-08-17T02:25:17.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.875+0000 7fd651a00640 1 -- 172.21.15.45:0/3306006114 wait complete. 2024-08-17T02:25:17.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.876+0000 7fd651a00640 1 Processor -- start 2024-08-17T02:25:17.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.877+0000 7fd651a00640 1 -- start start 2024-08-17T02:25:17.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.877+0000 7fd651a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd64c0cf280 0x7fd64c15cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.877+0000 7fd651a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd64c158f80 0x7fd64c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.877+0000 7fd651a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c159350 0x7fd64c0b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.877+0000 7fd651a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c15e490 con 0x7fd64c159350 2024-08-17T02:25:17.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.877+0000 7fd651a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c15d880 con 0x7fd64c0cf280 2024-08-17T02:25:17.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.877+0000 7fd651a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c15db60 con 0x7fd64c158f80 2024-08-17T02:25:17.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd64b400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c159350 0x7fd64c0b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd64b400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c159350 0x7fd64c0b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34286/0 (socket says 172.21.15.45:34286) 2024-08-17T02:25:17.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd64b400640 1 -- 172.21.15.45:0/1842615266 learned_addr learned my addr 172.21.15.45:0/1842615266 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:17.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd64aa00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd64c0cf280 0x7fd64c15cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd643e00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd64c158f80 0x7fd64c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd64b400640 1 -- 172.21.15.45:0/1842615266 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd64c158f80 msgr2=0x7fd64c15d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd64b400640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd64c158f80 0x7fd64c15d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd64b400640 1 -- 172.21.15.45:0/1842615266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd64c0cf280 msgr2=0x7fd64c15cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd64b400640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd64c0cf280 0x7fd64c15cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd64b400640 1 -- 172.21.15.45:0/1842615266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd644009a20 con 0x7fd64c159350 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd643e00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd64c158f80 0x7fd64c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd64aa00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd64c0cf280 0x7fd64c15cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.878+0000 7fd64b400640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c159350 0x7fd64c0b2b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd644009e90 tx=0x7fd644037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.879+0000 7fd642000640 1 -- 172.21.15.45:0/1842615266 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd644031c10 con 0x7fd64c159350 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.879+0000 7fd642000640 1 -- 172.21.15.45:0/1842615266 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd644031d70 con 0x7fd64c159350 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.879+0000 7fd642000640 1 -- 172.21.15.45:0/1842615266 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64403c650 con 0x7fd64c159350 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.879+0000 7fd651a00640 1 -- 172.21.15.45:0/1842615266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c15de40 con 0x7fd64c159350 2024-08-17T02:25:17.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.879+0000 7fd651a00640 1 -- 172.21.15.45:0/1842615266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c154360 con 0x7fd64c159350 2024-08-17T02:25:17.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.880+0000 7fd651a00640 1 -- 172.21.15.45:0/1842615266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c154550 con 0x7fd64c159350 2024-08-17T02:25:17.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.881+0000 7fd642000640 1 -- 172.21.15.45:0/1842615266 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd64403c9c0 con 0x7fd64c159350 2024-08-17T02:25:17.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.881+0000 7fd642000640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd628065150 0x7fd628067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:17.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.881+0000 7fd642000640 1 -- 172.21.15.45:0/1842615266 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6440a3de0 con 0x7fd64c159350 2024-08-17T02:25:17.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.882+0000 7fd64aa00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd628065150 0x7fd628067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:17.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.882+0000 7fd64aa00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd628065150 0x7fd628067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00bb80 tx=0x7fd63c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:17.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:17.885+0000 7fd642000640 1 -- 172.21.15.45:0/1842615266 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd644071ec0 con 0x7fd64c159350 2024-08-17T02:25:18.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.104+0000 7fd651a00640 1 -- 172.21.15.45:0/1842615266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd64c064db0 con 0x7fd64c159350 2024-08-17T02:25:18.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.105+0000 7fd642000640 1 -- 172.21.15.45:0/1842615266 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fd6440754e0 con 0x7fd64c159350 2024-08-17T02:25:18.105 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:18.106 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1637538519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1637538519},{"type":"v1","addr":"172.21.15.45:6837","nonce":1637538519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1027153973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1027153973},{"type":"v1","addr":"172.21.15.169:6835","nonce":1027153973}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2482387224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2482387224},{"type":"v1","addr":"172.21.15.45:6835","nonce":2482387224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:14.095016+0000","modified":"2024-08-17T02:25:17.687006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6834/911178485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":911178485},{"type":"v1","addr":"172.21.15.169:6834","nonce":911178485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:18.106 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2024-08-17T02:25:18.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.106+0000 7fd651a00640 1 -- 172.21.15.45:0/1842615266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd628065150 msgr2=0x7fd628067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.106+0000 7fd651a00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd628065150 0x7fd628067600 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd63c00bb80 tx=0x7fd63c008040 comp rx=0 tx=0).stop 2024-08-17T02:25:18.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.106+0000 7fd651a00640 1 -- 172.21.15.45:0/1842615266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c159350 msgr2=0x7fd64c0b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.106+0000 7fd651a00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c159350 0x7fd64c0b2b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd644009e90 tx=0x7fd644037000 comp rx=0 tx=0).stop 2024-08-17T02:25:18.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.107+0000 7fd651a00640 1 -- 172.21.15.45:0/1842615266 shutdown_connections 2024-08-17T02:25:18.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.107+0000 7fd651a00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd64c159350 0x7fd64c0b2b60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.107+0000 7fd651a00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd628065150 0x7fd628067600 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.107+0000 7fd651a00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd64c158f80 0x7fd64c15d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.107+0000 7fd651a00640 1 --2- 172.21.15.45:0/1842615266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd64c0cf280 0x7fd64c15cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.107+0000 7fd651a00640 1 -- 172.21.15.45:0/1842615266 >> 172.21.15.45:0/1842615266 conn(0x7fd64c0cfd90 msgr2=0x7fd64c1562e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.107+0000 7fd651a00640 1 -- 172.21.15.45:0/1842615266 shutdown_connections 2024-08-17T02:25:18.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.107+0000 7fd651a00640 1 -- 172.21.15.45:0/1842615266 wait complete. 2024-08-17T02:25:18.123 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:18.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.272+0000 7fc499800640 1 Processor -- start 2024-08-17T02:25:18.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.272+0000 7fc499800640 1 -- start start 2024-08-17T02:25:18.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.273+0000 7fc499800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc49406da20 0x7fc49406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.273+0000 7fc499800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc499800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4940a9a10 con 0x7fc494158dd0 2024-08-17T02:25:18.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc499800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4940ac400 con 0x7fc49406da20 2024-08-17T02:25:18.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc499800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4940a9cf0 con 0x7fc4940aa7d0 2024-08-17T02:25:18.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc48be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc492a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc49406da20 0x7fc49406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc48be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:47430/0 (socket says 172.21.15.45:47430) 2024-08-17T02:25:18.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc48be00640 1 -- 172.21.15.45:0/1261877011 learned_addr learned my addr 172.21.15.45:0/1261877011 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc48be00640 1 -- 172.21.15.45:0/1261877011 >> v2:172.21.15.169:3300/0 conn(0x7fc49406da20 msgr2=0x7fc49406ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc48be00640 1 --2- 172.21.15.45:0/1261877011 >> v2:172.21.15.169:3300/0 conn(0x7fc49406da20 0x7fc49406ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc48be00640 1 -- 172.21.15.45:0/1261877011 >> v1:172.21.15.169:6789/0 conn(0x7fc494158dd0 legacy=0x7fc4940ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc48be00640 1 -- 172.21.15.45:0/1261877011 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4940a9fd0 con 0x7fc4940aa7d0 2024-08-17T02:25:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.274+0000 7fc492a00640 1 --2- 172.21.15.45:0/1261877011 >> v2:172.21.15.169:3300/0 conn(0x7fc49406da20 0x7fc49406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:18.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.275+0000 7fc48be00640 1 --2- 172.21.15.45:0/1261877011 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494158890 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009910 tx=0x7fc47c0091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c44beb7f977f9e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.276+0000 7fc492000640 1 -- 172.21.15.45:0/1261877011 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c02add0 con 0x7fc4940aa7d0 2024-08-17T02:25:18.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.276+0000 7fc492000640 1 -- 172.21.15.45:0/1261877011 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c032440 con 0x7fc4940aa7d0 2024-08-17T02:25:18.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.276+0000 7fc492000640 1 -- 172.21.15.45:0/1261877011 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c032820 con 0x7fc4940aa7d0 2024-08-17T02:25:18.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.276+0000 7fc499800640 1 -- 172.21.15.45:0/1261877011 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 msgr2=0x7fc494158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.276+0000 7fc499800640 1 --2- 172.21.15.45:0/1261877011 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494158890 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009910 tx=0x7fc47c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.276+0000 7fc499800640 1 -- 172.21.15.45:0/1261877011 shutdown_connections 2024-08-17T02:25:18.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.276+0000 7fc499800640 1 --2- 172.21.15.45:0/1261877011 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494158890 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.276+0000 7fc499800640 1 --2- 172.21.15.45:0/1261877011 >> v2:172.21.15.169:3300/0 conn(0x7fc49406da20 0x7fc49406ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.276+0000 7fc499800640 1 -- 172.21.15.45:0/1261877011 >> 172.21.15.45:0/1261877011 conn(0x7fc4940cb9b0 msgr2=0x7fc4940cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.277+0000 7fc499800640 1 -- 172.21.15.45:0/1261877011 shutdown_connections 2024-08-17T02:25:18.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.277+0000 7fc499800640 1 -- 172.21.15.45:0/1261877011 wait complete. 2024-08-17T02:25:18.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.278+0000 7fc499800640 1 Processor -- start 2024-08-17T02:25:18.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.278+0000 7fc499800640 1 -- start start 2024-08-17T02:25:18.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc499800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc49406da20 0x7fc4940c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc499800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494169d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc499800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc494158dd0 0x7fc49415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc499800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49415c480 con 0x7fc494158dd0 2024-08-17T02:25:18.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc499800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc494068f20 con 0x7fc49406da20 2024-08-17T02:25:18.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc499800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc49415c1a0 con 0x7fc4940aa7d0 2024-08-17T02:25:18.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc493400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc494158dd0 0x7fc49415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc48be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494169d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc492a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc49406da20 0x7fc4940c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc48be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494169d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:47444/0 (socket says 172.21.15.45:47444) 2024-08-17T02:25:18.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc492a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc49406da20 0x7fc4940c8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:49084/0 (socket says 172.21.15.45:49084) 2024-08-17T02:25:18.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.279+0000 7fc48be00640 1 -- 172.21.15.45:0/333937894 learned_addr learned my addr 172.21.15.45:0/333937894 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:18.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc493400640 1 -- 172.21.15.45:0/333937894 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 msgr2=0x7fc494169d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc493400640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494169d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc493400640 1 -- 172.21.15.45:0/333937894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc49406da20 msgr2=0x7fc4940c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc493400640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc49406da20 0x7fc4940c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc493400640 1 -- 172.21.15.45:0/333937894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484009390 con 0x7fc494158dd0 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc48be00640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc492a00640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc49406da20 0x7fc4940c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc493400640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc494158dd0 0x7fc49415b5e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00c790 tx=0x7fc48c001560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc48a000640 1 -- 172.21.15.45:0/333937894 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c00a640 con 0x7fc494158dd0 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc48a000640 1 -- 172.21.15.45:0/333937894 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc48c00a7c0 con 0x7fc494158dd0 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc48a000640 1 -- 172.21.15.45:0/333937894 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48c00ab80 con 0x7fc494158dd0 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.280+0000 7fc499800640 1 -- 172.21.15.45:0/333937894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47c009450 con 0x7fc494158dd0 2024-08-17T02:25:18.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.281+0000 7fc499800640 1 -- 172.21.15.45:0/333937894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc494068bb0 con 0x7fc494158dd0 2024-08-17T02:25:18.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.281+0000 7fc499800640 1 -- 172.21.15.45:0/333937894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc494068730 con 0x7fc494158dd0 2024-08-17T02:25:18.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.282+0000 7fc48a000640 1 -- 172.21.15.45:0/333937894 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc48c003030 con 0x7fc494158dd0 2024-08-17T02:25:18.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.283+0000 7fc48a000640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc470065150 0x7fc470067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.283+0000 7fc48a000640 1 -- 172.21.15.45:0/333937894 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc48c082200 con 0x7fc494158dd0 2024-08-17T02:25:18.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.283+0000 7fc492a00640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc470065150 0x7fc470067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.284+0000 7fc492a00640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc470065150 0x7fc470067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc4940cc3d0 tx=0x7fc4840090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.287+0000 7fc48a000640 1 -- 172.21.15.45:0/333937894 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc494068730 con 0x7fc494158dd0 2024-08-17T02:25:18.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.469+0000 7fc499800640 1 -- 172.21.15.45:0/333937894 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc494068730 con 0x7fc494158dd0 2024-08-17T02:25:18.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.470+0000 7fc48a000640 1 -- 172.21.15.45:0/333937894 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fc494068730 con 0x7fc494158dd0 2024-08-17T02:25:18.471 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:18.471 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 -- 172.21.15.45:0/333937894 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc470065150 msgr2=0x7fc470067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc470065150 0x7fc470067600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc4940cc3d0 tx=0x7fc4840090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 -- 172.21.15.45:0/333937894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc494158dd0 msgr2=0x7fc49415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc494158dd0 0x7fc49415b5e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc48c00c790 tx=0x7fc48c001560 comp rx=0 tx=0).stop 2024-08-17T02:25:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 -- 172.21.15.45:0/333937894 shutdown_connections 2024-08-17T02:25:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc494158dd0 0x7fc49415b5e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc470065150 0x7fc470067600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4940aa7d0 0x7fc494169d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 --2- 172.21.15.45:0/333937894 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc49406da20 0x7fc4940c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 -- 172.21.15.45:0/333937894 >> 172.21.15.45:0/333937894 conn(0x7fc4940cb9b0 msgr2=0x7fc49406ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 -- 172.21.15.45:0/333937894 shutdown_connections 2024-08-17T02:25:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.472+0000 7fc499800640 1 -- 172.21.15.45:0/333937894 wait complete. 2024-08-17T02:25:18.488 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:25:18.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:18.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.638+0000 7f61f6c00640 1 Processor -- start 2024-08-17T02:25:18.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.638+0000 7f61f6c00640 1 -- start start 2024-08-17T02:25:18.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.640+0000 7f61f6c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f61f0140580 0x7f61f00c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.640+0000 7f61f6c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f00caa80 con 0x7f61f00b1440 2024-08-17T02:25:18.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.640+0000 7f61f6c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61f00c9e70 con 0x7f61f01401b0 2024-08-17T02:25:18.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.640+0000 7f61f6c00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f00c9c90 con 0x7f61f0140580 2024-08-17T02:25:18.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.640+0000 7f61f4c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f61f0140580 0x7f61f00c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.640+0000 7f61e7e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f61f00b1440 0x7f61f00c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49186/0 (socket says 172.21.15.45:49186) 2024-08-17T02:25:18.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.640+0000 7f61e7e00640 1 -- 172.21.15.45:0/3097613720 learned_addr learned my addr 172.21.15.45:0/3097613720 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:18.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.640+0000 7f61f4c00640 1 -- 172.21.15.45:0/3097613720 >> v1:172.21.15.169:6789/0 conn(0x7f61f01401b0 legacy=0x7f61f00b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.640+0000 7f61ef400640 1 -- 172.21.15.45:0/3097613720 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2923541178 0 0) 0x7f61f00c9e70 con 0x7f61f01401b0 2024-08-17T02:25:18.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.641+0000 7f61f4c00640 1 -- 172.21.15.45:0/3097613720 >> v1:172.21.15.45:6789/0 conn(0x7f61f00b1440 legacy=0x7f61f00c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.641+0000 7f61f4c00640 1 -- 172.21.15.45:0/3097613720 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f00ca150 con 0x7f61f0140580 2024-08-17T02:25:18.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.641+0000 7f61f4c00640 1 --2- 172.21.15.45:0/3097613720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f0140580 0x7f61f00c9750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009e60 tx=0x7f61e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777d869f462e4b6b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.642+0000 7f61ef400640 1 -- 172.21.15.45:0/3097613720 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8007550 con 0x7f61f0140580 2024-08-17T02:25:18.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.642+0000 7f61ef400640 1 -- 172.21.15.45:0/3097613720 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e802d050 con 0x7f61f0140580 2024-08-17T02:25:18.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.642+0000 7f61ef400640 1 -- 172.21.15.45:0/3097613720 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e80078e0 con 0x7f61f0140580 2024-08-17T02:25:18.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.642+0000 7f61f6c00640 1 -- 172.21.15.45:0/3097613720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f0140580 msgr2=0x7f61f00c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.642+0000 7f61f6c00640 1 --2- 172.21.15.45:0/3097613720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f0140580 0x7f61f00c9750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f61e8009e60 tx=0x7f61e8009780 comp rx=0 tx=0).stop 2024-08-17T02:25:18.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.642+0000 7f61f6c00640 1 -- 172.21.15.45:0/3097613720 shutdown_connections 2024-08-17T02:25:18.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.642+0000 7f61f6c00640 1 --2- 172.21.15.45:0/3097613720 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f0140580 0x7f61f00c9750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.642+0000 7f61f6c00640 1 -- 172.21.15.45:0/3097613720 >> 172.21.15.45:0/3097613720 conn(0x7f61f00cb9b0 msgr2=0x7f61f00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.642+0000 7f61f6c00640 1 -- 172.21.15.45:0/3097613720 shutdown_connections 2024-08-17T02:25:18.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.643+0000 7f61f6c00640 1 -- 172.21.15.45:0/3097613720 wait complete. 2024-08-17T02:25:18.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.644+0000 7f61f6c00640 1 Processor -- start 2024-08-17T02:25:18.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.644+0000 7f61f6c00640 1 -- start start 2024-08-17T02:25:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61f6c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f00b1440 0x7f61f013ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61f6c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f01401b0 0x7f61f013e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61f6c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0140580 0x7f61f00c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61f6c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00c6690 con 0x7f61f01401b0 2024-08-17T02:25:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61f6c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00c6970 con 0x7f61f0140580 2024-08-17T02:25:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61f6c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00c6c50 con 0x7f61f00b1440 2024-08-17T02:25:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61e7e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f01401b0 0x7f61f013e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61e7e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f01401b0 0x7f61f013e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34314/0 (socket says 172.21.15.45:34314) 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61e7e00640 1 -- 172.21.15.45:0/912991498 learned_addr learned my addr 172.21.15.45:0/912991498 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61f4c00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0140580 0x7f61f00c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61efe00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f00b1440 0x7f61f013ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61e7e00640 1 -- 172.21.15.45:0/912991498 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f00b1440 msgr2=0x7f61f013ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61e7e00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f00b1440 0x7f61f013ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61e7e00640 1 -- 172.21.15.45:0/912991498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0140580 msgr2=0x7f61f00c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61e7e00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0140580 0x7f61f00c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61e7e00640 1 -- 172.21.15.45:0/912991498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e8009a20 con 0x7f61f01401b0 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.645+0000 7f61f4c00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0140580 0x7f61f00c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.646+0000 7f61e7e00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f01401b0 0x7f61f013e6f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c7e0 tx=0x7f61d8007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.646+0000 7f61e7400640 1 -- 172.21.15.45:0/912991498 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8005870 con 0x7f61f01401b0 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.646+0000 7f61e7400640 1 -- 172.21.15.45:0/912991498 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61d80059d0 con 0x7f61f01401b0 2024-08-17T02:25:18.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.646+0000 7f61e7400640 1 -- 172.21.15.45:0/912991498 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61d8005e10 con 0x7f61f01401b0 2024-08-17T02:25:18.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.646+0000 7f61f6c00640 1 -- 172.21.15.45:0/912991498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f00c6f30 con 0x7f61f01401b0 2024-08-17T02:25:18.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.646+0000 7f61f6c00640 1 -- 172.21.15.45:0/912991498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f013ec30 con 0x7f61f01401b0 2024-08-17T02:25:18.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.647+0000 7f61f6c00640 1 -- 172.21.15.45:0/912991498 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f00c7430 con 0x7f61f01401b0 2024-08-17T02:25:18.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.648+0000 7f61e7400640 1 -- 172.21.15.45:0/912991498 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f61d8007300 con 0x7f61f01401b0 2024-08-17T02:25:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.649+0000 7f61e7400640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f61cc065150 0x7f61cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.649+0000 7f61e7400640 1 -- 172.21.15.45:0/912991498 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61d8082140 con 0x7f61f01401b0 2024-08-17T02:25:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.649+0000 7f61efe00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f61cc065150 0x7f61cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.650+0000 7f61efe00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f61cc065150 0x7f61cc067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61e00011e0 tx=0x7f61e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:18.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.653+0000 7f61e7400640 1 -- 172.21.15.45:0/912991498 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f61d80501e0 con 0x7f61f01401b0 2024-08-17T02:25:18.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.834+0000 7f61f6c00640 1 -- 172.21.15.45:0/912991498 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f61f00c6ae0 con 0x7f61cc065150 2024-08-17T02:25:18.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.842+0000 7f61e7400640 1 -- 172.21.15.45:0/912991498 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+254031 (secure 0 0 0) 0x7f61f00c6ae0 con 0x7f61cc065150 2024-08-17T02:25:18.846 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:18.847 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:25:18.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.845+0000 7f61f6c00640 1 -- 172.21.15.45:0/912991498 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f61cc065150 msgr2=0x7f61cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.845+0000 7f61f6c00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f61cc065150 0x7f61cc067600 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f61e00011e0 tx=0x7f61e0009040 comp rx=0 tx=0).stop 2024-08-17T02:25:18.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.845+0000 7f61f6c00640 1 -- 172.21.15.45:0/912991498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f01401b0 msgr2=0x7f61f013e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:18.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.845+0000 7f61f6c00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f01401b0 0x7f61f013e6f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c7e0 tx=0x7f61d8007f40 comp rx=0 tx=0).stop 2024-08-17T02:25:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.846+0000 7f61f6c00640 1 -- 172.21.15.45:0/912991498 shutdown_connections 2024-08-17T02:25:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.846+0000 7f61f6c00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61f0140580 0x7f61f00c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.846+0000 7f61f6c00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61f01401b0 0x7f61f013e6f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.846+0000 7f61f6c00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f61cc065150 0x7f61cc067600 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.846+0000 7f61f6c00640 1 --2- 172.21.15.45:0/912991498 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61f00b1440 0x7f61f013ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.846+0000 7f61f6c00640 1 -- 172.21.15.45:0/912991498 >> 172.21.15.45:0/912991498 conn(0x7f61f00cb9b0 msgr2=0x7f61f00c1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.846+0000 7f61f6c00640 1 -- 172.21.15.45:0/912991498 shutdown_connections 2024-08-17T02:25:18.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:18.846+0000 7f61f6c00640 1 -- 172.21.15.45:0/912991498 wait complete. 2024-08-17T02:25:18.862 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:25:17.657813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398644,"kb_used_data":2376,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576076,"statfs":{"total":773094113280,"available":770637901824,"internally_reserved":0,"allocated":2433024,"data_stored":1545016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.009235"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.654996+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:40:03.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.662355+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:08:28.840293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.655452+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.655901+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.663368+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.657395+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.658348+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.663140+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660502+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:08:28.840293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.658068+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.662440+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:40:03.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.651766+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:40:03.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.664939+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.651772+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.657116+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.651927+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-08-17T02:25:07.032677+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:25:07.032677+0000","last_peered":"2024-08-17T02:25:07.032677+0000","last_clean":"2024-08-17T02:25:07.032677+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:25:07.032677+0000","last_undegraded":"2024-08-17T02:25:07.032677+0000","last_fullsized":"2024-08-17T02:25:07.032677+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.655854+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:40:03.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.659634+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.651826+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.657478+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:08:28.840293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.658842+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660096+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.655274+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.662405+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660648+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.656518+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.655953+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.659869+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660168+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660895+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.656026+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660574+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:40:03.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298708,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073132,"statfs":{"total":96636764160,"available":96330887168,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301676,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301676,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301676,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302372,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069468,"statfs":{"total":96636764160,"available":96327135232,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:18.867 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:19.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.053+0000 7fd8f2c00640 1 Processor -- start 2024-08-17T02:25:19.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.053+0000 7fd8f2c00640 1 -- start start 2024-08-17T02:25:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.054+0000 7fd8f2c00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd8ec0ce8a0 0x7fd8ec0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.054+0000 7fd8f2c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ec0cc890 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.054+0000 7fd8f2c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8ec0cb4c0 con 0x7fd8ec0aed50 2024-08-17T02:25:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.054+0000 7fd8f2c00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8ec0cb7a0 con 0x7fd8ec0ce8a0 2024-08-17T02:25:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.054+0000 7fd8f2200640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd8ec0c5c40 0x7fd8ec0cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49192/0 (socket says 172.21.15.45:49192) 2024-08-17T02:25:19.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.054+0000 7fd8f2200640 1 -- 172.21.15.45:0/1453177604 learned_addr learned my addr 172.21.15.45:0/1453177604 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.054+0000 7fd8f0e00640 1 --2- 172.21.15.45:0/1453177604 >> v2:172.21.15.169:3300/0 conn(0x7fd8ec0ce8a0 0x7fd8ec0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.055+0000 7fd8ebe00640 1 -- 172.21.15.45:0/1453177604 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122708391 0 0) 0x7fd8ec0cc890 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.055+0000 7fd8ebe00640 1 -- 172.21.15.45:0/1453177604 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8d40034e0 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.055+0000 7fd8f0e00640 1 -- 172.21.15.45:0/1453177604 >> v1:172.21.15.169:6789/0 conn(0x7fd8ec0aed50 legacy=0x7fd8ec0ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.056 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.055+0000 7fd8f0e00640 1 -- 172.21.15.45:0/1453177604 >> v1:172.21.15.45:6789/0 conn(0x7fd8ec0c5c40 legacy=0x7fd8ec0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.055+0000 7fd8f0e00640 1 -- 172.21.15.45:0/1453177604 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec0cba80 con 0x7fd8ec0ce8a0 2024-08-17T02:25:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.056+0000 7fd8f0e00640 1 --2- 172.21.15.45:0/1453177604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8ec0ce8a0 0x7fd8ec0ca7b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009850 tx=0x7fd8d80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5727916cf0dc3081 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.056+0000 7fd8ebe00640 1 -- 172.21.15.45:0/1453177604 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d802ae20 con 0x7fd8ec0ce8a0 2024-08-17T02:25:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.056+0000 7fd8ebe00640 1 -- 172.21.15.45:0/1453177604 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d8032440 con 0x7fd8ec0ce8a0 2024-08-17T02:25:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.056+0000 7fd8ebe00640 1 -- 172.21.15.45:0/1453177604 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80327e0 con 0x7fd8ec0ce8a0 2024-08-17T02:25:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.057+0000 7fd8f2c00640 1 -- 172.21.15.45:0/1453177604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8ec0ce8a0 msgr2=0x7fd8ec0ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.057+0000 7fd8f2c00640 1 --2- 172.21.15.45:0/1453177604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8ec0ce8a0 0x7fd8ec0ca7b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009850 tx=0x7fd8d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.057+0000 7fd8f2c00640 1 -- 172.21.15.45:0/1453177604 shutdown_connections 2024-08-17T02:25:19.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.057+0000 7fd8f2c00640 1 --2- 172.21.15.45:0/1453177604 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8ec0ce8a0 0x7fd8ec0ca7b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.057+0000 7fd8f2c00640 1 -- 172.21.15.45:0/1453177604 >> 172.21.15.45:0/1453177604 conn(0x7fd8ec098e30 msgr2=0x7fd8ec06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.057+0000 7fd8f2c00640 1 -- 172.21.15.45:0/1453177604 shutdown_connections 2024-08-17T02:25:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.057+0000 7fd8f2c00640 1 -- 172.21.15.45:0/1453177604 wait complete. 2024-08-17T02:25:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.058+0000 7fd8f2c00640 1 Processor -- start 2024-08-17T02:25:19.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.059+0000 7fd8f2c00640 1 -- start start 2024-08-17T02:25:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.059+0000 7fd8f2c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8ec0aed50 0x7fd8ec150950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.059+0000 7fd8f2c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8ec0c5c40 0x7fd8ec0acc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.059+0000 7fd8f2c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8ec0ce8a0 0x7fd8ec0ad150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f2c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec0b2040 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f2c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec150e90 con 0x7fd8ec0ce8a0 2024-08-17T02:25:19.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f2c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec0b0fa0 con 0x7fd8ec0aed50 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f0e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8ec0c5c40 0x7fd8ec0acc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f0e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8ec0c5c40 0x7fd8ec0acc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34318/0 (socket says 172.21.15.45:34318) 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f0e00640 1 -- 172.21.15.45:0/3192837369 learned_addr learned my addr 172.21.15.45:0/3192837369 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f2200640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8ec0ce8a0 0x7fd8ec0ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f1800640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8ec0aed50 0x7fd8ec150950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f0e00640 1 -- 172.21.15.45:0/3192837369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8ec0aed50 msgr2=0x7fd8ec150950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f0e00640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8ec0aed50 0x7fd8ec150950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f0e00640 1 -- 172.21.15.45:0/3192837369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8ec0ce8a0 msgr2=0x7fd8ec0ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f0e00640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8ec0ce8a0 0x7fd8ec0ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f0e00640 1 -- 172.21.15.45:0/3192837369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8009390 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.060+0000 7fd8f1800640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8ec0aed50 0x7fd8ec150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:19.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.061+0000 7fd8f0e00640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8ec0c5c40 0x7fd8ec0acc10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009360 tx=0x7fd8d8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.061+0000 7fd8e8c00640 1 -- 172.21.15.45:0/3192837369 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8000d10 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.061+0000 7fd8e8c00640 1 -- 172.21.15.45:0/3192837369 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d8031e00 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.061+0000 7fd8f2c00640 1 -- 172.21.15.45:0/3192837369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8ec0b1280 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.061+0000 7fd8e8c00640 1 -- 172.21.15.45:0/3192837369 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d803d690 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.061+0000 7fd8f2c00640 1 -- 172.21.15.45:0/3192837369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8ec0b1840 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.062+0000 7fd8f2c00640 1 -- 172.21.15.45:0/3192837369 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8ec071050 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.064 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.063+0000 7fd8e8c00640 1 -- 172.21.15.45:0/3192837369 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd8d8039040 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.064+0000 7fd8e8c00640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd8cc065150 0x7fd8cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.064+0000 7fd8e8c00640 1 -- 172.21.15.45:0/3192837369 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8d80a2620 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.064+0000 7fd8f1800640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd8cc065150 0x7fd8cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.064+0000 7fd8f1800640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd8cc065150 0x7fd8cc067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0001780 tx=0x7fd8e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.068+0000 7fd8e8c00640 1 -- 172.21.15.45:0/3192837369 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd8d80706f0 con 0x7fd8ec0c5c40 2024-08-17T02:25:19.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.248+0000 7fd8f2c00640 1 -- 172.21.15.45:0/3192837369 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8ec0ccf30 con 0x7fd8cc065150 2024-08-17T02:25:19.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.255+0000 7fd8e8c00640 1 -- 172.21.15.45:0/3192837369 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+254031 (secure 0 0 0) 0x7fd8ec0ccf30 con 0x7fd8cc065150 2024-08-17T02:25:19.259 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:19.260 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:25:19.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 -- 172.21.15.45:0/3192837369 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd8cc065150 msgr2=0x7fd8cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd8cc065150 0x7fd8cc067600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0001780 tx=0x7fd8e0009040 comp rx=0 tx=0).stop 2024-08-17T02:25:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 -- 172.21.15.45:0/3192837369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8ec0c5c40 msgr2=0x7fd8ec0acc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8ec0c5c40 0x7fd8ec0acc10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd8d8009360 tx=0x7fd8d8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 -- 172.21.15.45:0/3192837369 shutdown_connections 2024-08-17T02:25:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd8ec0ce8a0 0x7fd8ec0ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8ec0c5c40 0x7fd8ec0acc10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd8cc065150 0x7fd8cc067600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 --2- 172.21.15.45:0/3192837369 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd8ec0aed50 0x7fd8ec150950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 -- 172.21.15.45:0/3192837369 >> 172.21.15.45:0/3192837369 conn(0x7fd8ec098e30 msgr2=0x7fd8ec0cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 -- 172.21.15.45:0/3192837369 shutdown_connections 2024-08-17T02:25:19.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.259+0000 7fd8f2c00640 1 -- 172.21.15.45:0/3192837369 wait complete. 2024-08-17T02:25:19.275 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-08-17T02:25:17.657813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398644,"kb_used_data":2376,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576076,"statfs":{"total":773094113280,"available":770637901824,"internally_reserved":0,"allocated":2433024,"data_stored":1545016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.009235"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.654996+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:40:03.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.662355+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:08:28.840293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.655452+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.655901+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.663368+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.657395+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.658348+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.663140+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660502+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:08:28.840293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.658068+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.662440+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:40:03.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.651766+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:40:03.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.664939+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.651772+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.657116+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.651927+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-08-17T02:25:07.032677+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:25:07.032677+0000","last_peered":"2024-08-17T02:25:07.032677+0000","last_clean":"2024-08-17T02:25:07.032677+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:25:07.032677+0000","last_undegraded":"2024-08-17T02:25:07.032677+0000","last_fullsized":"2024-08-17T02:25:07.032677+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.655854+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:40:03.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.659634+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.651826+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.657478+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:08:28.840293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.658842+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660096+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.655274+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.662405+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660648+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.656518+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.655953+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.659869+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660168+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660895+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.656026+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-08-17T02:25:13.648231+0000","last_change":"2024-08-17T02:25:13.648231+0000","last_active":"2024-08-17T02:25:13.648231+0000","last_peered":"2024-08-17T02:25:13.648231+0000","last_clean":"2024-08-17T02:25:13.648231+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:13.648231+0000","last_undegraded":"2024-08-17T02:25:13.648231+0000","last_fullsized":"2024-08-17T02:25:13.648231+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2024-08-17T02:25:12.642766+0000","last_change":"2024-08-17T02:25:12.660574+0000","last_active":"2024-08-17T02:25:12.642766+0000","last_peered":"2024-08-17T02:25:12.642766+0000","last_clean":"2024-08-17T02:25:12.642766+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-08-17T02:25:12.642766+0000","last_undegraded":"2024-08-17T02:25:12.642766+0000","last_fullsized":"2024-08-17T02:25:12.642766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:40:03.734042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298708,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073132,"statfs":{"total":96636764160,"available":96330887168,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.746}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297512,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074328,"statfs":{"total":96636764160,"available":96332111872,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301676,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301676,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301676,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070164,"statfs":{"total":96636764160,"available":96327847936,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302372,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069468,"statfs":{"total":96636764160,"available":96327135232,"internally_reserved":0,"allocated":749568,"data_stored":635903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:19.279 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:19.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.465+0000 7f7df3200640 1 Processor -- start 2024-08-17T02:25:19.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.465+0000 7f7df3200640 1 -- start start 2024-08-17T02:25:19.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.466+0000 7f7df3200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7dec158f80 0x7f7dec0ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.466+0000 7f7df3200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7dec0cf280 0x7f7dec0ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.466+0000 7f7df3200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dec0cb560 con 0x7f7dec159350 2024-08-17T02:25:19.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.466+0000 7f7df3200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec0cf7e0 con 0x7f7dec158f80 2024-08-17T02:25:19.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.466+0000 7f7df3200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dec0cfac0 con 0x7f7dec0cf280 2024-08-17T02:25:19.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.466+0000 7f7debe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7dec158f80 0x7f7dec0ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.466+0000 7f7deb400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7dec159350 0x7f7dec0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49206/0 (socket says 172.21.15.45:49206) 2024-08-17T02:25:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.466+0000 7f7deb400640 1 -- 172.21.15.45:0/1093994669 learned_addr learned my addr 172.21.15.45:0/1093994669 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.467+0000 7f7df1200640 1 --2- 172.21.15.45:0/1093994669 >> v2:172.21.15.169:3300/0 conn(0x7f7dec0cf280 0x7f7dec0ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.467+0000 7f7debe00640 1 -- 172.21.15.45:0/1093994669 >> v2:172.21.15.169:3300/0 conn(0x7f7dec0cf280 msgr2=0x7f7dec0ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.467+0000 7f7debe00640 1 --2- 172.21.15.45:0/1093994669 >> v2:172.21.15.169:3300/0 conn(0x7f7dec0cf280 0x7f7dec0ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.467+0000 7f7debe00640 1 -- 172.21.15.45:0/1093994669 >> v1:172.21.15.45:6789/0 conn(0x7f7dec159350 legacy=0x7f7dec0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.467+0000 7f7deaa00640 1 -- 172.21.15.45:0/1093994669 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816105437 0 0) 0x7f7dec0cb560 con 0x7f7dec159350 2024-08-17T02:25:19.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.467+0000 7f7debe00640 1 -- 172.21.15.45:0/1093994669 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec0caf10 con 0x7f7dec158f80 2024-08-17T02:25:19.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.468+0000 7f7debe00640 1 --2- 172.21.15.45:0/1093994669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec158f80 0x7f7dec0ca330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7dec08a230 tx=0x7f7ddc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927aa6bf9aca93a6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.468+0000 7f7deaa00640 1 -- 172.21.15.45:0/1093994669 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc02adb0 con 0x7f7dec158f80 2024-08-17T02:25:19.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.468+0000 7f7deaa00640 1 -- 172.21.15.45:0/1093994669 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc032440 con 0x7f7dec158f80 2024-08-17T02:25:19.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.468+0000 7f7deaa00640 1 -- 172.21.15.45:0/1093994669 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0327e0 con 0x7f7dec158f80 2024-08-17T02:25:19.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.469+0000 7f7df3200640 1 -- 172.21.15.45:0/1093994669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec158f80 msgr2=0x7f7dec0ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.469+0000 7f7df3200640 1 --2- 172.21.15.45:0/1093994669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec158f80 0x7f7dec0ca330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7dec08a230 tx=0x7f7ddc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.469+0000 7f7df3200640 1 -- 172.21.15.45:0/1093994669 shutdown_connections 2024-08-17T02:25:19.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.469+0000 7f7df3200640 1 --2- 172.21.15.45:0/1093994669 >> v2:172.21.15.169:3300/0 conn(0x7f7dec0cf280 0x7f7dec0ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.469+0000 7f7df3200640 1 --2- 172.21.15.45:0/1093994669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec158f80 0x7f7dec0ca330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.469+0000 7f7df3200640 1 -- 172.21.15.45:0/1093994669 >> 172.21.15.45:0/1093994669 conn(0x7f7dec0cfd90 msgr2=0x7f7dec0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.469+0000 7f7df3200640 1 -- 172.21.15.45:0/1093994669 shutdown_connections 2024-08-17T02:25:19.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.469+0000 7f7df3200640 1 -- 172.21.15.45:0/1093994669 wait complete. 2024-08-17T02:25:19.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.470+0000 7f7df3200640 1 Processor -- start 2024-08-17T02:25:19.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.470+0000 7f7df3200640 1 -- start start 2024-08-17T02:25:19.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.471+0000 7f7df3200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dec0cf280 0x7f7dec16a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.471+0000 7f7df3200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec158f80 0x7f7dec15b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.471+0000 7f7df3200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dec159350 0x7f7dec16b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.471+0000 7f7df3200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec15c250 con 0x7f7dec158f80 2024-08-17T02:25:19.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.471+0000 7f7df3200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec152ff0 con 0x7f7dec159350 2024-08-17T02:25:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.471+0000 7f7df3200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dec15bf70 con 0x7f7dec0cf280 2024-08-17T02:25:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.471+0000 7f7deb400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec158f80 0x7f7dec15b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7deb400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec158f80 0x7f7dec15b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34336/0 (socket says 172.21.15.45:34336) 2024-08-17T02:25:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7deb400640 1 -- 172.21.15.45:0/3851169419 learned_addr learned my addr 172.21.15.45:0/3851169419 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7debe00640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dec0cf280 0x7f7dec16a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7df1200640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dec159350 0x7f7dec16b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7deb400640 1 -- 172.21.15.45:0/3851169419 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dec0cf280 msgr2=0x7f7dec16a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7deb400640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dec0cf280 0x7f7dec16a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7deb400640 1 -- 172.21.15.45:0/3851169419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dec159350 msgr2=0x7f7dec16b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7deb400640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dec159350 0x7f7dec16b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7deb400640 1 -- 172.21.15.45:0/3851169419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ddc009390 con 0x7f7dec158f80 2024-08-17T02:25:19.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7deb400640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec158f80 0x7f7dec15b920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800c5e0 tx=0x7f7dd8007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7de3400640 1 -- 172.21.15.45:0/3851169419 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8005aa0 con 0x7f7dec158f80 2024-08-17T02:25:19.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7de3400640 1 -- 172.21.15.45:0/3851169419 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd8005c00 con 0x7f7dec158f80 2024-08-17T02:25:19.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7de3400640 1 -- 172.21.15.45:0/3851169419 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80070f0 con 0x7f7dec158f80 2024-08-17T02:25:19.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.472+0000 7f7df3200640 1 -- 172.21.15.45:0/3851169419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dec1529a0 con 0x7f7dec158f80 2024-08-17T02:25:19.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.473+0000 7f7df3200640 1 -- 172.21.15.45:0/3851169419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dec159910 con 0x7f7dec158f80 2024-08-17T02:25:19.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.474+0000 7f7df3200640 1 -- 172.21.15.45:0/3851169419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dec152800 con 0x7f7dec158f80 2024-08-17T02:25:19.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.474+0000 7f7de3400640 1 -- 172.21.15.45:0/3851169419 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7dd8007520 con 0x7f7dec158f80 2024-08-17T02:25:19.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.475+0000 7f7de3400640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7dcc065150 0x7f7dcc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.475+0000 7f7de3400640 1 -- 172.21.15.45:0/3851169419 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7dd8081e80 con 0x7f7dec158f80 2024-08-17T02:25:19.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.475+0000 7f7debe00640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7dcc065150 0x7f7dcc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.476+0000 7f7debe00640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7dcc065150 0x7f7dcc067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc034000 tx=0x7f7ddc032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.479+0000 7f7de3400640 1 -- 172.21.15.45:0/3851169419 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7dec152800 con 0x7f7dec158f80 2024-08-17T02:25:19.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.660+0000 7f7df3200640 1 -- 172.21.15.45:0/3851169419 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7dec152800 con 0x7f7dcc065150 2024-08-17T02:25:19.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.667+0000 7f7de3400640 1 -- 172.21.15.45:0/3851169419 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264680 (secure 0 0 0) 0x7f7dec152800 con 0x7f7dcc065150 2024-08-17T02:25:19.670 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:19.672 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:25:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 -- 172.21.15.45:0/3851169419 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7dcc065150 msgr2=0x7f7dcc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7dcc065150 0x7f7dcc067600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc034000 tx=0x7f7ddc032000 comp rx=0 tx=0).stop 2024-08-17T02:25:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 -- 172.21.15.45:0/3851169419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec158f80 msgr2=0x7f7dec15b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec158f80 0x7f7dec15b920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800c5e0 tx=0x7f7dd8007d60 comp rx=0 tx=0).stop 2024-08-17T02:25:19.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 -- 172.21.15.45:0/3851169419 shutdown_connections 2024-08-17T02:25:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7dec159350 0x7f7dec16b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7dec158f80 0x7f7dec15b920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7dcc065150 0x7f7dcc067600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 --2- 172.21.15.45:0/3851169419 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7dec0cf280 0x7f7dec16a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 -- 172.21.15.45:0/3851169419 >> 172.21.15.45:0/3851169419 conn(0x7f7dec0cfd90 msgr2=0x7f7dec0d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 -- 172.21.15.45:0/3851169419 shutdown_connections 2024-08-17T02:25:19.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.671+0000 7f7df3200640 1 -- 172.21.15.45:0/3851169419 wait complete. 2024-08-17T02:25:19.686 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:25:19.658285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398324,"kb_used_data":2812,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576396,"statfs":{"total":773094113280,"available":770638229504,"internally_reserved":0,"allocated":2879488,"data_stored":1744356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.006584"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694749+0000","last_change":"2024-08-17T02:25:14.688635+0000","last_active":"2024-08-17T02:25:14.694749+0000","last_peered":"2024-08-17T02:25:14.694749+0000","last_clean":"2024-08-17T02:25:14.694749+0000","last_became_active":"2024-08-17T02:25:14.688409+0000","last_became_peered":"2024-08-17T02:25:14.688409+0000","last_unstale":"2024-08-17T02:25:14.694749+0000","last_undegraded":"2024-08-17T02:25:14.694749+0000","last_fullsized":"2024-08-17T02:25:14.694749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:32.913252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686216+0000","last_change":"2024-08-17T02:25:14.685522+0000","last_active":"2024-08-17T02:25:14.686216+0000","last_peered":"2024-08-17T02:25:14.686216+0000","last_clean":"2024-08-17T02:25:14.686216+0000","last_became_active":"2024-08-17T02:25:14.685146+0000","last_became_peered":"2024-08-17T02:25:14.685146+0000","last_unstale":"2024-08-17T02:25:14.686216+0000","last_undegraded":"2024-08-17T02:25:14.686216+0000","last_fullsized":"2024-08-17T02:25:14.686216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.669173+0000","last_change":"2024-08-17T02:25:14.668249+0000","last_active":"2024-08-17T02:25:14.669173+0000","last_peered":"2024-08-17T02:25:14.669173+0000","last_clean":"2024-08-17T02:25:14.669173+0000","last_became_active":"2024-08-17T02:25:14.667916+0000","last_became_peered":"2024-08-17T02:25:14.667916+0000","last_unstale":"2024-08-17T02:25:14.669173+0000","last_undegraded":"2024-08-17T02:25:14.669173+0000","last_fullsized":"2024-08-17T02:25:14.669173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678079+0000","last_change":"2024-08-17T02:25:14.667371+0000","last_active":"2024-08-17T02:25:14.678079+0000","last_peered":"2024-08-17T02:25:14.678079+0000","last_clean":"2024-08-17T02:25:14.678079+0000","last_became_active":"2024-08-17T02:25:14.666507+0000","last_became_peered":"2024-08-17T02:25:14.666507+0000","last_unstale":"2024-08-17T02:25:14.678079+0000","last_undegraded":"2024-08-17T02:25:14.678079+0000","last_fullsized":"2024-08-17T02:25:14.678079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:32.913252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.680072+0000","last_change":"2024-08-17T02:25:14.673429+0000","last_active":"2024-08-17T02:25:14.680072+0000","last_peered":"2024-08-17T02:25:14.680072+0000","last_clean":"2024-08-17T02:25:14.680072+0000","last_became_active":"2024-08-17T02:25:14.673116+0000","last_became_peered":"2024-08-17T02:25:14.673116+0000","last_unstale":"2024-08-17T02:25:14.680072+0000","last_undegraded":"2024-08-17T02:25:14.680072+0000","last_fullsized":"2024-08-17T02:25:14.680072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678094+0000","last_change":"2024-08-17T02:25:14.665820+0000","last_active":"2024-08-17T02:25:14.678094+0000","last_peered":"2024-08-17T02:25:14.678094+0000","last_clean":"2024-08-17T02:25:14.678094+0000","last_became_active":"2024-08-17T02:25:14.665533+0000","last_became_peered":"2024-08-17T02:25:14.665533+0000","last_unstale":"2024-08-17T02:25:14.678094+0000","last_undegraded":"2024-08-17T02:25:14.678094+0000","last_fullsized":"2024-08-17T02:25:14.678094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:07.562236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693398+0000","last_change":"2024-08-17T02:25:14.685204+0000","last_active":"2024-08-17T02:25:14.693398+0000","last_peered":"2024-08-17T02:25:14.693398+0000","last_clean":"2024-08-17T02:25:14.693398+0000","last_became_active":"2024-08-17T02:25:14.684913+0000","last_became_peered":"2024-08-17T02:25:14.684913+0000","last_unstale":"2024-08-17T02:25:14.693398+0000","last_undegraded":"2024-08-17T02:25:14.693398+0000","last_fullsized":"2024-08-17T02:25:14.693398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:27:44.886508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679252+0000","last_change":"2024-08-17T02:25:14.671977+0000","last_active":"2024-08-17T02:25:14.679252+0000","last_peered":"2024-08-17T02:25:14.679252+0000","last_clean":"2024-08-17T02:25:14.679252+0000","last_became_active":"2024-08-17T02:25:14.671715+0000","last_became_peered":"2024-08-17T02:25:14.671715+0000","last_unstale":"2024-08-17T02:25:14.679252+0000","last_undegraded":"2024-08-17T02:25:14.679252+0000","last_fullsized":"2024-08-17T02:25:14.679252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690194+0000","last_change":"2024-08-17T02:25:14.682177+0000","last_active":"2024-08-17T02:25:14.690194+0000","last_peered":"2024-08-17T02:25:14.690194+0000","last_clean":"2024-08-17T02:25:14.690194+0000","last_became_active":"2024-08-17T02:25:14.681923+0000","last_became_peered":"2024-08-17T02:25:14.681923+0000","last_unstale":"2024-08-17T02:25:14.690194+0000","last_undegraded":"2024-08-17T02:25:14.690194+0000","last_fullsized":"2024-08-17T02:25:14.690194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:07.562236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689537+0000","last_change":"2024-08-17T02:25:14.684528+0000","last_active":"2024-08-17T02:25:14.689537+0000","last_peered":"2024-08-17T02:25:14.689537+0000","last_clean":"2024-08-17T02:25:14.689537+0000","last_became_active":"2024-08-17T02:25:14.684273+0000","last_became_peered":"2024-08-17T02:25:14.684273+0000","last_unstale":"2024-08-17T02:25:14.689537+0000","last_undegraded":"2024-08-17T02:25:14.689537+0000","last_fullsized":"2024-08-17T02:25:14.689537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693057+0000","last_change":"2024-08-17T02:25:14.687803+0000","last_active":"2024-08-17T02:25:14.693057+0000","last_peered":"2024-08-17T02:25:14.693057+0000","last_clean":"2024-08-17T02:25:14.693057+0000","last_became_active":"2024-08-17T02:25:14.687474+0000","last_became_peered":"2024-08-17T02:25:14.687474+0000","last_unstale":"2024-08-17T02:25:14.693057+0000","last_undegraded":"2024-08-17T02:25:14.693057+0000","last_fullsized":"2024-08-17T02:25:14.693057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694472+0000","last_change":"2024-08-17T02:25:14.688106+0000","last_active":"2024-08-17T02:25:14.694472+0000","last_peered":"2024-08-17T02:25:14.694472+0000","last_clean":"2024-08-17T02:25:14.694472+0000","last_became_active":"2024-08-17T02:25:14.687884+0000","last_became_peered":"2024-08-17T02:25:14.687884+0000","last_unstale":"2024-08-17T02:25:14.694472+0000","last_undegraded":"2024-08-17T02:25:14.694472+0000","last_fullsized":"2024-08-17T02:25:14.694472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:07.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678556+0000","last_change":"2024-08-17T02:25:14.675832+0000","last_active":"2024-08-17T02:25:14.678556+0000","last_peered":"2024-08-17T02:25:14.678556+0000","last_clean":"2024-08-17T02:25:14.678556+0000","last_became_active":"2024-08-17T02:25:14.674356+0000","last_became_peered":"2024-08-17T02:25:14.674356+0000","last_unstale":"2024-08-17T02:25:14.678556+0000","last_undegraded":"2024-08-17T02:25:14.678556+0000","last_fullsized":"2024-08-17T02:25:14.678556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686167+0000","last_change":"2024-08-17T02:25:14.682873+0000","last_active":"2024-08-17T02:25:14.686167+0000","last_peered":"2024-08-17T02:25:14.686167+0000","last_clean":"2024-08-17T02:25:14.686167+0000","last_became_active":"2024-08-17T02:25:14.678077+0000","last_became_peered":"2024-08-17T02:25:14.678077+0000","last_unstale":"2024-08-17T02:25:14.686167+0000","last_undegraded":"2024-08-17T02:25:14.686167+0000","last_fullsized":"2024-08-17T02:25:14.686167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:34.226633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678037+0000","last_change":"2024-08-17T02:25:14.675577+0000","last_active":"2024-08-17T02:25:14.678037+0000","last_peered":"2024-08-17T02:25:14.678037+0000","last_clean":"2024-08-17T02:25:14.678037+0000","last_became_active":"2024-08-17T02:25:14.675346+0000","last_became_peered":"2024-08-17T02:25:14.675346+0000","last_unstale":"2024-08-17T02:25:14.678037+0000","last_undegraded":"2024-08-17T02:25:14.678037+0000","last_fullsized":"2024-08-17T02:25:14.678037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678546+0000","last_change":"2024-08-17T02:25:14.664639+0000","last_active":"2024-08-17T02:25:14.678546+0000","last_peered":"2024-08-17T02:25:14.678546+0000","last_clean":"2024-08-17T02:25:14.678546+0000","last_became_active":"2024-08-17T02:25:14.664238+0000","last_became_peered":"2024-08-17T02:25:14.664238+0000","last_unstale":"2024-08-17T02:25:14.678546+0000","last_undegraded":"2024-08-17T02:25:14.678546+0000","last_fullsized":"2024-08-17T02:25:14.678546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681035+0000","last_change":"2024-08-17T02:25:14.673971+0000","last_active":"2024-08-17T02:25:14.681035+0000","last_peered":"2024-08-17T02:25:14.681035+0000","last_clean":"2024-08-17T02:25:14.681035+0000","last_became_active":"2024-08-17T02:25:14.673681+0000","last_became_peered":"2024-08-17T02:25:14.673681+0000","last_unstale":"2024-08-17T02:25:14.681035+0000","last_undegraded":"2024-08-17T02:25:14.681035+0000","last_fullsized":"2024-08-17T02:25:14.681035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681015+0000","last_change":"2024-08-17T02:25:14.679222+0000","last_active":"2024-08-17T02:25:14.681015+0000","last_peered":"2024-08-17T02:25:14.681015+0000","last_clean":"2024-08-17T02:25:14.681015+0000","last_became_active":"2024-08-17T02:25:14.678854+0000","last_became_peered":"2024-08-17T02:25:14.678854+0000","last_unstale":"2024-08-17T02:25:14.681015+0000","last_undegraded":"2024-08-17T02:25:14.681015+0000","last_fullsized":"2024-08-17T02:25:14.681015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:49.762929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690292+0000","last_change":"2024-08-17T02:25:14.675322+0000","last_active":"2024-08-17T02:25:14.690292+0000","last_peered":"2024-08-17T02:25:14.690292+0000","last_clean":"2024-08-17T02:25:14.690292+0000","last_became_active":"2024-08-17T02:25:14.675062+0000","last_became_peered":"2024-08-17T02:25:14.675062+0000","last_unstale":"2024-08-17T02:25:14.690292+0000","last_undegraded":"2024-08-17T02:25:14.690292+0000","last_fullsized":"2024-08-17T02:25:14.690292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693140+0000","last_change":"2024-08-17T02:25:14.688691+0000","last_active":"2024-08-17T02:25:14.693140+0000","last_peered":"2024-08-17T02:25:14.693140+0000","last_clean":"2024-08-17T02:25:14.693140+0000","last_became_active":"2024-08-17T02:25:14.688426+0000","last_became_peered":"2024-08-17T02:25:14.688426+0000","last_unstale":"2024-08-17T02:25:14.693140+0000","last_undegraded":"2024-08-17T02:25:14.693140+0000","last_fullsized":"2024-08-17T02:25:14.693140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684959+0000","last_change":"2024-08-17T02:25:14.677713+0000","last_active":"2024-08-17T02:25:14.684959+0000","last_peered":"2024-08-17T02:25:14.684959+0000","last_clean":"2024-08-17T02:25:14.684959+0000","last_became_active":"2024-08-17T02:25:14.676684+0000","last_became_peered":"2024-08-17T02:25:14.676684+0000","last_unstale":"2024-08-17T02:25:14.684959+0000","last_undegraded":"2024-08-17T02:25:14.684959+0000","last_fullsized":"2024-08-17T02:25:14.684959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683534+0000","last_change":"2024-08-17T02:25:14.677693+0000","last_active":"2024-08-17T02:25:14.683534+0000","last_peered":"2024-08-17T02:25:14.683534+0000","last_clean":"2024-08-17T02:25:14.683534+0000","last_became_active":"2024-08-17T02:25:14.675085+0000","last_became_peered":"2024-08-17T02:25:14.675085+0000","last_unstale":"2024-08-17T02:25:14.683534+0000","last_undegraded":"2024-08-17T02:25:14.683534+0000","last_fullsized":"2024-08-17T02:25:14.683534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686732+0000","last_change":"2024-08-17T02:25:14.680570+0000","last_active":"2024-08-17T02:25:14.686732+0000","last_peered":"2024-08-17T02:25:14.686732+0000","last_clean":"2024-08-17T02:25:14.686732+0000","last_became_active":"2024-08-17T02:25:14.680331+0000","last_became_peered":"2024-08-17T02:25:14.680331+0000","last_unstale":"2024-08-17T02:25:14.686732+0000","last_undegraded":"2024-08-17T02:25:14.686732+0000","last_fullsized":"2024-08-17T02:25:14.686732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678558+0000","last_change":"2024-08-17T02:25:14.669965+0000","last_active":"2024-08-17T02:25:14.678558+0000","last_peered":"2024-08-17T02:25:14.678558+0000","last_clean":"2024-08-17T02:25:14.678558+0000","last_became_active":"2024-08-17T02:25:14.669710+0000","last_became_peered":"2024-08-17T02:25:14.669710+0000","last_unstale":"2024-08-17T02:25:14.678558+0000","last_undegraded":"2024-08-17T02:25:14.678558+0000","last_fullsized":"2024-08-17T02:25:14.678558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686777+0000","last_change":"2024-08-17T02:25:14.680996+0000","last_active":"2024-08-17T02:25:14.686777+0000","last_peered":"2024-08-17T02:25:14.686777+0000","last_clean":"2024-08-17T02:25:14.686777+0000","last_became_active":"2024-08-17T02:25:14.680672+0000","last_became_peered":"2024-08-17T02:25:14.680672+0000","last_unstale":"2024-08-17T02:25:14.686777+0000","last_undegraded":"2024-08-17T02:25:14.686777+0000","last_fullsized":"2024-08-17T02:25:14.686777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686709+0000","last_change":"2024-08-17T02:25:14.682018+0000","last_active":"2024-08-17T02:25:14.686709+0000","last_peered":"2024-08-17T02:25:14.686709+0000","last_clean":"2024-08-17T02:25:14.686709+0000","last_became_active":"2024-08-17T02:25:14.681624+0000","last_became_peered":"2024-08-17T02:25:14.681624+0000","last_unstale":"2024-08-17T02:25:14.686709+0000","last_undegraded":"2024-08-17T02:25:14.686709+0000","last_fullsized":"2024-08-17T02:25:14.686709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.674157+0000","last_change":"2024-08-17T02:25:14.673348+0000","last_active":"2024-08-17T02:25:14.674157+0000","last_peered":"2024-08-17T02:25:14.674157+0000","last_clean":"2024-08-17T02:25:14.674157+0000","last_became_active":"2024-08-17T02:25:14.672984+0000","last_became_peered":"2024-08-17T02:25:14.672984+0000","last_unstale":"2024-08-17T02:25:14.674157+0000","last_undegraded":"2024-08-17T02:25:14.674157+0000","last_fullsized":"2024-08-17T02:25:14.674157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686798+0000","last_change":"2024-08-17T02:25:14.681879+0000","last_active":"2024-08-17T02:25:14.686798+0000","last_peered":"2024-08-17T02:25:14.686798+0000","last_clean":"2024-08-17T02:25:14.686798+0000","last_became_active":"2024-08-17T02:25:14.681545+0000","last_became_peered":"2024-08-17T02:25:14.681545+0000","last_unstale":"2024-08-17T02:25:14.686798+0000","last_undegraded":"2024-08-17T02:25:14.686798+0000","last_fullsized":"2024-08-17T02:25:14.686798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:59.372660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684978+0000","last_change":"2024-08-17T02:25:14.680092+0000","last_active":"2024-08-17T02:25:14.684978+0000","last_peered":"2024-08-17T02:25:14.684978+0000","last_clean":"2024-08-17T02:25:14.684978+0000","last_became_active":"2024-08-17T02:25:14.677406+0000","last_became_peered":"2024-08-17T02:25:14.677406+0000","last_unstale":"2024-08-17T02:25:14.684978+0000","last_undegraded":"2024-08-17T02:25:14.684978+0000","last_fullsized":"2024-08-17T02:25:14.684978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:12.662553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678115+0000","last_change":"2024-08-17T02:25:14.668666+0000","last_active":"2024-08-17T02:25:14.678115+0000","last_peered":"2024-08-17T02:25:14.678115+0000","last_clean":"2024-08-17T02:25:14.678115+0000","last_became_active":"2024-08-17T02:25:14.668347+0000","last_became_peered":"2024-08-17T02:25:14.668347+0000","last_unstale":"2024-08-17T02:25:14.678115+0000","last_undegraded":"2024-08-17T02:25:14.678115+0000","last_fullsized":"2024-08-17T02:25:14.678115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:27:44.886508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670824+0000","last_change":"2024-08-17T02:25:14.668138+0000","last_active":"2024-08-17T02:25:14.670824+0000","last_peered":"2024-08-17T02:25:14.670824+0000","last_clean":"2024-08-17T02:25:14.670824+0000","last_became_active":"2024-08-17T02:25:14.667760+0000","last_became_peered":"2024-08-17T02:25:14.667760+0000","last_unstale":"2024-08-17T02:25:14.670824+0000","last_undegraded":"2024-08-17T02:25:14.670824+0000","last_fullsized":"2024-08-17T02:25:14.670824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:07.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683761+0000","last_change":"2024-08-17T02:25:14.674636+0000","last_active":"2024-08-17T02:25:14.683761+0000","last_peered":"2024-08-17T02:25:14.683761+0000","last_clean":"2024-08-17T02:25:14.683761+0000","last_became_active":"2024-08-17T02:25:14.674133+0000","last_became_peered":"2024-08-17T02:25:14.674133+0000","last_unstale":"2024-08-17T02:25:14.683761+0000","last_undegraded":"2024-08-17T02:25:14.683761+0000","last_fullsized":"2024-08-17T02:25:14.683761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689013+0000","last_change":"2024-08-17T02:25:14.677807+0000","last_active":"2024-08-17T02:25:14.689013+0000","last_peered":"2024-08-17T02:25:14.689013+0000","last_clean":"2024-08-17T02:25:14.689013+0000","last_became_active":"2024-08-17T02:25:14.677600+0000","last_became_peered":"2024-08-17T02:25:14.677600+0000","last_unstale":"2024-08-17T02:25:14.689013+0000","last_undegraded":"2024-08-17T02:25:14.689013+0000","last_fullsized":"2024-08-17T02:25:14.689013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:20.793789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700661+0000","last_change":"2024-08-17T02:25:13.676038+0000","last_active":"2024-08-17T02:25:14.700661+0000","last_peered":"2024-08-17T02:25:14.700661+0000","last_clean":"2024-08-17T02:25:14.700661+0000","last_became_active":"2024-08-17T02:25:13.675729+0000","last_became_peered":"2024-08-17T02:25:13.675729+0000","last_unstale":"2024-08-17T02:25:14.700661+0000","last_undegraded":"2024-08-17T02:25:14.700661+0000","last_fullsized":"2024-08-17T02:25:14.700661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684995+0000","last_change":"2024-08-17T02:25:14.680735+0000","last_active":"2024-08-17T02:25:14.684995+0000","last_peered":"2024-08-17T02:25:14.684995+0000","last_clean":"2024-08-17T02:25:14.684995+0000","last_became_active":"2024-08-17T02:25:14.679254+0000","last_became_peered":"2024-08-17T02:25:14.679254+0000","last_unstale":"2024-08-17T02:25:14.684995+0000","last_undegraded":"2024-08-17T02:25:14.684995+0000","last_fullsized":"2024-08-17T02:25:14.684995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700214+0000","last_change":"2024-08-17T02:25:13.685739+0000","last_active":"2024-08-17T02:25:14.700214+0000","last_peered":"2024-08-17T02:25:14.700214+0000","last_clean":"2024-08-17T02:25:14.700214+0000","last_became_active":"2024-08-17T02:25:13.685479+0000","last_became_peered":"2024-08-17T02:25:13.685479+0000","last_unstale":"2024-08-17T02:25:14.700214+0000","last_undegraded":"2024-08-17T02:25:14.700214+0000","last_fullsized":"2024-08-17T02:25:14.700214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660450+0000","last_change":"2024-08-17T02:25:13.674789+0000","last_active":"2024-08-17T02:25:14.660450+0000","last_peered":"2024-08-17T02:25:14.660450+0000","last_clean":"2024-08-17T02:25:14.660450+0000","last_became_active":"2024-08-17T02:25:13.674512+0000","last_became_peered":"2024-08-17T02:25:13.674512+0000","last_unstale":"2024-08-17T02:25:14.660450+0000","last_undegraded":"2024-08-17T02:25:14.660450+0000","last_fullsized":"2024-08-17T02:25:14.660450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671875+0000","last_change":"2024-08-17T02:25:14.663923+0000","last_active":"2024-08-17T02:25:14.671875+0000","last_peered":"2024-08-17T02:25:14.671875+0000","last_clean":"2024-08-17T02:25:14.671875+0000","last_became_active":"2024-08-17T02:25:14.663671+0000","last_became_peered":"2024-08-17T02:25:14.663671+0000","last_unstale":"2024-08-17T02:25:14.671875+0000","last_undegraded":"2024-08-17T02:25:14.671875+0000","last_fullsized":"2024-08-17T02:25:14.671875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.659542+0000","last_change":"2024-08-17T02:25:13.679503+0000","last_active":"2024-08-17T02:25:14.659542+0000","last_peered":"2024-08-17T02:25:14.659542+0000","last_clean":"2024-08-17T02:25:14.659542+0000","last_became_active":"2024-08-17T02:25:13.679226+0000","last_became_peered":"2024-08-17T02:25:13.679226+0000","last_unstale":"2024-08-17T02:25:14.659542+0000","last_undegraded":"2024-08-17T02:25:14.659542+0000","last_fullsized":"2024-08-17T02:25:14.659542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678019+0000","last_change":"2024-08-17T02:25:14.675096+0000","last_active":"2024-08-17T02:25:14.678019+0000","last_peered":"2024-08-17T02:25:14.678019+0000","last_clean":"2024-08-17T02:25:14.678019+0000","last_became_active":"2024-08-17T02:25:14.672309+0000","last_became_peered":"2024-08-17T02:25:14.672309+0000","last_unstale":"2024-08-17T02:25:14.678019+0000","last_undegraded":"2024-08-17T02:25:14.678019+0000","last_fullsized":"2024-08-17T02:25:14.678019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.676600+0000","last_change":"2024-08-17T02:25:13.676652+0000","last_active":"2024-08-17T02:25:14.676600+0000","last_peered":"2024-08-17T02:25:14.676600+0000","last_clean":"2024-08-17T02:25:14.676600+0000","last_became_active":"2024-08-17T02:25:13.676364+0000","last_became_peered":"2024-08-17T02:25:13.676364+0000","last_unstale":"2024-08-17T02:25:14.676600+0000","last_undegraded":"2024-08-17T02:25:14.676600+0000","last_fullsized":"2024-08-17T02:25:14.676600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.682522+0000","last_change":"2024-08-17T02:25:14.672988+0000","last_active":"2024-08-17T02:25:14.682522+0000","last_peered":"2024-08-17T02:25:14.682522+0000","last_clean":"2024-08-17T02:25:14.682522+0000","last_became_active":"2024-08-17T02:25:14.672662+0000","last_became_peered":"2024-08-17T02:25:14.672662+0000","last_unstale":"2024-08-17T02:25:14.682522+0000","last_undegraded":"2024-08-17T02:25:14.682522+0000","last_fullsized":"2024-08-17T02:25:14.682522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658744+0000","last_change":"2024-08-17T02:25:13.676993+0000","last_active":"2024-08-17T02:25:14.658744+0000","last_peered":"2024-08-17T02:25:14.658744+0000","last_clean":"2024-08-17T02:25:14.658744+0000","last_became_active":"2024-08-17T02:25:13.674529+0000","last_became_peered":"2024-08-17T02:25:13.674529+0000","last_unstale":"2024-08-17T02:25:14.658744+0000","last_undegraded":"2024-08-17T02:25:14.658744+0000","last_fullsized":"2024-08-17T02:25:14.658744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681456+0000","last_change":"2024-08-17T02:25:14.677046+0000","last_active":"2024-08-17T02:25:14.681456+0000","last_peered":"2024-08-17T02:25:14.681456+0000","last_clean":"2024-08-17T02:25:14.681456+0000","last_became_active":"2024-08-17T02:25:14.676726+0000","last_became_peered":"2024-08-17T02:25:14.676726+0000","last_unstale":"2024-08-17T02:25:14.681456+0000","last_undegraded":"2024-08-17T02:25:14.681456+0000","last_fullsized":"2024-08-17T02:25:14.681456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700073+0000","last_change":"2024-08-17T02:25:13.685185+0000","last_active":"2024-08-17T02:25:14.700073+0000","last_peered":"2024-08-17T02:25:14.700073+0000","last_clean":"2024-08-17T02:25:14.700073+0000","last_became_active":"2024-08-17T02:25:13.684855+0000","last_became_peered":"2024-08-17T02:25:13.684855+0000","last_unstale":"2024-08-17T02:25:14.700073+0000","last_undegraded":"2024-08-17T02:25:14.700073+0000","last_fullsized":"2024-08-17T02:25:14.700073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689679+0000","last_change":"2024-08-17T02:25:14.684052+0000","last_active":"2024-08-17T02:25:14.689679+0000","last_peered":"2024-08-17T02:25:14.689679+0000","last_clean":"2024-08-17T02:25:14.689679+0000","last_became_active":"2024-08-17T02:25:14.682595+0000","last_became_peered":"2024-08-17T02:25:14.682595+0000","last_unstale":"2024-08-17T02:25:14.689679+0000","last_undegraded":"2024-08-17T02:25:14.689679+0000","last_fullsized":"2024-08-17T02:25:14.689679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:49.693684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.702862+0000","last_change":"2024-08-17T02:25:13.679399+0000","last_active":"2024-08-17T02:25:14.702862+0000","last_peered":"2024-08-17T02:25:14.702862+0000","last_clean":"2024-08-17T02:25:14.702862+0000","last_became_active":"2024-08-17T02:25:13.679142+0000","last_became_peered":"2024-08-17T02:25:13.679142+0000","last_unstale":"2024-08-17T02:25:14.702862+0000","last_undegraded":"2024-08-17T02:25:14.702862+0000","last_fullsized":"2024-08-17T02:25:14.702862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690311+0000","last_change":"2024-08-17T02:25:14.682175+0000","last_active":"2024-08-17T02:25:14.690311+0000","last_peered":"2024-08-17T02:25:14.690311+0000","last_clean":"2024-08-17T02:25:14.690311+0000","last_became_active":"2024-08-17T02:25:14.681498+0000","last_became_peered":"2024-08-17T02:25:14.681498+0000","last_unstale":"2024-08-17T02:25:14.690311+0000","last_undegraded":"2024-08-17T02:25:14.690311+0000","last_fullsized":"2024-08-17T02:25:14.690311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699519+0000","last_change":"2024-08-17T02:25:13.681889+0000","last_active":"2024-08-17T02:25:14.699519+0000","last_peered":"2024-08-17T02:25:14.699519+0000","last_clean":"2024-08-17T02:25:14.699519+0000","last_became_active":"2024-08-17T02:25:13.681485+0000","last_became_peered":"2024-08-17T02:25:13.681485+0000","last_unstale":"2024-08-17T02:25:14.699519+0000","last_undegraded":"2024-08-17T02:25:14.699519+0000","last_fullsized":"2024-08-17T02:25:14.699519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683304+0000","last_change":"2024-08-17T02:25:14.678042+0000","last_active":"2024-08-17T02:25:14.683304+0000","last_peered":"2024-08-17T02:25:14.683304+0000","last_clean":"2024-08-17T02:25:14.683304+0000","last_became_active":"2024-08-17T02:25:14.677441+0000","last_became_peered":"2024-08-17T02:25:14.677441+0000","last_unstale":"2024-08-17T02:25:14.683304+0000","last_undegraded":"2024-08-17T02:25:14.683304+0000","last_fullsized":"2024-08-17T02:25:14.683304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658041+0000","last_change":"2024-08-17T02:25:13.672280+0000","last_active":"2024-08-17T02:25:14.658041+0000","last_peered":"2024-08-17T02:25:14.658041+0000","last_clean":"2024-08-17T02:25:14.658041+0000","last_became_active":"2024-08-17T02:25:13.672021+0000","last_became_peered":"2024-08-17T02:25:13.672021+0000","last_unstale":"2024-08-17T02:25:14.658041+0000","last_undegraded":"2024-08-17T02:25:14.658041+0000","last_fullsized":"2024-08-17T02:25:14.658041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694737+0000","last_change":"2024-08-17T02:25:14.690951+0000","last_active":"2024-08-17T02:25:14.694737+0000","last_peered":"2024-08-17T02:25:14.694737+0000","last_clean":"2024-08-17T02:25:14.694737+0000","last_became_active":"2024-08-17T02:25:14.690640+0000","last_became_peered":"2024-08-17T02:25:14.690640+0000","last_unstale":"2024-08-17T02:25:14.694737+0000","last_undegraded":"2024-08-17T02:25:14.694737+0000","last_fullsized":"2024-08-17T02:25:14.694737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:38.177445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.666609+0000","last_change":"2024-08-17T02:25:13.678799+0000","last_active":"2024-08-17T02:25:14.666609+0000","last_peered":"2024-08-17T02:25:14.666609+0000","last_clean":"2024-08-17T02:25:14.666609+0000","last_became_active":"2024-08-17T02:25:13.678338+0000","last_became_peered":"2024-08-17T02:25:13.678338+0000","last_unstale":"2024-08-17T02:25:14.666609+0000","last_undegraded":"2024-08-17T02:25:14.666609+0000","last_fullsized":"2024-08-17T02:25:14.666609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684933+0000","last_change":"2024-08-17T02:25:14.677309+0000","last_active":"2024-08-17T02:25:14.684933+0000","last_peered":"2024-08-17T02:25:14.684933+0000","last_clean":"2024-08-17T02:25:14.684933+0000","last_became_active":"2024-08-17T02:25:14.673828+0000","last_became_peered":"2024-08-17T02:25:14.673828+0000","last_unstale":"2024-08-17T02:25:14.684933+0000","last_undegraded":"2024-08-17T02:25:14.684933+0000","last_fullsized":"2024-08-17T02:25:14.684933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.701579+0000","last_change":"2024-08-17T02:25:13.679207+0000","last_active":"2024-08-17T02:25:14.701579+0000","last_peered":"2024-08-17T02:25:14.701579+0000","last_clean":"2024-08-17T02:25:14.701579+0000","last_became_active":"2024-08-17T02:25:13.678895+0000","last_became_peered":"2024-08-17T02:25:13.678895+0000","last_unstale":"2024-08-17T02:25:14.701579+0000","last_undegraded":"2024-08-17T02:25:14.701579+0000","last_fullsized":"2024-08-17T02:25:14.701579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693362+0000","last_change":"2024-08-17T02:25:14.684764+0000","last_active":"2024-08-17T02:25:14.693362+0000","last_peered":"2024-08-17T02:25:14.693362+0000","last_clean":"2024-08-17T02:25:14.693362+0000","last_became_active":"2024-08-17T02:25:14.682919+0000","last_became_peered":"2024-08-17T02:25:14.682919+0000","last_unstale":"2024-08-17T02:25:14.693362+0000","last_undegraded":"2024-08-17T02:25:14.693362+0000","last_fullsized":"2024-08-17T02:25:14.693362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:22.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699314+0000","last_change":"2024-08-17T02:25:13.680283+0000","last_active":"2024-08-17T02:25:14.699314+0000","last_peered":"2024-08-17T02:25:14.699314+0000","last_clean":"2024-08-17T02:25:14.699314+0000","last_became_active":"2024-08-17T02:25:13.679891+0000","last_became_peered":"2024-08-17T02:25:13.679891+0000","last_unstale":"2024-08-17T02:25:14.699314+0000","last_undegraded":"2024-08-17T02:25:14.699314+0000","last_fullsized":"2024-08-17T02:25:14.699314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694975+0000","last_change":"2024-08-17T02:25:14.691471+0000","last_active":"2024-08-17T02:25:14.694975+0000","last_peered":"2024-08-17T02:25:14.694975+0000","last_clean":"2024-08-17T02:25:14.694975+0000","last_became_active":"2024-08-17T02:25:14.691171+0000","last_became_peered":"2024-08-17T02:25:14.691171+0000","last_unstale":"2024-08-17T02:25:14.694975+0000","last_undegraded":"2024-08-17T02:25:14.694975+0000","last_fullsized":"2024-08-17T02:25:14.694975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:19.535692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700333+0000","last_change":"2024-08-17T02:25:13.677536+0000","last_active":"2024-08-17T02:25:14.700333+0000","last_peered":"2024-08-17T02:25:14.700333+0000","last_clean":"2024-08-17T02:25:14.700333+0000","last_became_active":"2024-08-17T02:25:13.675183+0000","last_became_peered":"2024-08-17T02:25:13.675183+0000","last_unstale":"2024-08-17T02:25:14.700333+0000","last_undegraded":"2024-08-17T02:25:14.700333+0000","last_fullsized":"2024-08-17T02:25:14.700333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.695063+0000","last_change":"2024-08-17T02:25:14.692018+0000","last_active":"2024-08-17T02:25:14.695063+0000","last_peered":"2024-08-17T02:25:14.695063+0000","last_clean":"2024-08-17T02:25:14.695063+0000","last_became_active":"2024-08-17T02:25:14.691753+0000","last_became_peered":"2024-08-17T02:25:14.691753+0000","last_unstale":"2024-08-17T02:25:14.695063+0000","last_undegraded":"2024-08-17T02:25:14.695063+0000","last_fullsized":"2024-08-17T02:25:14.695063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:57.832736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699649+0000","last_change":"2024-08-17T02:25:13.684009+0000","last_active":"2024-08-17T02:25:14.699649+0000","last_peered":"2024-08-17T02:25:14.699649+0000","last_clean":"2024-08-17T02:25:14.699649+0000","last_became_active":"2024-08-17T02:25:13.683242+0000","last_became_peered":"2024-08-17T02:25:13.683242+0000","last_unstale":"2024-08-17T02:25:14.699649+0000","last_undegraded":"2024-08-17T02:25:14.699649+0000","last_fullsized":"2024-08-17T02:25:14.699649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:48.757464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678098+0000","last_change":"2024-08-17T02:25:14.667634+0000","last_active":"2024-08-17T02:25:14.678098+0000","last_peered":"2024-08-17T02:25:14.678098+0000","last_clean":"2024-08-17T02:25:14.678098+0000","last_became_active":"2024-08-17T02:25:14.667363+0000","last_became_peered":"2024-08-17T02:25:14.667363+0000","last_unstale":"2024-08-17T02:25:14.678098+0000","last_undegraded":"2024-08-17T02:25:14.678098+0000","last_fullsized":"2024-08-17T02:25:14.678098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:59.372660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660728+0000","last_change":"2024-08-17T02:25:13.668855+0000","last_active":"2024-08-17T02:25:14.660728+0000","last_peered":"2024-08-17T02:25:14.660728+0000","last_clean":"2024-08-17T02:25:14.660728+0000","last_became_active":"2024-08-17T02:25:13.668568+0000","last_became_peered":"2024-08-17T02:25:13.668568+0000","last_unstale":"2024-08-17T02:25:14.660728+0000","last_undegraded":"2024-08-17T02:25:14.660728+0000","last_fullsized":"2024-08-17T02:25:14.660728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694943+0000","last_change":"2024-08-17T02:25:14.691327+0000","last_active":"2024-08-17T02:25:14.694943+0000","last_peered":"2024-08-17T02:25:14.694943+0000","last_clean":"2024-08-17T02:25:14.694943+0000","last_became_active":"2024-08-17T02:25:14.690760+0000","last_became_peered":"2024-08-17T02:25:14.690760+0000","last_unstale":"2024-08-17T02:25:14.694943+0000","last_undegraded":"2024-08-17T02:25:14.694943+0000","last_fullsized":"2024-08-17T02:25:14.694943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.664056+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:25:14.664056+0000","last_peered":"2024-08-17T02:25:14.664056+0000","last_clean":"2024-08-17T02:25:14.664056+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:25:14.664056+0000","last_undegraded":"2024-08-17T02:25:14.664056+0000","last_fullsized":"2024-08-17T02:25:14.664056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.657956+0000","last_change":"2024-08-17T02:25:13.671609+0000","last_active":"2024-08-17T02:25:14.657956+0000","last_peered":"2024-08-17T02:25:14.657956+0000","last_clean":"2024-08-17T02:25:14.657956+0000","last_became_active":"2024-08-17T02:25:13.665871+0000","last_became_peered":"2024-08-17T02:25:13.665871+0000","last_unstale":"2024-08-17T02:25:14.657956+0000","last_undegraded":"2024-08-17T02:25:14.657956+0000","last_fullsized":"2024-08-17T02:25:14.657956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679635+0000","last_change":"2024-08-17T02:25:14.671245+0000","last_active":"2024-08-17T02:25:14.679635+0000","last_peered":"2024-08-17T02:25:14.679635+0000","last_clean":"2024-08-17T02:25:14.679635+0000","last_became_active":"2024-08-17T02:25:14.670965+0000","last_became_peered":"2024-08-17T02:25:14.670965+0000","last_unstale":"2024-08-17T02:25:14.679635+0000","last_undegraded":"2024-08-17T02:25:14.679635+0000","last_fullsized":"2024-08-17T02:25:14.679635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.663915+0000","last_change":"2024-08-17T02:25:13.687566+0000","last_active":"2024-08-17T02:25:14.663915+0000","last_peered":"2024-08-17T02:25:14.663915+0000","last_clean":"2024-08-17T02:25:14.663915+0000","last_became_active":"2024-08-17T02:25:13.687289+0000","last_became_peered":"2024-08-17T02:25:13.687289+0000","last_unstale":"2024-08-17T02:25:14.663915+0000","last_undegraded":"2024-08-17T02:25:14.663915+0000","last_fullsized":"2024-08-17T02:25:14.663915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684731+0000","last_change":"2024-08-17T02:25:14.678546+0000","last_active":"2024-08-17T02:25:14.684731+0000","last_peered":"2024-08-17T02:25:14.684731+0000","last_clean":"2024-08-17T02:25:14.684731+0000","last_became_active":"2024-08-17T02:25:14.677779+0000","last_became_peered":"2024-08-17T02:25:14.677779+0000","last_unstale":"2024-08-17T02:25:14.684731+0000","last_undegraded":"2024-08-17T02:25:14.684731+0000","last_fullsized":"2024-08-17T02:25:14.684731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660654+0000","last_change":"2024-08-17T02:25:13.668305+0000","last_active":"2024-08-17T02:25:14.660654+0000","last_peered":"2024-08-17T02:25:14.660654+0000","last_clean":"2024-08-17T02:25:14.660654+0000","last_became_active":"2024-08-17T02:25:13.667891+0000","last_became_peered":"2024-08-17T02:25:13.667891+0000","last_unstale":"2024-08-17T02:25:14.660654+0000","last_undegraded":"2024-08-17T02:25:14.660654+0000","last_fullsized":"2024-08-17T02:25:14.660654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.672921+0000","last_change":"2024-08-17T02:25:14.671227+0000","last_active":"2024-08-17T02:25:14.672921+0000","last_peered":"2024-08-17T02:25:14.672921+0000","last_clean":"2024-08-17T02:25:14.672921+0000","last_became_active":"2024-08-17T02:25:14.670957+0000","last_became_peered":"2024-08-17T02:25:14.670957+0000","last_unstale":"2024-08-17T02:25:14.672921+0000","last_undegraded":"2024-08-17T02:25:14.672921+0000","last_fullsized":"2024-08-17T02:25:14.672921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658042+0000","last_change":"2024-08-17T02:25:13.682523+0000","last_active":"2024-08-17T02:25:14.658042+0000","last_peered":"2024-08-17T02:25:14.658042+0000","last_clean":"2024-08-17T02:25:14.658042+0000","last_became_active":"2024-08-17T02:25:13.681263+0000","last_became_peered":"2024-08-17T02:25:13.681263+0000","last_unstale":"2024-08-17T02:25:14.658042+0000","last_undegraded":"2024-08-17T02:25:14.658042+0000","last_fullsized":"2024-08-17T02:25:14.658042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689867+0000","last_change":"2024-08-17T02:25:14.684673+0000","last_active":"2024-08-17T02:25:14.689867+0000","last_peered":"2024-08-17T02:25:14.689867+0000","last_clean":"2024-08-17T02:25:14.689867+0000","last_became_active":"2024-08-17T02:25:14.684108+0000","last_became_peered":"2024-08-17T02:25:14.684108+0000","last_unstale":"2024-08-17T02:25:14.689867+0000","last_undegraded":"2024-08-17T02:25:14.689867+0000","last_fullsized":"2024-08-17T02:25:14.689867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:49.762929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671095+0000","last_change":"2024-08-17T02:25:13.683299+0000","last_active":"2024-08-17T02:25:14.671095+0000","last_peered":"2024-08-17T02:25:14.671095+0000","last_clean":"2024-08-17T02:25:14.671095+0000","last_became_active":"2024-08-17T02:25:13.682446+0000","last_became_peered":"2024-08-17T02:25:13.682446+0000","last_unstale":"2024-08-17T02:25:14.671095+0000","last_undegraded":"2024-08-17T02:25:14.671095+0000","last_fullsized":"2024-08-17T02:25:14.671095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:48.688219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683680+0000","last_change":"2024-08-17T02:25:14.670920+0000","last_active":"2024-08-17T02:25:14.683680+0000","last_peered":"2024-08-17T02:25:14.683680+0000","last_clean":"2024-08-17T02:25:14.683680+0000","last_became_active":"2024-08-17T02:25:14.670641+0000","last_became_peered":"2024-08-17T02:25:14.670641+0000","last_unstale":"2024-08-17T02:25:14.683680+0000","last_undegraded":"2024-08-17T02:25:14.683680+0000","last_fullsized":"2024-08-17T02:25:14.683680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.666369+0000","last_change":"2024-08-17T02:25:13.686375+0000","last_active":"2024-08-17T02:25:14.666369+0000","last_peered":"2024-08-17T02:25:14.666369+0000","last_clean":"2024-08-17T02:25:14.666369+0000","last_became_active":"2024-08-17T02:25:13.686118+0000","last_became_peered":"2024-08-17T02:25:13.686118+0000","last_unstale":"2024-08-17T02:25:14.666369+0000","last_undegraded":"2024-08-17T02:25:14.666369+0000","last_fullsized":"2024-08-17T02:25:14.666369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:48.688219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.673713+0000","last_change":"2024-08-17T02:25:14.672615+0000","last_active":"2024-08-17T02:25:14.673713+0000","last_peered":"2024-08-17T02:25:14.673713+0000","last_clean":"2024-08-17T02:25:14.673713+0000","last_became_active":"2024-08-17T02:25:14.672282+0000","last_became_peered":"2024-08-17T02:25:14.672282+0000","last_unstale":"2024-08-17T02:25:14.673713+0000","last_undegraded":"2024-08-17T02:25:14.673713+0000","last_fullsized":"2024-08-17T02:25:14.673713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.674136+0000","last_change":"2024-08-17T02:25:13.683744+0000","last_active":"2024-08-17T02:25:14.674136+0000","last_peered":"2024-08-17T02:25:14.674136+0000","last_clean":"2024-08-17T02:25:14.674136+0000","last_became_active":"2024-08-17T02:25:13.683299+0000","last_became_peered":"2024-08-17T02:25:13.683299+0000","last_unstale":"2024-08-17T02:25:14.674136+0000","last_undegraded":"2024-08-17T02:25:14.674136+0000","last_fullsized":"2024-08-17T02:25:14.674136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:06.729225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686757+0000","last_change":"2024-08-17T02:25:14.680936+0000","last_active":"2024-08-17T02:25:14.686757+0000","last_peered":"2024-08-17T02:25:14.686757+0000","last_clean":"2024-08-17T02:25:14.686757+0000","last_became_active":"2024-08-17T02:25:14.680661+0000","last_became_peered":"2024-08-17T02:25:14.680661+0000","last_unstale":"2024-08-17T02:25:14.686757+0000","last_undegraded":"2024-08-17T02:25:14.686757+0000","last_fullsized":"2024-08-17T02:25:14.686757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.701405+0000","last_change":"2024-08-17T02:25:13.677363+0000","last_active":"2024-08-17T02:25:14.701405+0000","last_peered":"2024-08-17T02:25:14.701405+0000","last_clean":"2024-08-17T02:25:14.701405+0000","last_became_active":"2024-08-17T02:25:13.677094+0000","last_became_peered":"2024-08-17T02:25:13.677094+0000","last_unstale":"2024-08-17T02:25:14.701405+0000","last_undegraded":"2024-08-17T02:25:14.701405+0000","last_fullsized":"2024-08-17T02:25:14.701405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686590+0000","last_change":"2024-08-17T02:25:14.683885+0000","last_active":"2024-08-17T02:25:14.686590+0000","last_peered":"2024-08-17T02:25:14.686590+0000","last_clean":"2024-08-17T02:25:14.686590+0000","last_became_active":"2024-08-17T02:25:14.679041+0000","last_became_peered":"2024-08-17T02:25:14.679041+0000","last_unstale":"2024-08-17T02:25:14.686590+0000","last_undegraded":"2024-08-17T02:25:14.686590+0000","last_fullsized":"2024-08-17T02:25:14.686590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.661849+0000","last_change":"2024-08-17T02:25:13.685837+0000","last_active":"2024-08-17T02:25:14.661849+0000","last_peered":"2024-08-17T02:25:14.661849+0000","last_clean":"2024-08-17T02:25:14.661849+0000","last_became_active":"2024-08-17T02:25:13.685565+0000","last_became_peered":"2024-08-17T02:25:13.685565+0000","last_unstale":"2024-08-17T02:25:14.661849+0000","last_undegraded":"2024-08-17T02:25:14.661849+0000","last_fullsized":"2024-08-17T02:25:14.661849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:33.349779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.672818+0000","last_change":"2024-08-17T02:25:14.668966+0000","last_active":"2024-08-17T02:25:14.672818+0000","last_peered":"2024-08-17T02:25:14.672818+0000","last_clean":"2024-08-17T02:25:14.672818+0000","last_became_active":"2024-08-17T02:25:14.668718+0000","last_became_peered":"2024-08-17T02:25:14.668718+0000","last_unstale":"2024-08-17T02:25:14.672818+0000","last_undegraded":"2024-08-17T02:25:14.672818+0000","last_fullsized":"2024-08-17T02:25:14.672818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:34.355244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670142+0000","last_change":"2024-08-17T02:25:13.687912+0000","last_active":"2024-08-17T02:25:14.670142+0000","last_peered":"2024-08-17T02:25:14.670142+0000","last_clean":"2024-08-17T02:25:14.670142+0000","last_became_active":"2024-08-17T02:25:13.687603+0000","last_became_peered":"2024-08-17T02:25:13.687603+0000","last_unstale":"2024-08-17T02:25:14.670142+0000","last_undegraded":"2024-08-17T02:25:14.670142+0000","last_fullsized":"2024-08-17T02:25:14.670142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:33.349779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679271+0000","last_change":"2024-08-17T02:25:14.674759+0000","last_active":"2024-08-17T02:25:14.679271+0000","last_peered":"2024-08-17T02:25:14.679271+0000","last_clean":"2024-08-17T02:25:14.679271+0000","last_became_active":"2024-08-17T02:25:14.674396+0000","last_became_peered":"2024-08-17T02:25:14.674396+0000","last_unstale":"2024-08-17T02:25:14.679271+0000","last_undegraded":"2024-08-17T02:25:14.679271+0000","last_fullsized":"2024-08-17T02:25:14.679271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671878+0000","last_change":"2024-08-17T02:25:13.678511+0000","last_active":"2024-08-17T02:25:14.671878+0000","last_peered":"2024-08-17T02:25:14.671878+0000","last_clean":"2024-08-17T02:25:14.671878+0000","last_became_active":"2024-08-17T02:25:13.678154+0000","last_became_peered":"2024-08-17T02:25:13.678154+0000","last_unstale":"2024-08-17T02:25:14.671878+0000","last_undegraded":"2024-08-17T02:25:14.671878+0000","last_fullsized":"2024-08-17T02:25:14.671878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670650+0000","last_change":"2024-08-17T02:25:14.664508+0000","last_active":"2024-08-17T02:25:14.670650+0000","last_peered":"2024-08-17T02:25:14.670650+0000","last_clean":"2024-08-17T02:25:14.670650+0000","last_became_active":"2024-08-17T02:25:14.664227+0000","last_became_peered":"2024-08-17T02:25:14.664227+0000","last_unstale":"2024-08-17T02:25:14.670650+0000","last_undegraded":"2024-08-17T02:25:14.670650+0000","last_fullsized":"2024-08-17T02:25:14.670650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700270+0000","last_change":"2024-08-17T02:25:13.688660+0000","last_active":"2024-08-17T02:25:14.700270+0000","last_peered":"2024-08-17T02:25:14.700270+0000","last_clean":"2024-08-17T02:25:14.700270+0000","last_became_active":"2024-08-17T02:25:13.688164+0000","last_became_peered":"2024-08-17T02:25:13.688164+0000","last_unstale":"2024-08-17T02:25:14.700270+0000","last_undegraded":"2024-08-17T02:25:14.700270+0000","last_fullsized":"2024-08-17T02:25:14.700270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:48.757464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.685034+0000","last_change":"2024-08-17T02:25:14.673503+0000","last_active":"2024-08-17T02:25:14.685034+0000","last_peered":"2024-08-17T02:25:14.685034+0000","last_clean":"2024-08-17T02:25:14.685034+0000","last_became_active":"2024-08-17T02:25:14.673240+0000","last_became_peered":"2024-08-17T02:25:14.673240+0000","last_unstale":"2024-08-17T02:25:14.685034+0000","last_undegraded":"2024-08-17T02:25:14.685034+0000","last_fullsized":"2024-08-17T02:25:14.685034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683703+0000","last_change":"2024-08-17T02:25:14.676439+0000","last_active":"2024-08-17T02:25:14.683703+0000","last_peered":"2024-08-17T02:25:14.683703+0000","last_clean":"2024-08-17T02:25:14.683703+0000","last_became_active":"2024-08-17T02:25:14.676156+0000","last_became_peered":"2024-08-17T02:25:14.676156+0000","last_unstale":"2024-08-17T02:25:14.683703+0000","last_undegraded":"2024-08-17T02:25:14.683703+0000","last_fullsized":"2024-08-17T02:25:14.683703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:19.535692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700344+0000","last_change":"2024-08-17T02:25:13.686099+0000","last_active":"2024-08-17T02:25:14.700344+0000","last_peered":"2024-08-17T02:25:14.700344+0000","last_clean":"2024-08-17T02:25:14.700344+0000","last_became_active":"2024-08-17T02:25:13.685723+0000","last_became_peered":"2024-08-17T02:25:13.685723+0000","last_unstale":"2024-08-17T02:25:14.700344+0000","last_undegraded":"2024-08-17T02:25:14.700344+0000","last_fullsized":"2024-08-17T02:25:14.700344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:06.729225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684455+0000","last_change":"2024-08-17T02:25:14.678735+0000","last_active":"2024-08-17T02:25:14.684455+0000","last_peered":"2024-08-17T02:25:14.684455+0000","last_clean":"2024-08-17T02:25:14.684455+0000","last_became_active":"2024-08-17T02:25:14.676285+0000","last_became_peered":"2024-08-17T02:25:14.676285+0000","last_unstale":"2024-08-17T02:25:14.684455+0000","last_undegraded":"2024-08-17T02:25:14.684455+0000","last_fullsized":"2024-08-17T02:25:14.684455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:22.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700787+0000","last_change":"2024-08-17T02:25:13.686181+0000","last_active":"2024-08-17T02:25:14.700787+0000","last_peered":"2024-08-17T02:25:14.700787+0000","last_clean":"2024-08-17T02:25:14.700787+0000","last_became_active":"2024-08-17T02:25:13.685840+0000","last_became_peered":"2024-08-17T02:25:13.685840+0000","last_unstale":"2024-08-17T02:25:14.700787+0000","last_undegraded":"2024-08-17T02:25:14.700787+0000","last_fullsized":"2024-08-17T02:25:14.700787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681432+0000","last_change":"2024-08-17T02:25:14.677008+0000","last_active":"2024-08-17T02:25:14.681432+0000","last_peered":"2024-08-17T02:25:14.681432+0000","last_clean":"2024-08-17T02:25:14.681432+0000","last_became_active":"2024-08-17T02:25:14.675860+0000","last_became_peered":"2024-08-17T02:25:14.675860+0000","last_unstale":"2024-08-17T02:25:14.681432+0000","last_undegraded":"2024-08-17T02:25:14.681432+0000","last_fullsized":"2024-08-17T02:25:14.681432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699765+0000","last_change":"2024-08-17T02:25:13.680804+0000","last_active":"2024-08-17T02:25:14.699765+0000","last_peered":"2024-08-17T02:25:14.699765+0000","last_clean":"2024-08-17T02:25:14.699765+0000","last_became_active":"2024-08-17T02:25:13.679930+0000","last_became_peered":"2024-08-17T02:25:13.679930+0000","last_unstale":"2024-08-17T02:25:14.699765+0000","last_undegraded":"2024-08-17T02:25:14.699765+0000","last_fullsized":"2024-08-17T02:25:14.699765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.685317+0000","last_change":"2024-08-17T02:25:14.678511+0000","last_active":"2024-08-17T02:25:14.685317+0000","last_peered":"2024-08-17T02:25:14.685317+0000","last_clean":"2024-08-17T02:25:14.685317+0000","last_became_active":"2024-08-17T02:25:14.677265+0000","last_became_peered":"2024-08-17T02:25:14.677265+0000","last_unstale":"2024-08-17T02:25:14.685317+0000","last_undegraded":"2024-08-17T02:25:14.685317+0000","last_fullsized":"2024-08-17T02:25:14.685317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700062+0000","last_change":"2024-08-17T02:25:13.688293+0000","last_active":"2024-08-17T02:25:14.700062+0000","last_peered":"2024-08-17T02:25:14.700062+0000","last_clean":"2024-08-17T02:25:14.700062+0000","last_became_active":"2024-08-17T02:25:13.688046+0000","last_became_peered":"2024-08-17T02:25:13.688046+0000","last_unstale":"2024-08-17T02:25:14.700062+0000","last_undegraded":"2024-08-17T02:25:14.700062+0000","last_fullsized":"2024-08-17T02:25:14.700062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301728,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070112,"statfs":{"total":96636764160,"available":96327794688,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301712,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070128,"statfs":{"total":96636764160,"available":96327811072,"internally_reserved":0,"allocated":192512,"data_stored":64366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:19.691 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-08-17T02:25:19.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.874+0000 7f5747c00640 1 Processor -- start 2024-08-17T02:25:19.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.875+0000 7f5747c00640 1 -- start start 2024-08-17T02:25:19.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.876+0000 7f5747c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5740155a20 0x7f57400adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.876+0000 7f5747c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5740156670 con 0x7f574006df00 2024-08-17T02:25:19.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.876+0000 7f5747c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574006e5e0 con 0x7f5740155df0 2024-08-17T02:25:19.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.876+0000 7f5747c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57400b0350 con 0x7f5740155a20 2024-08-17T02:25:19.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.876+0000 7f5745c00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f574006df00 0x7f5740156b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:49220/0 (socket says 172.21.15.45:49220) 2024-08-17T02:25:19.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.876+0000 7f5745c00640 1 -- 172.21.15.45:0/850705199 learned_addr learned my addr 172.21.15.45:0/850705199 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:19.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.876+0000 7f5745200640 1 --2- 172.21.15.45:0/850705199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5740155a20 0x7f57400adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.876+0000 7f573f400640 1 -- 172.21.15.45:0/850705199 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2295229789 0 0) 0x7f5740156670 con 0x7f574006df00 2024-08-17T02:25:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.876+0000 7f573f400640 1 -- 172.21.15.45:0/850705199 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57280034e0 con 0x7f574006df00 2024-08-17T02:25:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.877+0000 7f5745200640 1 -- 172.21.15.45:0/850705199 >> v1:172.21.15.169:6789/0 conn(0x7f5740155df0 legacy=0x7f574006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.877+0000 7f573f400640 1 -- 172.21.15.45:0/850705199 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679491083 0 0) 0x7f574006e5e0 con 0x7f5740155df0 2024-08-17T02:25:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.877+0000 7f5745200640 1 -- 172.21.15.45:0/850705199 >> v1:172.21.15.45:6789/0 conn(0x7f574006df00 legacy=0x7f5740156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.877+0000 7f5745200640 1 -- 172.21.15.45:0/850705199 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574006e8c0 con 0x7f5740155a20 2024-08-17T02:25:19.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.878+0000 7f5745200640 1 --2- 172.21.15.45:0/850705199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5740155a20 0x7f57400adf10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5734009880 tx=0x7f57340090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91f134d29dc35d97 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.878+0000 7f573f400640 1 -- 172.21.15.45:0/850705199 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573402ae10 con 0x7f5740155a20 2024-08-17T02:25:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.878+0000 7f573f400640 1 -- 172.21.15.45:0/850705199 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5734032440 con 0x7f5740155a20 2024-08-17T02:25:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.878+0000 7f573f400640 1 -- 172.21.15.45:0/850705199 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57340327e0 con 0x7f5740155a20 2024-08-17T02:25:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.879+0000 7f5747c00640 1 -- 172.21.15.45:0/850705199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5740155a20 msgr2=0x7f57400adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.879+0000 7f5747c00640 1 --2- 172.21.15.45:0/850705199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5740155a20 0x7f57400adf10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5734009880 tx=0x7f57340090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.879+0000 7f5747c00640 1 -- 172.21.15.45:0/850705199 shutdown_connections 2024-08-17T02:25:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.879+0000 7f5747c00640 1 --2- 172.21.15.45:0/850705199 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5740155a20 0x7f57400adf10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.879+0000 7f5747c00640 1 -- 172.21.15.45:0/850705199 >> 172.21.15.45:0/850705199 conn(0x7f57400cb9b0 msgr2=0x7f57400cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.879+0000 7f5747c00640 1 -- 172.21.15.45:0/850705199 shutdown_connections 2024-08-17T02:25:19.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.879+0000 7f5747c00640 1 -- 172.21.15.45:0/850705199 wait complete. 2024-08-17T02:25:19.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.880+0000 7f5747c00640 1 Processor -- start 2024-08-17T02:25:19.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.880+0000 7f5747c00640 1 -- start start 2024-08-17T02:25:19.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.881+0000 7f5747c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f574006df00 0x7f57400ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.881+0000 7f5747c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5740155a20 0x7f57400cae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.881+0000 7f5747c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5740155df0 0x7f57400cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.881+0000 7f5747c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574006a140 con 0x7f5740155a20 2024-08-17T02:25:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.881+0000 7f5747c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57400aa8d0 con 0x7f574006df00 2024-08-17T02:25:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.881+0000 7f5747c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57400a9fa0 con 0x7f5740155df0 2024-08-17T02:25:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.881+0000 7f573fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5740155a20 0x7f57400cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.881+0000 7f573fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5740155a20 0x7f57400cae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34338/0 (socket says 172.21.15.45:34338) 2024-08-17T02:25:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f573fe00640 1 -- 172.21.15.45:0/2540337784 learned_addr learned my addr 172.21.15.45:0/2540337784 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f5745c00640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5740155df0 0x7f57400cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f5745200640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f574006df00 0x7f57400ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f573fe00640 1 -- 172.21.15.45:0/2540337784 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5740155df0 msgr2=0x7f57400cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f573fe00640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5740155df0 0x7f57400cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f573fe00640 1 -- 172.21.15.45:0/2540337784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f574006df00 msgr2=0x7f57400ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:19.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f573fe00640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f574006df00 0x7f57400ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:19.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f573fe00640 1 -- 172.21.15.45:0/2540337784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5734009390 con 0x7f5740155a20 2024-08-17T02:25:19.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f5745200640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f574006df00 0x7f57400ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f573fe00640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5740155a20 0x7f57400cae60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f572c00c4e0 tx=0x7f572c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f5733e00640 1 -- 172.21.15.45:0/2540337784 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c011590 con 0x7f5740155a20 2024-08-17T02:25:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f5733e00640 1 -- 172.21.15.45:0/2540337784 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c0116f0 con 0x7f5740155a20 2024-08-17T02:25:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f5747c00640 1 -- 172.21.15.45:0/2540337784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57400aa280 con 0x7f5740155a20 2024-08-17T02:25:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.882+0000 7f5733e00640 1 -- 172.21.15.45:0/2540337784 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c011af0 con 0x7f5740155a20 2024-08-17T02:25:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.883+0000 7f5747c00640 1 -- 172.21.15.45:0/2540337784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5740143fb0 con 0x7f5740155a20 2024-08-17T02:25:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.884+0000 7f5747c00640 1 -- 172.21.15.45:0/2540337784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57400aaa80 con 0x7f5740155a20 2024-08-17T02:25:19.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.884+0000 7f5733e00640 1 -- 172.21.15.45:0/2540337784 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f572c01b3b0 con 0x7f5740155a20 2024-08-17T02:25:19.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.885+0000 7f5733e00640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5720065150 0x7f5720067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:19.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.885+0000 7f5733e00640 1 -- 172.21.15.45:0/2540337784 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f572c081a00 con 0x7f5740155a20 2024-08-17T02:25:19.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.885+0000 7f5745200640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5720065150 0x7f5720067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:19.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.886+0000 7f5745200640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5720065150 0x7f5720067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5734034000 tx=0x7f5734032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:19.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:19.889+0000 7f5733e00640 1 -- 172.21.15.45:0/2540337784 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f57400aaa80 con 0x7f5740155a20 2024-08-17T02:25:20.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.137+0000 7f5747c00640 1 -- 172.21.15.45:0/2540337784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f57400aa700 con 0x7f5740155a20 2024-08-17T02:25:20.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.138+0000 7f5733e00640 1 -- 172.21.15.45:0/2540337784 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1013 (secure 0 0 0) 0x7f572c017080 con 0x7f5740155a20 2024-08-17T02:25:20.139 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:20.139 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1723861502,"num_in_osds":8,"osd_in_since":1723861493,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592706,"bytes_used":2455883776,"bytes_avail":770638229504,"bytes_total":773094113280,"write_bytes_sec":2216,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4291}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-08-17T02:24:50.985337+0000","services":{}},"progress_events":{}} 2024-08-17T02:25:20.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 -- 172.21.15.45:0/2540337784 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5720065150 msgr2=0x7f5720067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5720065150 0x7f5720067600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5734034000 tx=0x7f5734032000 comp rx=0 tx=0).stop 2024-08-17T02:25:20.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 -- 172.21.15.45:0/2540337784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5740155a20 msgr2=0x7f57400cae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5740155a20 0x7f57400cae60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f572c00c4e0 tx=0x7f572c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 -- 172.21.15.45:0/2540337784 shutdown_connections 2024-08-17T02:25:20.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5720065150 0x7f5720067600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5740155df0 0x7f57400cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5740155a20 0x7f57400cae60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 --2- 172.21.15.45:0/2540337784 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f574006df00 0x7f57400ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 -- 172.21.15.45:0/2540337784 >> 172.21.15.45:0/2540337784 conn(0x7f57400cb9b0 msgr2=0x7f57400ad690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 -- 172.21.15.45:0/2540337784 shutdown_connections 2024-08-17T02:25:20.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.140+0000 7f5747c00640 1 -- 172.21.15.45:0/2540337784 wait complete. 2024-08-17T02:25:20.156 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-08-17T02:25:20.156 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:20.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.306+0000 7f73f7a00640 1 Processor -- start 2024-08-17T02:25:20.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.306+0000 7f73f7a00640 1 -- start start 2024-08-17T02:25:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.307+0000 7f73f7a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 0x7f73f00caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.307+0000 7f73f7a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f73f0140580 0x7f73f00b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.307+0000 7f73f7a00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f00b16d0 con 0x7f73f00b1270 2024-08-17T02:25:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.307+0000 7f73f7a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f00cb450 con 0x7f73f0140580 2024-08-17T02:25:20.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.307+0000 7f73f7a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00caa80 con 0x7f73f01401b0 2024-08-17T02:25:20.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.307+0000 7f73f5000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 0x7f73f00caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.307+0000 7f73f5000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 0x7f73f00caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:47494/0 (socket says 172.21.15.45:47494) 2024-08-17T02:25:20.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.307+0000 7f73f5000640 1 -- 172.21.15.45:0/2686166867 learned_addr learned my addr 172.21.15.45:0/2686166867 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:20.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.308+0000 7f73efe00640 1 --2- 172.21.15.45:0/2686166867 >> v2:172.21.15.169:3300/0 conn(0x7f73f0140580 0x7f73f00b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.308+0000 7f73f5000640 1 -- 172.21.15.45:0/2686166867 >> v2:172.21.15.169:3300/0 conn(0x7f73f0140580 msgr2=0x7f73f00b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:20.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.308+0000 7f73f5000640 1 --2- 172.21.15.45:0/2686166867 >> v2:172.21.15.169:3300/0 conn(0x7f73f0140580 0x7f73f00b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.308+0000 7f73f5000640 1 -- 172.21.15.45:0/2686166867 >> v1:172.21.15.169:6789/0 conn(0x7f73f00b1270 legacy=0x7f73f00c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.308+0000 7f73f5000640 1 -- 172.21.15.45:0/2686166867 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f00c9e70 con 0x7f73f01401b0 2024-08-17T02:25:20.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.309+0000 7f73f5000640 1 --2- 172.21.15.45:0/2686166867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 0x7f73f00caf10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009910 tx=0x7f73e40091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91aa4195bac91852 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.309+0000 7f73ef400640 1 -- 172.21.15.45:0/2686166867 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e402adb0 con 0x7f73f01401b0 2024-08-17T02:25:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.309+0000 7f73ef400640 1 -- 172.21.15.45:0/2686166867 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e4032440 con 0x7f73f01401b0 2024-08-17T02:25:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.309+0000 7f73ef400640 1 -- 172.21.15.45:0/2686166867 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4032820 con 0x7f73f01401b0 2024-08-17T02:25:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.310+0000 7f73f7a00640 1 -- 172.21.15.45:0/2686166867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 msgr2=0x7f73f00caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.310+0000 7f73f7a00640 1 --2- 172.21.15.45:0/2686166867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 0x7f73f00caf10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f73e4009910 tx=0x7f73e40091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.310+0000 7f73f7a00640 1 -- 172.21.15.45:0/2686166867 shutdown_connections 2024-08-17T02:25:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.310+0000 7f73f7a00640 1 --2- 172.21.15.45:0/2686166867 >> v2:172.21.15.169:3300/0 conn(0x7f73f0140580 0x7f73f00b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.310+0000 7f73f7a00640 1 --2- 172.21.15.45:0/2686166867 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 0x7f73f00caf10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.310+0000 7f73f7a00640 1 -- 172.21.15.45:0/2686166867 >> 172.21.15.45:0/2686166867 conn(0x7f73f00cb9b0 msgr2=0x7f73f00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.310+0000 7f73f7a00640 1 -- 172.21.15.45:0/2686166867 shutdown_connections 2024-08-17T02:25:20.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.310+0000 7f73f7a00640 1 -- 172.21.15.45:0/2686166867 wait complete. 2024-08-17T02:25:20.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.311+0000 7f73f7a00640 1 Processor -- start 2024-08-17T02:25:20.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.311+0000 7f73f7a00640 1 -- start start 2024-08-17T02:25:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.312+0000 7f73f7a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f00b1270 0x7f73f0134360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.312+0000 7f73f7a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 0x7f73f00aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.312+0000 7f73f7a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f0140580 0x7f73f015c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.312+0000 7f73f7a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f0131b40 con 0x7f73f00b1270 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.312+0000 7f73f7a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00ab550 con 0x7f73f0140580 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.312+0000 7f73f7a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f00aefc0 con 0x7f73f01401b0 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73f5000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f00b1270 0x7f73f0134360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73f5000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f00b1270 0x7f73f0134360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34342/0 (socket says 172.21.15.45:34342) 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73f5000640 1 -- 172.21.15.45:0/3741650965 learned_addr learned my addr 172.21.15.45:0/3741650965 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73efe00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 0x7f73f00aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73f5000640 1 -- 172.21.15.45:0/3741650965 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 msgr2=0x7f73f00aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73f5000640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 0x7f73f00aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73f5000640 1 -- 172.21.15.45:0/3741650965 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f0140580 msgr2=0x7f73f015c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73f5a00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f0140580 0x7f73f015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73f5000640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f0140580 0x7f73f015c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73f5000640 1 -- 172.21.15.45:0/3741650965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4009450 con 0x7f73f00b1270 2024-08-17T02:25:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73efe00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 0x7f73f00aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73f5a00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f0140580 0x7f73f015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.313+0000 7f73f5000640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f00b1270 0x7f73f0134360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73e4035040 tx=0x7f73e4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.314+0000 7f73e3e00640 1 -- 172.21.15.45:0/3741650965 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4031bb0 con 0x7f73f00b1270 2024-08-17T02:25:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.314+0000 7f73e3e00640 1 -- 172.21.15.45:0/3741650965 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e4031d50 con 0x7f73f00b1270 2024-08-17T02:25:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.314+0000 7f73f7a00640 1 -- 172.21.15.45:0/3741650965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f00aaf90 con 0x7f73f00b1270 2024-08-17T02:25:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.314+0000 7f73e3e00640 1 -- 172.21.15.45:0/3741650965 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e403d690 con 0x7f73f00b1270 2024-08-17T02:25:20.316 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.314+0000 7f73f7a00640 1 -- 172.21.15.45:0/3741650965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f00aec50 con 0x7f73f00b1270 2024-08-17T02:25:20.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.315+0000 7f73f7a00640 1 -- 172.21.15.45:0/3741650965 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f0064db0 con 0x7f73f00b1270 2024-08-17T02:25:20.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.316+0000 7f73e3e00640 1 -- 172.21.15.45:0/3741650965 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f73e4039040 con 0x7f73f00b1270 2024-08-17T02:25:20.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.316+0000 7f73e3e00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065150 0x7f73d0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:20.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.316+0000 7f73e3e00640 1 -- 172.21.15.45:0/3741650965 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73e40a26c0 con 0x7f73f00b1270 2024-08-17T02:25:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.317+0000 7f73efe00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065150 0x7f73d0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:20.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.317+0000 7f73efe00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065150 0x7f73d0067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f73dc006e70 tx=0x7f73dc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:20.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.320+0000 7f73e3e00640 1 -- 172.21.15.45:0/3741650965 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f73e40706e0 con 0x7f73f00b1270 2024-08-17T02:25:20.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.496+0000 7f73f7a00640 1 -- 172.21.15.45:0/3741650965 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73f006a540 con 0x7f73d0065150 2024-08-17T02:25:20.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.503+0000 7f73e3e00640 1 -- 172.21.15.45:0/3741650965 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264680 (secure 0 0 0) 0x7f73f006a540 con 0x7f73d0065150 2024-08-17T02:25:20.507 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:20.509 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:25:20.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 -- 172.21.15.45:0/3741650965 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065150 msgr2=0x7f73d0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065150 0x7f73d0067600 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f73dc006e70 tx=0x7f73dc008040 comp rx=0 tx=0).stop 2024-08-17T02:25:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 -- 172.21.15.45:0/3741650965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f00b1270 msgr2=0x7f73f0134360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f00b1270 0x7f73f0134360 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73e4035040 tx=0x7f73e4032000 comp rx=0 tx=0).stop 2024-08-17T02:25:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 -- 172.21.15.45:0/3741650965 shutdown_connections 2024-08-17T02:25:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f0140580 0x7f73f015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065150 0x7f73d0067600 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f01401b0 0x7f73f00aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 --2- 172.21.15.45:0/3741650965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f00b1270 0x7f73f0134360 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 -- 172.21.15.45:0/3741650965 >> 172.21.15.45:0/3741650965 conn(0x7f73f00cb9b0 msgr2=0x7f73f006cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 -- 172.21.15.45:0/3741650965 shutdown_connections 2024-08-17T02:25:20.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:20.507+0000 7f73f7a00640 1 -- 172.21.15.45:0/3741650965 wait complete. 2024-08-17T02:25:20.523 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-08-17T02:25:19.658285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":172,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398324,"kb_used_data":2812,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576396,"statfs":{"total":773094113280,"available":770638229504,"internally_reserved":0,"allocated":2879488,"data_stored":1744356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.006584"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694749+0000","last_change":"2024-08-17T02:25:14.688635+0000","last_active":"2024-08-17T02:25:14.694749+0000","last_peered":"2024-08-17T02:25:14.694749+0000","last_clean":"2024-08-17T02:25:14.694749+0000","last_became_active":"2024-08-17T02:25:14.688409+0000","last_became_peered":"2024-08-17T02:25:14.688409+0000","last_unstale":"2024-08-17T02:25:14.694749+0000","last_undegraded":"2024-08-17T02:25:14.694749+0000","last_fullsized":"2024-08-17T02:25:14.694749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:32.913252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686216+0000","last_change":"2024-08-17T02:25:14.685522+0000","last_active":"2024-08-17T02:25:14.686216+0000","last_peered":"2024-08-17T02:25:14.686216+0000","last_clean":"2024-08-17T02:25:14.686216+0000","last_became_active":"2024-08-17T02:25:14.685146+0000","last_became_peered":"2024-08-17T02:25:14.685146+0000","last_unstale":"2024-08-17T02:25:14.686216+0000","last_undegraded":"2024-08-17T02:25:14.686216+0000","last_fullsized":"2024-08-17T02:25:14.686216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.669173+0000","last_change":"2024-08-17T02:25:14.668249+0000","last_active":"2024-08-17T02:25:14.669173+0000","last_peered":"2024-08-17T02:25:14.669173+0000","last_clean":"2024-08-17T02:25:14.669173+0000","last_became_active":"2024-08-17T02:25:14.667916+0000","last_became_peered":"2024-08-17T02:25:14.667916+0000","last_unstale":"2024-08-17T02:25:14.669173+0000","last_undegraded":"2024-08-17T02:25:14.669173+0000","last_fullsized":"2024-08-17T02:25:14.669173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678079+0000","last_change":"2024-08-17T02:25:14.667371+0000","last_active":"2024-08-17T02:25:14.678079+0000","last_peered":"2024-08-17T02:25:14.678079+0000","last_clean":"2024-08-17T02:25:14.678079+0000","last_became_active":"2024-08-17T02:25:14.666507+0000","last_became_peered":"2024-08-17T02:25:14.666507+0000","last_unstale":"2024-08-17T02:25:14.678079+0000","last_undegraded":"2024-08-17T02:25:14.678079+0000","last_fullsized":"2024-08-17T02:25:14.678079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:32.913252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.680072+0000","last_change":"2024-08-17T02:25:14.673429+0000","last_active":"2024-08-17T02:25:14.680072+0000","last_peered":"2024-08-17T02:25:14.680072+0000","last_clean":"2024-08-17T02:25:14.680072+0000","last_became_active":"2024-08-17T02:25:14.673116+0000","last_became_peered":"2024-08-17T02:25:14.673116+0000","last_unstale":"2024-08-17T02:25:14.680072+0000","last_undegraded":"2024-08-17T02:25:14.680072+0000","last_fullsized":"2024-08-17T02:25:14.680072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678094+0000","last_change":"2024-08-17T02:25:14.665820+0000","last_active":"2024-08-17T02:25:14.678094+0000","last_peered":"2024-08-17T02:25:14.678094+0000","last_clean":"2024-08-17T02:25:14.678094+0000","last_became_active":"2024-08-17T02:25:14.665533+0000","last_became_peered":"2024-08-17T02:25:14.665533+0000","last_unstale":"2024-08-17T02:25:14.678094+0000","last_undegraded":"2024-08-17T02:25:14.678094+0000","last_fullsized":"2024-08-17T02:25:14.678094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:07.562236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693398+0000","last_change":"2024-08-17T02:25:14.685204+0000","last_active":"2024-08-17T02:25:14.693398+0000","last_peered":"2024-08-17T02:25:14.693398+0000","last_clean":"2024-08-17T02:25:14.693398+0000","last_became_active":"2024-08-17T02:25:14.684913+0000","last_became_peered":"2024-08-17T02:25:14.684913+0000","last_unstale":"2024-08-17T02:25:14.693398+0000","last_undegraded":"2024-08-17T02:25:14.693398+0000","last_fullsized":"2024-08-17T02:25:14.693398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:27:44.886508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679252+0000","last_change":"2024-08-17T02:25:14.671977+0000","last_active":"2024-08-17T02:25:14.679252+0000","last_peered":"2024-08-17T02:25:14.679252+0000","last_clean":"2024-08-17T02:25:14.679252+0000","last_became_active":"2024-08-17T02:25:14.671715+0000","last_became_peered":"2024-08-17T02:25:14.671715+0000","last_unstale":"2024-08-17T02:25:14.679252+0000","last_undegraded":"2024-08-17T02:25:14.679252+0000","last_fullsized":"2024-08-17T02:25:14.679252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690194+0000","last_change":"2024-08-17T02:25:14.682177+0000","last_active":"2024-08-17T02:25:14.690194+0000","last_peered":"2024-08-17T02:25:14.690194+0000","last_clean":"2024-08-17T02:25:14.690194+0000","last_became_active":"2024-08-17T02:25:14.681923+0000","last_became_peered":"2024-08-17T02:25:14.681923+0000","last_unstale":"2024-08-17T02:25:14.690194+0000","last_undegraded":"2024-08-17T02:25:14.690194+0000","last_fullsized":"2024-08-17T02:25:14.690194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:07.562236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689537+0000","last_change":"2024-08-17T02:25:14.684528+0000","last_active":"2024-08-17T02:25:14.689537+0000","last_peered":"2024-08-17T02:25:14.689537+0000","last_clean":"2024-08-17T02:25:14.689537+0000","last_became_active":"2024-08-17T02:25:14.684273+0000","last_became_peered":"2024-08-17T02:25:14.684273+0000","last_unstale":"2024-08-17T02:25:14.689537+0000","last_undegraded":"2024-08-17T02:25:14.689537+0000","last_fullsized":"2024-08-17T02:25:14.689537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693057+0000","last_change":"2024-08-17T02:25:14.687803+0000","last_active":"2024-08-17T02:25:14.693057+0000","last_peered":"2024-08-17T02:25:14.693057+0000","last_clean":"2024-08-17T02:25:14.693057+0000","last_became_active":"2024-08-17T02:25:14.687474+0000","last_became_peered":"2024-08-17T02:25:14.687474+0000","last_unstale":"2024-08-17T02:25:14.693057+0000","last_undegraded":"2024-08-17T02:25:14.693057+0000","last_fullsized":"2024-08-17T02:25:14.693057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694472+0000","last_change":"2024-08-17T02:25:14.688106+0000","last_active":"2024-08-17T02:25:14.694472+0000","last_peered":"2024-08-17T02:25:14.694472+0000","last_clean":"2024-08-17T02:25:14.694472+0000","last_became_active":"2024-08-17T02:25:14.687884+0000","last_became_peered":"2024-08-17T02:25:14.687884+0000","last_unstale":"2024-08-17T02:25:14.694472+0000","last_undegraded":"2024-08-17T02:25:14.694472+0000","last_fullsized":"2024-08-17T02:25:14.694472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:07.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678556+0000","last_change":"2024-08-17T02:25:14.675832+0000","last_active":"2024-08-17T02:25:14.678556+0000","last_peered":"2024-08-17T02:25:14.678556+0000","last_clean":"2024-08-17T02:25:14.678556+0000","last_became_active":"2024-08-17T02:25:14.674356+0000","last_became_peered":"2024-08-17T02:25:14.674356+0000","last_unstale":"2024-08-17T02:25:14.678556+0000","last_undegraded":"2024-08-17T02:25:14.678556+0000","last_fullsized":"2024-08-17T02:25:14.678556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686167+0000","last_change":"2024-08-17T02:25:14.682873+0000","last_active":"2024-08-17T02:25:14.686167+0000","last_peered":"2024-08-17T02:25:14.686167+0000","last_clean":"2024-08-17T02:25:14.686167+0000","last_became_active":"2024-08-17T02:25:14.678077+0000","last_became_peered":"2024-08-17T02:25:14.678077+0000","last_unstale":"2024-08-17T02:25:14.686167+0000","last_undegraded":"2024-08-17T02:25:14.686167+0000","last_fullsized":"2024-08-17T02:25:14.686167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:34.226633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678037+0000","last_change":"2024-08-17T02:25:14.675577+0000","last_active":"2024-08-17T02:25:14.678037+0000","last_peered":"2024-08-17T02:25:14.678037+0000","last_clean":"2024-08-17T02:25:14.678037+0000","last_became_active":"2024-08-17T02:25:14.675346+0000","last_became_peered":"2024-08-17T02:25:14.675346+0000","last_unstale":"2024-08-17T02:25:14.678037+0000","last_undegraded":"2024-08-17T02:25:14.678037+0000","last_fullsized":"2024-08-17T02:25:14.678037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678546+0000","last_change":"2024-08-17T02:25:14.664639+0000","last_active":"2024-08-17T02:25:14.678546+0000","last_peered":"2024-08-17T02:25:14.678546+0000","last_clean":"2024-08-17T02:25:14.678546+0000","last_became_active":"2024-08-17T02:25:14.664238+0000","last_became_peered":"2024-08-17T02:25:14.664238+0000","last_unstale":"2024-08-17T02:25:14.678546+0000","last_undegraded":"2024-08-17T02:25:14.678546+0000","last_fullsized":"2024-08-17T02:25:14.678546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681035+0000","last_change":"2024-08-17T02:25:14.673971+0000","last_active":"2024-08-17T02:25:14.681035+0000","last_peered":"2024-08-17T02:25:14.681035+0000","last_clean":"2024-08-17T02:25:14.681035+0000","last_became_active":"2024-08-17T02:25:14.673681+0000","last_became_peered":"2024-08-17T02:25:14.673681+0000","last_unstale":"2024-08-17T02:25:14.681035+0000","last_undegraded":"2024-08-17T02:25:14.681035+0000","last_fullsized":"2024-08-17T02:25:14.681035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681015+0000","last_change":"2024-08-17T02:25:14.679222+0000","last_active":"2024-08-17T02:25:14.681015+0000","last_peered":"2024-08-17T02:25:14.681015+0000","last_clean":"2024-08-17T02:25:14.681015+0000","last_became_active":"2024-08-17T02:25:14.678854+0000","last_became_peered":"2024-08-17T02:25:14.678854+0000","last_unstale":"2024-08-17T02:25:14.681015+0000","last_undegraded":"2024-08-17T02:25:14.681015+0000","last_fullsized":"2024-08-17T02:25:14.681015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:49.762929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690292+0000","last_change":"2024-08-17T02:25:14.675322+0000","last_active":"2024-08-17T02:25:14.690292+0000","last_peered":"2024-08-17T02:25:14.690292+0000","last_clean":"2024-08-17T02:25:14.690292+0000","last_became_active":"2024-08-17T02:25:14.675062+0000","last_became_peered":"2024-08-17T02:25:14.675062+0000","last_unstale":"2024-08-17T02:25:14.690292+0000","last_undegraded":"2024-08-17T02:25:14.690292+0000","last_fullsized":"2024-08-17T02:25:14.690292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693140+0000","last_change":"2024-08-17T02:25:14.688691+0000","last_active":"2024-08-17T02:25:14.693140+0000","last_peered":"2024-08-17T02:25:14.693140+0000","last_clean":"2024-08-17T02:25:14.693140+0000","last_became_active":"2024-08-17T02:25:14.688426+0000","last_became_peered":"2024-08-17T02:25:14.688426+0000","last_unstale":"2024-08-17T02:25:14.693140+0000","last_undegraded":"2024-08-17T02:25:14.693140+0000","last_fullsized":"2024-08-17T02:25:14.693140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684959+0000","last_change":"2024-08-17T02:25:14.677713+0000","last_active":"2024-08-17T02:25:14.684959+0000","last_peered":"2024-08-17T02:25:14.684959+0000","last_clean":"2024-08-17T02:25:14.684959+0000","last_became_active":"2024-08-17T02:25:14.676684+0000","last_became_peered":"2024-08-17T02:25:14.676684+0000","last_unstale":"2024-08-17T02:25:14.684959+0000","last_undegraded":"2024-08-17T02:25:14.684959+0000","last_fullsized":"2024-08-17T02:25:14.684959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683534+0000","last_change":"2024-08-17T02:25:14.677693+0000","last_active":"2024-08-17T02:25:14.683534+0000","last_peered":"2024-08-17T02:25:14.683534+0000","last_clean":"2024-08-17T02:25:14.683534+0000","last_became_active":"2024-08-17T02:25:14.675085+0000","last_became_peered":"2024-08-17T02:25:14.675085+0000","last_unstale":"2024-08-17T02:25:14.683534+0000","last_undegraded":"2024-08-17T02:25:14.683534+0000","last_fullsized":"2024-08-17T02:25:14.683534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686732+0000","last_change":"2024-08-17T02:25:14.680570+0000","last_active":"2024-08-17T02:25:14.686732+0000","last_peered":"2024-08-17T02:25:14.686732+0000","last_clean":"2024-08-17T02:25:14.686732+0000","last_became_active":"2024-08-17T02:25:14.680331+0000","last_became_peered":"2024-08-17T02:25:14.680331+0000","last_unstale":"2024-08-17T02:25:14.686732+0000","last_undegraded":"2024-08-17T02:25:14.686732+0000","last_fullsized":"2024-08-17T02:25:14.686732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678558+0000","last_change":"2024-08-17T02:25:14.669965+0000","last_active":"2024-08-17T02:25:14.678558+0000","last_peered":"2024-08-17T02:25:14.678558+0000","last_clean":"2024-08-17T02:25:14.678558+0000","last_became_active":"2024-08-17T02:25:14.669710+0000","last_became_peered":"2024-08-17T02:25:14.669710+0000","last_unstale":"2024-08-17T02:25:14.678558+0000","last_undegraded":"2024-08-17T02:25:14.678558+0000","last_fullsized":"2024-08-17T02:25:14.678558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686777+0000","last_change":"2024-08-17T02:25:14.680996+0000","last_active":"2024-08-17T02:25:14.686777+0000","last_peered":"2024-08-17T02:25:14.686777+0000","last_clean":"2024-08-17T02:25:14.686777+0000","last_became_active":"2024-08-17T02:25:14.680672+0000","last_became_peered":"2024-08-17T02:25:14.680672+0000","last_unstale":"2024-08-17T02:25:14.686777+0000","last_undegraded":"2024-08-17T02:25:14.686777+0000","last_fullsized":"2024-08-17T02:25:14.686777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686709+0000","last_change":"2024-08-17T02:25:14.682018+0000","last_active":"2024-08-17T02:25:14.686709+0000","last_peered":"2024-08-17T02:25:14.686709+0000","last_clean":"2024-08-17T02:25:14.686709+0000","last_became_active":"2024-08-17T02:25:14.681624+0000","last_became_peered":"2024-08-17T02:25:14.681624+0000","last_unstale":"2024-08-17T02:25:14.686709+0000","last_undegraded":"2024-08-17T02:25:14.686709+0000","last_fullsized":"2024-08-17T02:25:14.686709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.674157+0000","last_change":"2024-08-17T02:25:14.673348+0000","last_active":"2024-08-17T02:25:14.674157+0000","last_peered":"2024-08-17T02:25:14.674157+0000","last_clean":"2024-08-17T02:25:14.674157+0000","last_became_active":"2024-08-17T02:25:14.672984+0000","last_became_peered":"2024-08-17T02:25:14.672984+0000","last_unstale":"2024-08-17T02:25:14.674157+0000","last_undegraded":"2024-08-17T02:25:14.674157+0000","last_fullsized":"2024-08-17T02:25:14.674157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686798+0000","last_change":"2024-08-17T02:25:14.681879+0000","last_active":"2024-08-17T02:25:14.686798+0000","last_peered":"2024-08-17T02:25:14.686798+0000","last_clean":"2024-08-17T02:25:14.686798+0000","last_became_active":"2024-08-17T02:25:14.681545+0000","last_became_peered":"2024-08-17T02:25:14.681545+0000","last_unstale":"2024-08-17T02:25:14.686798+0000","last_undegraded":"2024-08-17T02:25:14.686798+0000","last_fullsized":"2024-08-17T02:25:14.686798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:59.372660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684978+0000","last_change":"2024-08-17T02:25:14.680092+0000","last_active":"2024-08-17T02:25:14.684978+0000","last_peered":"2024-08-17T02:25:14.684978+0000","last_clean":"2024-08-17T02:25:14.684978+0000","last_became_active":"2024-08-17T02:25:14.677406+0000","last_became_peered":"2024-08-17T02:25:14.677406+0000","last_unstale":"2024-08-17T02:25:14.684978+0000","last_undegraded":"2024-08-17T02:25:14.684978+0000","last_fullsized":"2024-08-17T02:25:14.684978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:12.662553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678115+0000","last_change":"2024-08-17T02:25:14.668666+0000","last_active":"2024-08-17T02:25:14.678115+0000","last_peered":"2024-08-17T02:25:14.678115+0000","last_clean":"2024-08-17T02:25:14.678115+0000","last_became_active":"2024-08-17T02:25:14.668347+0000","last_became_peered":"2024-08-17T02:25:14.668347+0000","last_unstale":"2024-08-17T02:25:14.678115+0000","last_undegraded":"2024-08-17T02:25:14.678115+0000","last_fullsized":"2024-08-17T02:25:14.678115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:27:44.886508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670824+0000","last_change":"2024-08-17T02:25:14.668138+0000","last_active":"2024-08-17T02:25:14.670824+0000","last_peered":"2024-08-17T02:25:14.670824+0000","last_clean":"2024-08-17T02:25:14.670824+0000","last_became_active":"2024-08-17T02:25:14.667760+0000","last_became_peered":"2024-08-17T02:25:14.667760+0000","last_unstale":"2024-08-17T02:25:14.670824+0000","last_undegraded":"2024-08-17T02:25:14.670824+0000","last_fullsized":"2024-08-17T02:25:14.670824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:07.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683761+0000","last_change":"2024-08-17T02:25:14.674636+0000","last_active":"2024-08-17T02:25:14.683761+0000","last_peered":"2024-08-17T02:25:14.683761+0000","last_clean":"2024-08-17T02:25:14.683761+0000","last_became_active":"2024-08-17T02:25:14.674133+0000","last_became_peered":"2024-08-17T02:25:14.674133+0000","last_unstale":"2024-08-17T02:25:14.683761+0000","last_undegraded":"2024-08-17T02:25:14.683761+0000","last_fullsized":"2024-08-17T02:25:14.683761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689013+0000","last_change":"2024-08-17T02:25:14.677807+0000","last_active":"2024-08-17T02:25:14.689013+0000","last_peered":"2024-08-17T02:25:14.689013+0000","last_clean":"2024-08-17T02:25:14.689013+0000","last_became_active":"2024-08-17T02:25:14.677600+0000","last_became_peered":"2024-08-17T02:25:14.677600+0000","last_unstale":"2024-08-17T02:25:14.689013+0000","last_undegraded":"2024-08-17T02:25:14.689013+0000","last_fullsized":"2024-08-17T02:25:14.689013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:20.793789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700661+0000","last_change":"2024-08-17T02:25:13.676038+0000","last_active":"2024-08-17T02:25:14.700661+0000","last_peered":"2024-08-17T02:25:14.700661+0000","last_clean":"2024-08-17T02:25:14.700661+0000","last_became_active":"2024-08-17T02:25:13.675729+0000","last_became_peered":"2024-08-17T02:25:13.675729+0000","last_unstale":"2024-08-17T02:25:14.700661+0000","last_undegraded":"2024-08-17T02:25:14.700661+0000","last_fullsized":"2024-08-17T02:25:14.700661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684995+0000","last_change":"2024-08-17T02:25:14.680735+0000","last_active":"2024-08-17T02:25:14.684995+0000","last_peered":"2024-08-17T02:25:14.684995+0000","last_clean":"2024-08-17T02:25:14.684995+0000","last_became_active":"2024-08-17T02:25:14.679254+0000","last_became_peered":"2024-08-17T02:25:14.679254+0000","last_unstale":"2024-08-17T02:25:14.684995+0000","last_undegraded":"2024-08-17T02:25:14.684995+0000","last_fullsized":"2024-08-17T02:25:14.684995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700214+0000","last_change":"2024-08-17T02:25:13.685739+0000","last_active":"2024-08-17T02:25:14.700214+0000","last_peered":"2024-08-17T02:25:14.700214+0000","last_clean":"2024-08-17T02:25:14.700214+0000","last_became_active":"2024-08-17T02:25:13.685479+0000","last_became_peered":"2024-08-17T02:25:13.685479+0000","last_unstale":"2024-08-17T02:25:14.700214+0000","last_undegraded":"2024-08-17T02:25:14.700214+0000","last_fullsized":"2024-08-17T02:25:14.700214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660450+0000","last_change":"2024-08-17T02:25:13.674789+0000","last_active":"2024-08-17T02:25:14.660450+0000","last_peered":"2024-08-17T02:25:14.660450+0000","last_clean":"2024-08-17T02:25:14.660450+0000","last_became_active":"2024-08-17T02:25:13.674512+0000","last_became_peered":"2024-08-17T02:25:13.674512+0000","last_unstale":"2024-08-17T02:25:14.660450+0000","last_undegraded":"2024-08-17T02:25:14.660450+0000","last_fullsized":"2024-08-17T02:25:14.660450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671875+0000","last_change":"2024-08-17T02:25:14.663923+0000","last_active":"2024-08-17T02:25:14.671875+0000","last_peered":"2024-08-17T02:25:14.671875+0000","last_clean":"2024-08-17T02:25:14.671875+0000","last_became_active":"2024-08-17T02:25:14.663671+0000","last_became_peered":"2024-08-17T02:25:14.663671+0000","last_unstale":"2024-08-17T02:25:14.671875+0000","last_undegraded":"2024-08-17T02:25:14.671875+0000","last_fullsized":"2024-08-17T02:25:14.671875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.659542+0000","last_change":"2024-08-17T02:25:13.679503+0000","last_active":"2024-08-17T02:25:14.659542+0000","last_peered":"2024-08-17T02:25:14.659542+0000","last_clean":"2024-08-17T02:25:14.659542+0000","last_became_active":"2024-08-17T02:25:13.679226+0000","last_became_peered":"2024-08-17T02:25:13.679226+0000","last_unstale":"2024-08-17T02:25:14.659542+0000","last_undegraded":"2024-08-17T02:25:14.659542+0000","last_fullsized":"2024-08-17T02:25:14.659542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678019+0000","last_change":"2024-08-17T02:25:14.675096+0000","last_active":"2024-08-17T02:25:14.678019+0000","last_peered":"2024-08-17T02:25:14.678019+0000","last_clean":"2024-08-17T02:25:14.678019+0000","last_became_active":"2024-08-17T02:25:14.672309+0000","last_became_peered":"2024-08-17T02:25:14.672309+0000","last_unstale":"2024-08-17T02:25:14.678019+0000","last_undegraded":"2024-08-17T02:25:14.678019+0000","last_fullsized":"2024-08-17T02:25:14.678019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.676600+0000","last_change":"2024-08-17T02:25:13.676652+0000","last_active":"2024-08-17T02:25:14.676600+0000","last_peered":"2024-08-17T02:25:14.676600+0000","last_clean":"2024-08-17T02:25:14.676600+0000","last_became_active":"2024-08-17T02:25:13.676364+0000","last_became_peered":"2024-08-17T02:25:13.676364+0000","last_unstale":"2024-08-17T02:25:14.676600+0000","last_undegraded":"2024-08-17T02:25:14.676600+0000","last_fullsized":"2024-08-17T02:25:14.676600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.682522+0000","last_change":"2024-08-17T02:25:14.672988+0000","last_active":"2024-08-17T02:25:14.682522+0000","last_peered":"2024-08-17T02:25:14.682522+0000","last_clean":"2024-08-17T02:25:14.682522+0000","last_became_active":"2024-08-17T02:25:14.672662+0000","last_became_peered":"2024-08-17T02:25:14.672662+0000","last_unstale":"2024-08-17T02:25:14.682522+0000","last_undegraded":"2024-08-17T02:25:14.682522+0000","last_fullsized":"2024-08-17T02:25:14.682522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658744+0000","last_change":"2024-08-17T02:25:13.676993+0000","last_active":"2024-08-17T02:25:14.658744+0000","last_peered":"2024-08-17T02:25:14.658744+0000","last_clean":"2024-08-17T02:25:14.658744+0000","last_became_active":"2024-08-17T02:25:13.674529+0000","last_became_peered":"2024-08-17T02:25:13.674529+0000","last_unstale":"2024-08-17T02:25:14.658744+0000","last_undegraded":"2024-08-17T02:25:14.658744+0000","last_fullsized":"2024-08-17T02:25:14.658744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681456+0000","last_change":"2024-08-17T02:25:14.677046+0000","last_active":"2024-08-17T02:25:14.681456+0000","last_peered":"2024-08-17T02:25:14.681456+0000","last_clean":"2024-08-17T02:25:14.681456+0000","last_became_active":"2024-08-17T02:25:14.676726+0000","last_became_peered":"2024-08-17T02:25:14.676726+0000","last_unstale":"2024-08-17T02:25:14.681456+0000","last_undegraded":"2024-08-17T02:25:14.681456+0000","last_fullsized":"2024-08-17T02:25:14.681456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700073+0000","last_change":"2024-08-17T02:25:13.685185+0000","last_active":"2024-08-17T02:25:14.700073+0000","last_peered":"2024-08-17T02:25:14.700073+0000","last_clean":"2024-08-17T02:25:14.700073+0000","last_became_active":"2024-08-17T02:25:13.684855+0000","last_became_peered":"2024-08-17T02:25:13.684855+0000","last_unstale":"2024-08-17T02:25:14.700073+0000","last_undegraded":"2024-08-17T02:25:14.700073+0000","last_fullsized":"2024-08-17T02:25:14.700073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689679+0000","last_change":"2024-08-17T02:25:14.684052+0000","last_active":"2024-08-17T02:25:14.689679+0000","last_peered":"2024-08-17T02:25:14.689679+0000","last_clean":"2024-08-17T02:25:14.689679+0000","last_became_active":"2024-08-17T02:25:14.682595+0000","last_became_peered":"2024-08-17T02:25:14.682595+0000","last_unstale":"2024-08-17T02:25:14.689679+0000","last_undegraded":"2024-08-17T02:25:14.689679+0000","last_fullsized":"2024-08-17T02:25:14.689679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:49.693684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.702862+0000","last_change":"2024-08-17T02:25:13.679399+0000","last_active":"2024-08-17T02:25:14.702862+0000","last_peered":"2024-08-17T02:25:14.702862+0000","last_clean":"2024-08-17T02:25:14.702862+0000","last_became_active":"2024-08-17T02:25:13.679142+0000","last_became_peered":"2024-08-17T02:25:13.679142+0000","last_unstale":"2024-08-17T02:25:14.702862+0000","last_undegraded":"2024-08-17T02:25:14.702862+0000","last_fullsized":"2024-08-17T02:25:14.702862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690311+0000","last_change":"2024-08-17T02:25:14.682175+0000","last_active":"2024-08-17T02:25:14.690311+0000","last_peered":"2024-08-17T02:25:14.690311+0000","last_clean":"2024-08-17T02:25:14.690311+0000","last_became_active":"2024-08-17T02:25:14.681498+0000","last_became_peered":"2024-08-17T02:25:14.681498+0000","last_unstale":"2024-08-17T02:25:14.690311+0000","last_undegraded":"2024-08-17T02:25:14.690311+0000","last_fullsized":"2024-08-17T02:25:14.690311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699519+0000","last_change":"2024-08-17T02:25:13.681889+0000","last_active":"2024-08-17T02:25:14.699519+0000","last_peered":"2024-08-17T02:25:14.699519+0000","last_clean":"2024-08-17T02:25:14.699519+0000","last_became_active":"2024-08-17T02:25:13.681485+0000","last_became_peered":"2024-08-17T02:25:13.681485+0000","last_unstale":"2024-08-17T02:25:14.699519+0000","last_undegraded":"2024-08-17T02:25:14.699519+0000","last_fullsized":"2024-08-17T02:25:14.699519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683304+0000","last_change":"2024-08-17T02:25:14.678042+0000","last_active":"2024-08-17T02:25:14.683304+0000","last_peered":"2024-08-17T02:25:14.683304+0000","last_clean":"2024-08-17T02:25:14.683304+0000","last_became_active":"2024-08-17T02:25:14.677441+0000","last_became_peered":"2024-08-17T02:25:14.677441+0000","last_unstale":"2024-08-17T02:25:14.683304+0000","last_undegraded":"2024-08-17T02:25:14.683304+0000","last_fullsized":"2024-08-17T02:25:14.683304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658041+0000","last_change":"2024-08-17T02:25:13.672280+0000","last_active":"2024-08-17T02:25:14.658041+0000","last_peered":"2024-08-17T02:25:14.658041+0000","last_clean":"2024-08-17T02:25:14.658041+0000","last_became_active":"2024-08-17T02:25:13.672021+0000","last_became_peered":"2024-08-17T02:25:13.672021+0000","last_unstale":"2024-08-17T02:25:14.658041+0000","last_undegraded":"2024-08-17T02:25:14.658041+0000","last_fullsized":"2024-08-17T02:25:14.658041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694737+0000","last_change":"2024-08-17T02:25:14.690951+0000","last_active":"2024-08-17T02:25:14.694737+0000","last_peered":"2024-08-17T02:25:14.694737+0000","last_clean":"2024-08-17T02:25:14.694737+0000","last_became_active":"2024-08-17T02:25:14.690640+0000","last_became_peered":"2024-08-17T02:25:14.690640+0000","last_unstale":"2024-08-17T02:25:14.694737+0000","last_undegraded":"2024-08-17T02:25:14.694737+0000","last_fullsized":"2024-08-17T02:25:14.694737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:38.177445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.666609+0000","last_change":"2024-08-17T02:25:13.678799+0000","last_active":"2024-08-17T02:25:14.666609+0000","last_peered":"2024-08-17T02:25:14.666609+0000","last_clean":"2024-08-17T02:25:14.666609+0000","last_became_active":"2024-08-17T02:25:13.678338+0000","last_became_peered":"2024-08-17T02:25:13.678338+0000","last_unstale":"2024-08-17T02:25:14.666609+0000","last_undegraded":"2024-08-17T02:25:14.666609+0000","last_fullsized":"2024-08-17T02:25:14.666609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684933+0000","last_change":"2024-08-17T02:25:14.677309+0000","last_active":"2024-08-17T02:25:14.684933+0000","last_peered":"2024-08-17T02:25:14.684933+0000","last_clean":"2024-08-17T02:25:14.684933+0000","last_became_active":"2024-08-17T02:25:14.673828+0000","last_became_peered":"2024-08-17T02:25:14.673828+0000","last_unstale":"2024-08-17T02:25:14.684933+0000","last_undegraded":"2024-08-17T02:25:14.684933+0000","last_fullsized":"2024-08-17T02:25:14.684933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.701579+0000","last_change":"2024-08-17T02:25:13.679207+0000","last_active":"2024-08-17T02:25:14.701579+0000","last_peered":"2024-08-17T02:25:14.701579+0000","last_clean":"2024-08-17T02:25:14.701579+0000","last_became_active":"2024-08-17T02:25:13.678895+0000","last_became_peered":"2024-08-17T02:25:13.678895+0000","last_unstale":"2024-08-17T02:25:14.701579+0000","last_undegraded":"2024-08-17T02:25:14.701579+0000","last_fullsized":"2024-08-17T02:25:14.701579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693362+0000","last_change":"2024-08-17T02:25:14.684764+0000","last_active":"2024-08-17T02:25:14.693362+0000","last_peered":"2024-08-17T02:25:14.693362+0000","last_clean":"2024-08-17T02:25:14.693362+0000","last_became_active":"2024-08-17T02:25:14.682919+0000","last_became_peered":"2024-08-17T02:25:14.682919+0000","last_unstale":"2024-08-17T02:25:14.693362+0000","last_undegraded":"2024-08-17T02:25:14.693362+0000","last_fullsized":"2024-08-17T02:25:14.693362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:22.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699314+0000","last_change":"2024-08-17T02:25:13.680283+0000","last_active":"2024-08-17T02:25:14.699314+0000","last_peered":"2024-08-17T02:25:14.699314+0000","last_clean":"2024-08-17T02:25:14.699314+0000","last_became_active":"2024-08-17T02:25:13.679891+0000","last_became_peered":"2024-08-17T02:25:13.679891+0000","last_unstale":"2024-08-17T02:25:14.699314+0000","last_undegraded":"2024-08-17T02:25:14.699314+0000","last_fullsized":"2024-08-17T02:25:14.699314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694975+0000","last_change":"2024-08-17T02:25:14.691471+0000","last_active":"2024-08-17T02:25:14.694975+0000","last_peered":"2024-08-17T02:25:14.694975+0000","last_clean":"2024-08-17T02:25:14.694975+0000","last_became_active":"2024-08-17T02:25:14.691171+0000","last_became_peered":"2024-08-17T02:25:14.691171+0000","last_unstale":"2024-08-17T02:25:14.694975+0000","last_undegraded":"2024-08-17T02:25:14.694975+0000","last_fullsized":"2024-08-17T02:25:14.694975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:19.535692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700333+0000","last_change":"2024-08-17T02:25:13.677536+0000","last_active":"2024-08-17T02:25:14.700333+0000","last_peered":"2024-08-17T02:25:14.700333+0000","last_clean":"2024-08-17T02:25:14.700333+0000","last_became_active":"2024-08-17T02:25:13.675183+0000","last_became_peered":"2024-08-17T02:25:13.675183+0000","last_unstale":"2024-08-17T02:25:14.700333+0000","last_undegraded":"2024-08-17T02:25:14.700333+0000","last_fullsized":"2024-08-17T02:25:14.700333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.695063+0000","last_change":"2024-08-17T02:25:14.692018+0000","last_active":"2024-08-17T02:25:14.695063+0000","last_peered":"2024-08-17T02:25:14.695063+0000","last_clean":"2024-08-17T02:25:14.695063+0000","last_became_active":"2024-08-17T02:25:14.691753+0000","last_became_peered":"2024-08-17T02:25:14.691753+0000","last_unstale":"2024-08-17T02:25:14.695063+0000","last_undegraded":"2024-08-17T02:25:14.695063+0000","last_fullsized":"2024-08-17T02:25:14.695063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:57.832736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699649+0000","last_change":"2024-08-17T02:25:13.684009+0000","last_active":"2024-08-17T02:25:14.699649+0000","last_peered":"2024-08-17T02:25:14.699649+0000","last_clean":"2024-08-17T02:25:14.699649+0000","last_became_active":"2024-08-17T02:25:13.683242+0000","last_became_peered":"2024-08-17T02:25:13.683242+0000","last_unstale":"2024-08-17T02:25:14.699649+0000","last_undegraded":"2024-08-17T02:25:14.699649+0000","last_fullsized":"2024-08-17T02:25:14.699649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:48.757464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678098+0000","last_change":"2024-08-17T02:25:14.667634+0000","last_active":"2024-08-17T02:25:14.678098+0000","last_peered":"2024-08-17T02:25:14.678098+0000","last_clean":"2024-08-17T02:25:14.678098+0000","last_became_active":"2024-08-17T02:25:14.667363+0000","last_became_peered":"2024-08-17T02:25:14.667363+0000","last_unstale":"2024-08-17T02:25:14.678098+0000","last_undegraded":"2024-08-17T02:25:14.678098+0000","last_fullsized":"2024-08-17T02:25:14.678098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:59.372660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660728+0000","last_change":"2024-08-17T02:25:13.668855+0000","last_active":"2024-08-17T02:25:14.660728+0000","last_peered":"2024-08-17T02:25:14.660728+0000","last_clean":"2024-08-17T02:25:14.660728+0000","last_became_active":"2024-08-17T02:25:13.668568+0000","last_became_peered":"2024-08-17T02:25:13.668568+0000","last_unstale":"2024-08-17T02:25:14.660728+0000","last_undegraded":"2024-08-17T02:25:14.660728+0000","last_fullsized":"2024-08-17T02:25:14.660728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694943+0000","last_change":"2024-08-17T02:25:14.691327+0000","last_active":"2024-08-17T02:25:14.694943+0000","last_peered":"2024-08-17T02:25:14.694943+0000","last_clean":"2024-08-17T02:25:14.694943+0000","last_became_active":"2024-08-17T02:25:14.690760+0000","last_became_peered":"2024-08-17T02:25:14.690760+0000","last_unstale":"2024-08-17T02:25:14.694943+0000","last_undegraded":"2024-08-17T02:25:14.694943+0000","last_fullsized":"2024-08-17T02:25:14.694943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.664056+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:25:14.664056+0000","last_peered":"2024-08-17T02:25:14.664056+0000","last_clean":"2024-08-17T02:25:14.664056+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:25:14.664056+0000","last_undegraded":"2024-08-17T02:25:14.664056+0000","last_fullsized":"2024-08-17T02:25:14.664056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.657956+0000","last_change":"2024-08-17T02:25:13.671609+0000","last_active":"2024-08-17T02:25:14.657956+0000","last_peered":"2024-08-17T02:25:14.657956+0000","last_clean":"2024-08-17T02:25:14.657956+0000","last_became_active":"2024-08-17T02:25:13.665871+0000","last_became_peered":"2024-08-17T02:25:13.665871+0000","last_unstale":"2024-08-17T02:25:14.657956+0000","last_undegraded":"2024-08-17T02:25:14.657956+0000","last_fullsized":"2024-08-17T02:25:14.657956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679635+0000","last_change":"2024-08-17T02:25:14.671245+0000","last_active":"2024-08-17T02:25:14.679635+0000","last_peered":"2024-08-17T02:25:14.679635+0000","last_clean":"2024-08-17T02:25:14.679635+0000","last_became_active":"2024-08-17T02:25:14.670965+0000","last_became_peered":"2024-08-17T02:25:14.670965+0000","last_unstale":"2024-08-17T02:25:14.679635+0000","last_undegraded":"2024-08-17T02:25:14.679635+0000","last_fullsized":"2024-08-17T02:25:14.679635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.663915+0000","last_change":"2024-08-17T02:25:13.687566+0000","last_active":"2024-08-17T02:25:14.663915+0000","last_peered":"2024-08-17T02:25:14.663915+0000","last_clean":"2024-08-17T02:25:14.663915+0000","last_became_active":"2024-08-17T02:25:13.687289+0000","last_became_peered":"2024-08-17T02:25:13.687289+0000","last_unstale":"2024-08-17T02:25:14.663915+0000","last_undegraded":"2024-08-17T02:25:14.663915+0000","last_fullsized":"2024-08-17T02:25:14.663915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684731+0000","last_change":"2024-08-17T02:25:14.678546+0000","last_active":"2024-08-17T02:25:14.684731+0000","last_peered":"2024-08-17T02:25:14.684731+0000","last_clean":"2024-08-17T02:25:14.684731+0000","last_became_active":"2024-08-17T02:25:14.677779+0000","last_became_peered":"2024-08-17T02:25:14.677779+0000","last_unstale":"2024-08-17T02:25:14.684731+0000","last_undegraded":"2024-08-17T02:25:14.684731+0000","last_fullsized":"2024-08-17T02:25:14.684731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660654+0000","last_change":"2024-08-17T02:25:13.668305+0000","last_active":"2024-08-17T02:25:14.660654+0000","last_peered":"2024-08-17T02:25:14.660654+0000","last_clean":"2024-08-17T02:25:14.660654+0000","last_became_active":"2024-08-17T02:25:13.667891+0000","last_became_peered":"2024-08-17T02:25:13.667891+0000","last_unstale":"2024-08-17T02:25:14.660654+0000","last_undegraded":"2024-08-17T02:25:14.660654+0000","last_fullsized":"2024-08-17T02:25:14.660654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.672921+0000","last_change":"2024-08-17T02:25:14.671227+0000","last_active":"2024-08-17T02:25:14.672921+0000","last_peered":"2024-08-17T02:25:14.672921+0000","last_clean":"2024-08-17T02:25:14.672921+0000","last_became_active":"2024-08-17T02:25:14.670957+0000","last_became_peered":"2024-08-17T02:25:14.670957+0000","last_unstale":"2024-08-17T02:25:14.672921+0000","last_undegraded":"2024-08-17T02:25:14.672921+0000","last_fullsized":"2024-08-17T02:25:14.672921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658042+0000","last_change":"2024-08-17T02:25:13.682523+0000","last_active":"2024-08-17T02:25:14.658042+0000","last_peered":"2024-08-17T02:25:14.658042+0000","last_clean":"2024-08-17T02:25:14.658042+0000","last_became_active":"2024-08-17T02:25:13.681263+0000","last_became_peered":"2024-08-17T02:25:13.681263+0000","last_unstale":"2024-08-17T02:25:14.658042+0000","last_undegraded":"2024-08-17T02:25:14.658042+0000","last_fullsized":"2024-08-17T02:25:14.658042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689867+0000","last_change":"2024-08-17T02:25:14.684673+0000","last_active":"2024-08-17T02:25:14.689867+0000","last_peered":"2024-08-17T02:25:14.689867+0000","last_clean":"2024-08-17T02:25:14.689867+0000","last_became_active":"2024-08-17T02:25:14.684108+0000","last_became_peered":"2024-08-17T02:25:14.684108+0000","last_unstale":"2024-08-17T02:25:14.689867+0000","last_undegraded":"2024-08-17T02:25:14.689867+0000","last_fullsized":"2024-08-17T02:25:14.689867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:49.762929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671095+0000","last_change":"2024-08-17T02:25:13.683299+0000","last_active":"2024-08-17T02:25:14.671095+0000","last_peered":"2024-08-17T02:25:14.671095+0000","last_clean":"2024-08-17T02:25:14.671095+0000","last_became_active":"2024-08-17T02:25:13.682446+0000","last_became_peered":"2024-08-17T02:25:13.682446+0000","last_unstale":"2024-08-17T02:25:14.671095+0000","last_undegraded":"2024-08-17T02:25:14.671095+0000","last_fullsized":"2024-08-17T02:25:14.671095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:48.688219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683680+0000","last_change":"2024-08-17T02:25:14.670920+0000","last_active":"2024-08-17T02:25:14.683680+0000","last_peered":"2024-08-17T02:25:14.683680+0000","last_clean":"2024-08-17T02:25:14.683680+0000","last_became_active":"2024-08-17T02:25:14.670641+0000","last_became_peered":"2024-08-17T02:25:14.670641+0000","last_unstale":"2024-08-17T02:25:14.683680+0000","last_undegraded":"2024-08-17T02:25:14.683680+0000","last_fullsized":"2024-08-17T02:25:14.683680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.666369+0000","last_change":"2024-08-17T02:25:13.686375+0000","last_active":"2024-08-17T02:25:14.666369+0000","last_peered":"2024-08-17T02:25:14.666369+0000","last_clean":"2024-08-17T02:25:14.666369+0000","last_became_active":"2024-08-17T02:25:13.686118+0000","last_became_peered":"2024-08-17T02:25:13.686118+0000","last_unstale":"2024-08-17T02:25:14.666369+0000","last_undegraded":"2024-08-17T02:25:14.666369+0000","last_fullsized":"2024-08-17T02:25:14.666369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:48.688219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.673713+0000","last_change":"2024-08-17T02:25:14.672615+0000","last_active":"2024-08-17T02:25:14.673713+0000","last_peered":"2024-08-17T02:25:14.673713+0000","last_clean":"2024-08-17T02:25:14.673713+0000","last_became_active":"2024-08-17T02:25:14.672282+0000","last_became_peered":"2024-08-17T02:25:14.672282+0000","last_unstale":"2024-08-17T02:25:14.673713+0000","last_undegraded":"2024-08-17T02:25:14.673713+0000","last_fullsized":"2024-08-17T02:25:14.673713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.674136+0000","last_change":"2024-08-17T02:25:13.683744+0000","last_active":"2024-08-17T02:25:14.674136+0000","last_peered":"2024-08-17T02:25:14.674136+0000","last_clean":"2024-08-17T02:25:14.674136+0000","last_became_active":"2024-08-17T02:25:13.683299+0000","last_became_peered":"2024-08-17T02:25:13.683299+0000","last_unstale":"2024-08-17T02:25:14.674136+0000","last_undegraded":"2024-08-17T02:25:14.674136+0000","last_fullsized":"2024-08-17T02:25:14.674136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:06.729225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686757+0000","last_change":"2024-08-17T02:25:14.680936+0000","last_active":"2024-08-17T02:25:14.686757+0000","last_peered":"2024-08-17T02:25:14.686757+0000","last_clean":"2024-08-17T02:25:14.686757+0000","last_became_active":"2024-08-17T02:25:14.680661+0000","last_became_peered":"2024-08-17T02:25:14.680661+0000","last_unstale":"2024-08-17T02:25:14.686757+0000","last_undegraded":"2024-08-17T02:25:14.686757+0000","last_fullsized":"2024-08-17T02:25:14.686757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.701405+0000","last_change":"2024-08-17T02:25:13.677363+0000","last_active":"2024-08-17T02:25:14.701405+0000","last_peered":"2024-08-17T02:25:14.701405+0000","last_clean":"2024-08-17T02:25:14.701405+0000","last_became_active":"2024-08-17T02:25:13.677094+0000","last_became_peered":"2024-08-17T02:25:13.677094+0000","last_unstale":"2024-08-17T02:25:14.701405+0000","last_undegraded":"2024-08-17T02:25:14.701405+0000","last_fullsized":"2024-08-17T02:25:14.701405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686590+0000","last_change":"2024-08-17T02:25:14.683885+0000","last_active":"2024-08-17T02:25:14.686590+0000","last_peered":"2024-08-17T02:25:14.686590+0000","last_clean":"2024-08-17T02:25:14.686590+0000","last_became_active":"2024-08-17T02:25:14.679041+0000","last_became_peered":"2024-08-17T02:25:14.679041+0000","last_unstale":"2024-08-17T02:25:14.686590+0000","last_undegraded":"2024-08-17T02:25:14.686590+0000","last_fullsized":"2024-08-17T02:25:14.686590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.661849+0000","last_change":"2024-08-17T02:25:13.685837+0000","last_active":"2024-08-17T02:25:14.661849+0000","last_peered":"2024-08-17T02:25:14.661849+0000","last_clean":"2024-08-17T02:25:14.661849+0000","last_became_active":"2024-08-17T02:25:13.685565+0000","last_became_peered":"2024-08-17T02:25:13.685565+0000","last_unstale":"2024-08-17T02:25:14.661849+0000","last_undegraded":"2024-08-17T02:25:14.661849+0000","last_fullsized":"2024-08-17T02:25:14.661849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:33.349779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.672818+0000","last_change":"2024-08-17T02:25:14.668966+0000","last_active":"2024-08-17T02:25:14.672818+0000","last_peered":"2024-08-17T02:25:14.672818+0000","last_clean":"2024-08-17T02:25:14.672818+0000","last_became_active":"2024-08-17T02:25:14.668718+0000","last_became_peered":"2024-08-17T02:25:14.668718+0000","last_unstale":"2024-08-17T02:25:14.672818+0000","last_undegraded":"2024-08-17T02:25:14.672818+0000","last_fullsized":"2024-08-17T02:25:14.672818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:34.355244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670142+0000","last_change":"2024-08-17T02:25:13.687912+0000","last_active":"2024-08-17T02:25:14.670142+0000","last_peered":"2024-08-17T02:25:14.670142+0000","last_clean":"2024-08-17T02:25:14.670142+0000","last_became_active":"2024-08-17T02:25:13.687603+0000","last_became_peered":"2024-08-17T02:25:13.687603+0000","last_unstale":"2024-08-17T02:25:14.670142+0000","last_undegraded":"2024-08-17T02:25:14.670142+0000","last_fullsized":"2024-08-17T02:25:14.670142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:33.349779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679271+0000","last_change":"2024-08-17T02:25:14.674759+0000","last_active":"2024-08-17T02:25:14.679271+0000","last_peered":"2024-08-17T02:25:14.679271+0000","last_clean":"2024-08-17T02:25:14.679271+0000","last_became_active":"2024-08-17T02:25:14.674396+0000","last_became_peered":"2024-08-17T02:25:14.674396+0000","last_unstale":"2024-08-17T02:25:14.679271+0000","last_undegraded":"2024-08-17T02:25:14.679271+0000","last_fullsized":"2024-08-17T02:25:14.679271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671878+0000","last_change":"2024-08-17T02:25:13.678511+0000","last_active":"2024-08-17T02:25:14.671878+0000","last_peered":"2024-08-17T02:25:14.671878+0000","last_clean":"2024-08-17T02:25:14.671878+0000","last_became_active":"2024-08-17T02:25:13.678154+0000","last_became_peered":"2024-08-17T02:25:13.678154+0000","last_unstale":"2024-08-17T02:25:14.671878+0000","last_undegraded":"2024-08-17T02:25:14.671878+0000","last_fullsized":"2024-08-17T02:25:14.671878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670650+0000","last_change":"2024-08-17T02:25:14.664508+0000","last_active":"2024-08-17T02:25:14.670650+0000","last_peered":"2024-08-17T02:25:14.670650+0000","last_clean":"2024-08-17T02:25:14.670650+0000","last_became_active":"2024-08-17T02:25:14.664227+0000","last_became_peered":"2024-08-17T02:25:14.664227+0000","last_unstale":"2024-08-17T02:25:14.670650+0000","last_undegraded":"2024-08-17T02:25:14.670650+0000","last_fullsized":"2024-08-17T02:25:14.670650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700270+0000","last_change":"2024-08-17T02:25:13.688660+0000","last_active":"2024-08-17T02:25:14.700270+0000","last_peered":"2024-08-17T02:25:14.700270+0000","last_clean":"2024-08-17T02:25:14.700270+0000","last_became_active":"2024-08-17T02:25:13.688164+0000","last_became_peered":"2024-08-17T02:25:13.688164+0000","last_unstale":"2024-08-17T02:25:14.700270+0000","last_undegraded":"2024-08-17T02:25:14.700270+0000","last_fullsized":"2024-08-17T02:25:14.700270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:48.757464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.685034+0000","last_change":"2024-08-17T02:25:14.673503+0000","last_active":"2024-08-17T02:25:14.685034+0000","last_peered":"2024-08-17T02:25:14.685034+0000","last_clean":"2024-08-17T02:25:14.685034+0000","last_became_active":"2024-08-17T02:25:14.673240+0000","last_became_peered":"2024-08-17T02:25:14.673240+0000","last_unstale":"2024-08-17T02:25:14.685034+0000","last_undegraded":"2024-08-17T02:25:14.685034+0000","last_fullsized":"2024-08-17T02:25:14.685034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683703+0000","last_change":"2024-08-17T02:25:14.676439+0000","last_active":"2024-08-17T02:25:14.683703+0000","last_peered":"2024-08-17T02:25:14.683703+0000","last_clean":"2024-08-17T02:25:14.683703+0000","last_became_active":"2024-08-17T02:25:14.676156+0000","last_became_peered":"2024-08-17T02:25:14.676156+0000","last_unstale":"2024-08-17T02:25:14.683703+0000","last_undegraded":"2024-08-17T02:25:14.683703+0000","last_fullsized":"2024-08-17T02:25:14.683703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:19.535692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700344+0000","last_change":"2024-08-17T02:25:13.686099+0000","last_active":"2024-08-17T02:25:14.700344+0000","last_peered":"2024-08-17T02:25:14.700344+0000","last_clean":"2024-08-17T02:25:14.700344+0000","last_became_active":"2024-08-17T02:25:13.685723+0000","last_became_peered":"2024-08-17T02:25:13.685723+0000","last_unstale":"2024-08-17T02:25:14.700344+0000","last_undegraded":"2024-08-17T02:25:14.700344+0000","last_fullsized":"2024-08-17T02:25:14.700344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:06.729225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684455+0000","last_change":"2024-08-17T02:25:14.678735+0000","last_active":"2024-08-17T02:25:14.684455+0000","last_peered":"2024-08-17T02:25:14.684455+0000","last_clean":"2024-08-17T02:25:14.684455+0000","last_became_active":"2024-08-17T02:25:14.676285+0000","last_became_peered":"2024-08-17T02:25:14.676285+0000","last_unstale":"2024-08-17T02:25:14.684455+0000","last_undegraded":"2024-08-17T02:25:14.684455+0000","last_fullsized":"2024-08-17T02:25:14.684455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:22.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700787+0000","last_change":"2024-08-17T02:25:13.686181+0000","last_active":"2024-08-17T02:25:14.700787+0000","last_peered":"2024-08-17T02:25:14.700787+0000","last_clean":"2024-08-17T02:25:14.700787+0000","last_became_active":"2024-08-17T02:25:13.685840+0000","last_became_peered":"2024-08-17T02:25:13.685840+0000","last_unstale":"2024-08-17T02:25:14.700787+0000","last_undegraded":"2024-08-17T02:25:14.700787+0000","last_fullsized":"2024-08-17T02:25:14.700787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681432+0000","last_change":"2024-08-17T02:25:14.677008+0000","last_active":"2024-08-17T02:25:14.681432+0000","last_peered":"2024-08-17T02:25:14.681432+0000","last_clean":"2024-08-17T02:25:14.681432+0000","last_became_active":"2024-08-17T02:25:14.675860+0000","last_became_peered":"2024-08-17T02:25:14.675860+0000","last_unstale":"2024-08-17T02:25:14.681432+0000","last_undegraded":"2024-08-17T02:25:14.681432+0000","last_fullsized":"2024-08-17T02:25:14.681432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699765+0000","last_change":"2024-08-17T02:25:13.680804+0000","last_active":"2024-08-17T02:25:14.699765+0000","last_peered":"2024-08-17T02:25:14.699765+0000","last_clean":"2024-08-17T02:25:14.699765+0000","last_became_active":"2024-08-17T02:25:13.679930+0000","last_became_peered":"2024-08-17T02:25:13.679930+0000","last_unstale":"2024-08-17T02:25:14.699765+0000","last_undegraded":"2024-08-17T02:25:14.699765+0000","last_fullsized":"2024-08-17T02:25:14.699765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.685317+0000","last_change":"2024-08-17T02:25:14.678511+0000","last_active":"2024-08-17T02:25:14.685317+0000","last_peered":"2024-08-17T02:25:14.685317+0000","last_clean":"2024-08-17T02:25:14.685317+0000","last_became_active":"2024-08-17T02:25:14.677265+0000","last_became_peered":"2024-08-17T02:25:14.677265+0000","last_unstale":"2024-08-17T02:25:14.685317+0000","last_undegraded":"2024-08-17T02:25:14.685317+0000","last_fullsized":"2024-08-17T02:25:14.685317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700062+0000","last_change":"2024-08-17T02:25:13.688293+0000","last_active":"2024-08-17T02:25:14.700062+0000","last_peered":"2024-08-17T02:25:14.700062+0000","last_clean":"2024-08-17T02:25:14.700062+0000","last_became_active":"2024-08-17T02:25:13.688046+0000","last_became_peered":"2024-08-17T02:25:13.688046+0000","last_unstale":"2024-08-17T02:25:14.700062+0000","last_undegraded":"2024-08-17T02:25:14.700062+0000","last_fullsized":"2024-08-17T02:25:14.700062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301728,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070112,"statfs":{"total":96636764160,"available":96327794688,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301712,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070128,"statfs":{"total":96636764160,"available":96327811072,"internally_reserved":0,"allocated":192512,"data_stored":64366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:20.648 INFO:tasks.ceph.mds.b.smithi169.stderr:2024-08-17T02:25:20.648+0000 7f5fbfe00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:25:23.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:23.690 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.690+0000 7fda08400640 1 Processor -- start 2024-08-17T02:25:23.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.690+0000 7fda08400640 1 -- start start 2024-08-17T02:25:23.692 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.691+0000 7fda08400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fda000cc800 0x7fda00067ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.691+0000 7fda08400640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda000ca700 con 0x7fda000cc430 2024-08-17T02:25:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.691+0000 7fda08400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda000684f0 con 0x7fda00062da0 2024-08-17T02:25:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.691+0000 7fda08400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda000ccbf0 con 0x7fda000cc800 2024-08-17T02:25:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.691+0000 7fda05a00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fda000cc430 0x7fda000cab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33376/0 (socket says 172.21.15.45:33376) 2024-08-17T02:25:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.691+0000 7fda05a00640 1 -- 172.21.15.45:0/4139099083 learned_addr learned my addr 172.21.15.45:0/4139099083 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.692+0000 7fda06400640 1 --2- 172.21.15.45:0/4139099083 >> v2:172.21.15.169:3300/0 conn(0x7fda000cc800 0x7fda00067ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.692+0000 7fd9ffe00640 1 -- 172.21.15.45:0/4139099083 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131608525 0 0) 0x7fda000ca700 con 0x7fda000cc430 2024-08-17T02:25:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.692+0000 7fd9ffe00640 1 -- 172.21.15.45:0/4139099083 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9e80034e0 con 0x7fda000cc430 2024-08-17T02:25:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.692+0000 7fda06400640 1 -- 172.21.15.45:0/4139099083 >> v1:172.21.15.169:6789/0 conn(0x7fda00062da0 legacy=0x7fda000cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.692+0000 7fda06400640 1 -- 172.21.15.45:0/4139099083 >> v1:172.21.15.45:6789/0 conn(0x7fda000cc430 legacy=0x7fda000cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.693 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.692+0000 7fda06400640 1 -- 172.21.15.45:0/4139099083 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda000c9dd0 con 0x7fda000cc800 2024-08-17T02:25:23.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.693+0000 7fda06400640 1 --2- 172.21.15.45:0/4139099083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda000cc800 0x7fda00067ef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009e60 tx=0x7fd9f8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97ec709267f5e93a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.693+0000 7fd9ffe00640 1 -- 172.21.15.45:0/4139099083 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8007550 con 0x7fda000cc800 2024-08-17T02:25:23.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.694+0000 7fd9ffe00640 1 -- 172.21.15.45:0/4139099083 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f802d050 con 0x7fda000cc800 2024-08-17T02:25:23.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.694+0000 7fd9ffe00640 1 -- 172.21.15.45:0/4139099083 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80078c0 con 0x7fda000cc800 2024-08-17T02:25:23.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.694+0000 7fda08400640 1 -- 172.21.15.45:0/4139099083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda000cc800 msgr2=0x7fda00067ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.694+0000 7fda08400640 1 --2- 172.21.15.45:0/4139099083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda000cc800 0x7fda00067ef0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd9f8009e60 tx=0x7fd9f8009780 comp rx=0 tx=0).stop 2024-08-17T02:25:23.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.694+0000 7fda08400640 1 -- 172.21.15.45:0/4139099083 shutdown_connections 2024-08-17T02:25:23.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.694+0000 7fda08400640 1 --2- 172.21.15.45:0/4139099083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda000cc800 0x7fda00067ef0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.694+0000 7fda08400640 1 -- 172.21.15.45:0/4139099083 >> 172.21.15.45:0/4139099083 conn(0x7fda000afc30 msgr2=0x7fda000b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.694+0000 7fda08400640 1 -- 172.21.15.45:0/4139099083 shutdown_connections 2024-08-17T02:25:23.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.694+0000 7fda08400640 1 -- 172.21.15.45:0/4139099083 wait complete. 2024-08-17T02:25:23.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.696+0000 7fda08400640 1 Processor -- start 2024-08-17T02:25:23.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.696+0000 7fda08400640 1 -- start start 2024-08-17T02:25:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.696+0000 7fda08400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda00062da0 0x7fda000c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.696+0000 7fda08400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda000cc430 0x7fda00099a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda08400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda000cc800 0x7fda00150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda08400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda000c7d00 con 0x7fda000cc800 2024-08-17T02:25:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda08400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda000c7fe0 con 0x7fda00062da0 2024-08-17T02:25:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda08400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda000c82c0 con 0x7fda000cc430 2024-08-17T02:25:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda06400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda000cc800 0x7fda00150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda06400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda000cc800 0x7fda00150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56906/0 (socket says 172.21.15.45:56906) 2024-08-17T02:25:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda06400640 1 -- 172.21.15.45:0/1971699928 learned_addr learned my addr 172.21.15.45:0/1971699928 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda05a00640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda00062da0 0x7fda000c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda05000640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda000cc430 0x7fda00099a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda06400640 1 -- 172.21.15.45:0/1971699928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda000cc430 msgr2=0x7fda00099a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda06400640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda000cc430 0x7fda00099a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda06400640 1 -- 172.21.15.45:0/1971699928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda00062da0 msgr2=0x7fda000c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda06400640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda00062da0 0x7fda000c8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda06400640 1 -- 172.21.15.45:0/1971699928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f8009a20 con 0x7fda000cc800 2024-08-17T02:25:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.697+0000 7fda05a00640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda00062da0 0x7fda000c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.698+0000 7fda06400640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda000cc800 0x7fda00150d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80097c0 tx=0x7fd9f8037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.698+0000 7fd9fcc00640 1 -- 172.21.15.45:0/1971699928 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8031ac0 con 0x7fda000cc800 2024-08-17T02:25:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.698+0000 7fd9fcc00640 1 -- 172.21.15.45:0/1971699928 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f8031c20 con 0x7fda000cc800 2024-08-17T02:25:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.698+0000 7fda08400640 1 -- 172.21.15.45:0/1971699928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda000c85a0 con 0x7fda000cc800 2024-08-17T02:25:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.698+0000 7fd9fcc00640 1 -- 172.21.15.45:0/1971699928 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f803c420 con 0x7fda000cc800 2024-08-17T02:25:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.698+0000 7fda08400640 1 -- 172.21.15.45:0/1971699928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda000c92e0 con 0x7fda000cc800 2024-08-17T02:25:23.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.699+0000 7fda08400640 1 -- 172.21.15.45:0/1971699928 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda000c8aa0 con 0x7fda000cc800 2024-08-17T02:25:23.702 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.700+0000 7fd9fcc00640 1 -- 172.21.15.45:0/1971699928 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd9f8003040 con 0x7fda000cc800 2024-08-17T02:25:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.701+0000 7fd9fcc00640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd9e0065150 0x7fd9e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.701+0000 7fd9fcc00640 1 -- 172.21.15.45:0/1971699928 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd9f80a3870 con 0x7fda000cc800 2024-08-17T02:25:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.701+0000 7fda05a00640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd9e0065150 0x7fd9e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.701+0000 7fda05a00640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd9e0065150 0x7fd9e0067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4005840 tx=0x7fd9f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:23.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.705+0000 7fd9fcc00640 1 -- 172.21.15.45:0/1971699928 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd9f8071890 con 0x7fda000cc800 2024-08-17T02:25:23.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.883+0000 7fda08400640 1 -- 172.21.15.45:0/1971699928 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda00064db0 con 0x7fd9e0065150 2024-08-17T02:25:23.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.890+0000 7fd9fcc00640 1 -- 172.21.15.45:0/1971699928 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264595 (secure 0 0 0) 0x7fda00064db0 con 0x7fd9e0065150 2024-08-17T02:25:23.894 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:23.895 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.894+0000 7fda08400640 1 -- 172.21.15.45:0/1971699928 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd9e0065150 msgr2=0x7fd9e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.894+0000 7fda08400640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd9e0065150 0x7fd9e0067600 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4005840 tx=0x7fd9f4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:23.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.894+0000 7fda08400640 1 -- 172.21.15.45:0/1971699928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda000cc800 msgr2=0x7fda00150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.894+0000 7fda08400640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda000cc800 0x7fda00150d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80097c0 tx=0x7fd9f8037000 comp rx=0 tx=0).stop 2024-08-17T02:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.894+0000 7fda08400640 1 -- 172.21.15.45:0/1971699928 shutdown_connections 2024-08-17T02:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.894+0000 7fda08400640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda000cc800 0x7fda00150d80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.894+0000 7fda08400640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd9e0065150 0x7fd9e0067600 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.894+0000 7fda08400640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fda000cc430 0x7fda00099a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.894+0000 7fda08400640 1 --2- 172.21.15.45:0/1971699928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fda00062da0 0x7fda000c8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.894+0000 7fda08400640 1 -- 172.21.15.45:0/1971699928 >> 172.21.15.45:0/1971699928 conn(0x7fda000afc30 msgr2=0x7fda000b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.895+0000 7fda08400640 1 -- 172.21.15.45:0/1971699928 shutdown_connections 2024-08-17T02:25:23.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:23.895+0000 7fda08400640 1 -- 172.21.15.45:0/1971699928 wait complete. 2024-08-17T02:25:23.911 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-08-17T02:25:23.659132+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398328,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576392,"statfs":{"total":773094113280,"available":770638225408,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.005493"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694749+0000","last_change":"2024-08-17T02:25:14.688635+0000","last_active":"2024-08-17T02:25:14.694749+0000","last_peered":"2024-08-17T02:25:14.694749+0000","last_clean":"2024-08-17T02:25:14.694749+0000","last_became_active":"2024-08-17T02:25:14.688409+0000","last_became_peered":"2024-08-17T02:25:14.688409+0000","last_unstale":"2024-08-17T02:25:14.694749+0000","last_undegraded":"2024-08-17T02:25:14.694749+0000","last_fullsized":"2024-08-17T02:25:14.694749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:32.913252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686216+0000","last_change":"2024-08-17T02:25:14.685522+0000","last_active":"2024-08-17T02:25:14.686216+0000","last_peered":"2024-08-17T02:25:14.686216+0000","last_clean":"2024-08-17T02:25:14.686216+0000","last_became_active":"2024-08-17T02:25:14.685146+0000","last_became_peered":"2024-08-17T02:25:14.685146+0000","last_unstale":"2024-08-17T02:25:14.686216+0000","last_undegraded":"2024-08-17T02:25:14.686216+0000","last_fullsized":"2024-08-17T02:25:14.686216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.669173+0000","last_change":"2024-08-17T02:25:14.668249+0000","last_active":"2024-08-17T02:25:14.669173+0000","last_peered":"2024-08-17T02:25:14.669173+0000","last_clean":"2024-08-17T02:25:14.669173+0000","last_became_active":"2024-08-17T02:25:14.667916+0000","last_became_peered":"2024-08-17T02:25:14.667916+0000","last_unstale":"2024-08-17T02:25:14.669173+0000","last_undegraded":"2024-08-17T02:25:14.669173+0000","last_fullsized":"2024-08-17T02:25:14.669173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678079+0000","last_change":"2024-08-17T02:25:14.667371+0000","last_active":"2024-08-17T02:25:14.678079+0000","last_peered":"2024-08-17T02:25:14.678079+0000","last_clean":"2024-08-17T02:25:14.678079+0000","last_became_active":"2024-08-17T02:25:14.666507+0000","last_became_peered":"2024-08-17T02:25:14.666507+0000","last_unstale":"2024-08-17T02:25:14.678079+0000","last_undegraded":"2024-08-17T02:25:14.678079+0000","last_fullsized":"2024-08-17T02:25:14.678079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:32.913252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.680072+0000","last_change":"2024-08-17T02:25:14.673429+0000","last_active":"2024-08-17T02:25:14.680072+0000","last_peered":"2024-08-17T02:25:14.680072+0000","last_clean":"2024-08-17T02:25:14.680072+0000","last_became_active":"2024-08-17T02:25:14.673116+0000","last_became_peered":"2024-08-17T02:25:14.673116+0000","last_unstale":"2024-08-17T02:25:14.680072+0000","last_undegraded":"2024-08-17T02:25:14.680072+0000","last_fullsized":"2024-08-17T02:25:14.680072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678094+0000","last_change":"2024-08-17T02:25:14.665820+0000","last_active":"2024-08-17T02:25:14.678094+0000","last_peered":"2024-08-17T02:25:14.678094+0000","last_clean":"2024-08-17T02:25:14.678094+0000","last_became_active":"2024-08-17T02:25:14.665533+0000","last_became_peered":"2024-08-17T02:25:14.665533+0000","last_unstale":"2024-08-17T02:25:14.678094+0000","last_undegraded":"2024-08-17T02:25:14.678094+0000","last_fullsized":"2024-08-17T02:25:14.678094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:07.562236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693398+0000","last_change":"2024-08-17T02:25:14.685204+0000","last_active":"2024-08-17T02:25:14.693398+0000","last_peered":"2024-08-17T02:25:14.693398+0000","last_clean":"2024-08-17T02:25:14.693398+0000","last_became_active":"2024-08-17T02:25:14.684913+0000","last_became_peered":"2024-08-17T02:25:14.684913+0000","last_unstale":"2024-08-17T02:25:14.693398+0000","last_undegraded":"2024-08-17T02:25:14.693398+0000","last_fullsized":"2024-08-17T02:25:14.693398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:27:44.886508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679252+0000","last_change":"2024-08-17T02:25:14.671977+0000","last_active":"2024-08-17T02:25:14.679252+0000","last_peered":"2024-08-17T02:25:14.679252+0000","last_clean":"2024-08-17T02:25:14.679252+0000","last_became_active":"2024-08-17T02:25:14.671715+0000","last_became_peered":"2024-08-17T02:25:14.671715+0000","last_unstale":"2024-08-17T02:25:14.679252+0000","last_undegraded":"2024-08-17T02:25:14.679252+0000","last_fullsized":"2024-08-17T02:25:14.679252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690194+0000","last_change":"2024-08-17T02:25:14.682177+0000","last_active":"2024-08-17T02:25:14.690194+0000","last_peered":"2024-08-17T02:25:14.690194+0000","last_clean":"2024-08-17T02:25:14.690194+0000","last_became_active":"2024-08-17T02:25:14.681923+0000","last_became_peered":"2024-08-17T02:25:14.681923+0000","last_unstale":"2024-08-17T02:25:14.690194+0000","last_undegraded":"2024-08-17T02:25:14.690194+0000","last_fullsized":"2024-08-17T02:25:14.690194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:07.562236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689537+0000","last_change":"2024-08-17T02:25:14.684528+0000","last_active":"2024-08-17T02:25:14.689537+0000","last_peered":"2024-08-17T02:25:14.689537+0000","last_clean":"2024-08-17T02:25:14.689537+0000","last_became_active":"2024-08-17T02:25:14.684273+0000","last_became_peered":"2024-08-17T02:25:14.684273+0000","last_unstale":"2024-08-17T02:25:14.689537+0000","last_undegraded":"2024-08-17T02:25:14.689537+0000","last_fullsized":"2024-08-17T02:25:14.689537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693057+0000","last_change":"2024-08-17T02:25:14.687803+0000","last_active":"2024-08-17T02:25:14.693057+0000","last_peered":"2024-08-17T02:25:14.693057+0000","last_clean":"2024-08-17T02:25:14.693057+0000","last_became_active":"2024-08-17T02:25:14.687474+0000","last_became_peered":"2024-08-17T02:25:14.687474+0000","last_unstale":"2024-08-17T02:25:14.693057+0000","last_undegraded":"2024-08-17T02:25:14.693057+0000","last_fullsized":"2024-08-17T02:25:14.693057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694472+0000","last_change":"2024-08-17T02:25:14.688106+0000","last_active":"2024-08-17T02:25:14.694472+0000","last_peered":"2024-08-17T02:25:14.694472+0000","last_clean":"2024-08-17T02:25:14.694472+0000","last_became_active":"2024-08-17T02:25:14.687884+0000","last_became_peered":"2024-08-17T02:25:14.687884+0000","last_unstale":"2024-08-17T02:25:14.694472+0000","last_undegraded":"2024-08-17T02:25:14.694472+0000","last_fullsized":"2024-08-17T02:25:14.694472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:07.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678556+0000","last_change":"2024-08-17T02:25:14.675832+0000","last_active":"2024-08-17T02:25:14.678556+0000","last_peered":"2024-08-17T02:25:14.678556+0000","last_clean":"2024-08-17T02:25:14.678556+0000","last_became_active":"2024-08-17T02:25:14.674356+0000","last_became_peered":"2024-08-17T02:25:14.674356+0000","last_unstale":"2024-08-17T02:25:14.678556+0000","last_undegraded":"2024-08-17T02:25:14.678556+0000","last_fullsized":"2024-08-17T02:25:14.678556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686167+0000","last_change":"2024-08-17T02:25:14.682873+0000","last_active":"2024-08-17T02:25:14.686167+0000","last_peered":"2024-08-17T02:25:14.686167+0000","last_clean":"2024-08-17T02:25:14.686167+0000","last_became_active":"2024-08-17T02:25:14.678077+0000","last_became_peered":"2024-08-17T02:25:14.678077+0000","last_unstale":"2024-08-17T02:25:14.686167+0000","last_undegraded":"2024-08-17T02:25:14.686167+0000","last_fullsized":"2024-08-17T02:25:14.686167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:34.226633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678037+0000","last_change":"2024-08-17T02:25:14.675577+0000","last_active":"2024-08-17T02:25:14.678037+0000","last_peered":"2024-08-17T02:25:14.678037+0000","last_clean":"2024-08-17T02:25:14.678037+0000","last_became_active":"2024-08-17T02:25:14.675346+0000","last_became_peered":"2024-08-17T02:25:14.675346+0000","last_unstale":"2024-08-17T02:25:14.678037+0000","last_undegraded":"2024-08-17T02:25:14.678037+0000","last_fullsized":"2024-08-17T02:25:14.678037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678546+0000","last_change":"2024-08-17T02:25:14.664639+0000","last_active":"2024-08-17T02:25:14.678546+0000","last_peered":"2024-08-17T02:25:14.678546+0000","last_clean":"2024-08-17T02:25:14.678546+0000","last_became_active":"2024-08-17T02:25:14.664238+0000","last_became_peered":"2024-08-17T02:25:14.664238+0000","last_unstale":"2024-08-17T02:25:14.678546+0000","last_undegraded":"2024-08-17T02:25:14.678546+0000","last_fullsized":"2024-08-17T02:25:14.678546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681035+0000","last_change":"2024-08-17T02:25:14.673971+0000","last_active":"2024-08-17T02:25:14.681035+0000","last_peered":"2024-08-17T02:25:14.681035+0000","last_clean":"2024-08-17T02:25:14.681035+0000","last_became_active":"2024-08-17T02:25:14.673681+0000","last_became_peered":"2024-08-17T02:25:14.673681+0000","last_unstale":"2024-08-17T02:25:14.681035+0000","last_undegraded":"2024-08-17T02:25:14.681035+0000","last_fullsized":"2024-08-17T02:25:14.681035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681015+0000","last_change":"2024-08-17T02:25:14.679222+0000","last_active":"2024-08-17T02:25:14.681015+0000","last_peered":"2024-08-17T02:25:14.681015+0000","last_clean":"2024-08-17T02:25:14.681015+0000","last_became_active":"2024-08-17T02:25:14.678854+0000","last_became_peered":"2024-08-17T02:25:14.678854+0000","last_unstale":"2024-08-17T02:25:14.681015+0000","last_undegraded":"2024-08-17T02:25:14.681015+0000","last_fullsized":"2024-08-17T02:25:14.681015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:49.762929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690292+0000","last_change":"2024-08-17T02:25:14.675322+0000","last_active":"2024-08-17T02:25:14.690292+0000","last_peered":"2024-08-17T02:25:14.690292+0000","last_clean":"2024-08-17T02:25:14.690292+0000","last_became_active":"2024-08-17T02:25:14.675062+0000","last_became_peered":"2024-08-17T02:25:14.675062+0000","last_unstale":"2024-08-17T02:25:14.690292+0000","last_undegraded":"2024-08-17T02:25:14.690292+0000","last_fullsized":"2024-08-17T02:25:14.690292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693140+0000","last_change":"2024-08-17T02:25:14.688691+0000","last_active":"2024-08-17T02:25:14.693140+0000","last_peered":"2024-08-17T02:25:14.693140+0000","last_clean":"2024-08-17T02:25:14.693140+0000","last_became_active":"2024-08-17T02:25:14.688426+0000","last_became_peered":"2024-08-17T02:25:14.688426+0000","last_unstale":"2024-08-17T02:25:14.693140+0000","last_undegraded":"2024-08-17T02:25:14.693140+0000","last_fullsized":"2024-08-17T02:25:14.693140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684959+0000","last_change":"2024-08-17T02:25:14.677713+0000","last_active":"2024-08-17T02:25:14.684959+0000","last_peered":"2024-08-17T02:25:14.684959+0000","last_clean":"2024-08-17T02:25:14.684959+0000","last_became_active":"2024-08-17T02:25:14.676684+0000","last_became_peered":"2024-08-17T02:25:14.676684+0000","last_unstale":"2024-08-17T02:25:14.684959+0000","last_undegraded":"2024-08-17T02:25:14.684959+0000","last_fullsized":"2024-08-17T02:25:14.684959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683534+0000","last_change":"2024-08-17T02:25:14.677693+0000","last_active":"2024-08-17T02:25:14.683534+0000","last_peered":"2024-08-17T02:25:14.683534+0000","last_clean":"2024-08-17T02:25:14.683534+0000","last_became_active":"2024-08-17T02:25:14.675085+0000","last_became_peered":"2024-08-17T02:25:14.675085+0000","last_unstale":"2024-08-17T02:25:14.683534+0000","last_undegraded":"2024-08-17T02:25:14.683534+0000","last_fullsized":"2024-08-17T02:25:14.683534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686732+0000","last_change":"2024-08-17T02:25:14.680570+0000","last_active":"2024-08-17T02:25:14.686732+0000","last_peered":"2024-08-17T02:25:14.686732+0000","last_clean":"2024-08-17T02:25:14.686732+0000","last_became_active":"2024-08-17T02:25:14.680331+0000","last_became_peered":"2024-08-17T02:25:14.680331+0000","last_unstale":"2024-08-17T02:25:14.686732+0000","last_undegraded":"2024-08-17T02:25:14.686732+0000","last_fullsized":"2024-08-17T02:25:14.686732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678558+0000","last_change":"2024-08-17T02:25:14.669965+0000","last_active":"2024-08-17T02:25:14.678558+0000","last_peered":"2024-08-17T02:25:14.678558+0000","last_clean":"2024-08-17T02:25:14.678558+0000","last_became_active":"2024-08-17T02:25:14.669710+0000","last_became_peered":"2024-08-17T02:25:14.669710+0000","last_unstale":"2024-08-17T02:25:14.678558+0000","last_undegraded":"2024-08-17T02:25:14.678558+0000","last_fullsized":"2024-08-17T02:25:14.678558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686777+0000","last_change":"2024-08-17T02:25:14.680996+0000","last_active":"2024-08-17T02:25:14.686777+0000","last_peered":"2024-08-17T02:25:14.686777+0000","last_clean":"2024-08-17T02:25:14.686777+0000","last_became_active":"2024-08-17T02:25:14.680672+0000","last_became_peered":"2024-08-17T02:25:14.680672+0000","last_unstale":"2024-08-17T02:25:14.686777+0000","last_undegraded":"2024-08-17T02:25:14.686777+0000","last_fullsized":"2024-08-17T02:25:14.686777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686709+0000","last_change":"2024-08-17T02:25:14.682018+0000","last_active":"2024-08-17T02:25:14.686709+0000","last_peered":"2024-08-17T02:25:14.686709+0000","last_clean":"2024-08-17T02:25:14.686709+0000","last_became_active":"2024-08-17T02:25:14.681624+0000","last_became_peered":"2024-08-17T02:25:14.681624+0000","last_unstale":"2024-08-17T02:25:14.686709+0000","last_undegraded":"2024-08-17T02:25:14.686709+0000","last_fullsized":"2024-08-17T02:25:14.686709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.674157+0000","last_change":"2024-08-17T02:25:14.673348+0000","last_active":"2024-08-17T02:25:14.674157+0000","last_peered":"2024-08-17T02:25:14.674157+0000","last_clean":"2024-08-17T02:25:14.674157+0000","last_became_active":"2024-08-17T02:25:14.672984+0000","last_became_peered":"2024-08-17T02:25:14.672984+0000","last_unstale":"2024-08-17T02:25:14.674157+0000","last_undegraded":"2024-08-17T02:25:14.674157+0000","last_fullsized":"2024-08-17T02:25:14.674157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686798+0000","last_change":"2024-08-17T02:25:14.681879+0000","last_active":"2024-08-17T02:25:14.686798+0000","last_peered":"2024-08-17T02:25:14.686798+0000","last_clean":"2024-08-17T02:25:14.686798+0000","last_became_active":"2024-08-17T02:25:14.681545+0000","last_became_peered":"2024-08-17T02:25:14.681545+0000","last_unstale":"2024-08-17T02:25:14.686798+0000","last_undegraded":"2024-08-17T02:25:14.686798+0000","last_fullsized":"2024-08-17T02:25:14.686798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:59.372660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684978+0000","last_change":"2024-08-17T02:25:14.680092+0000","last_active":"2024-08-17T02:25:14.684978+0000","last_peered":"2024-08-17T02:25:14.684978+0000","last_clean":"2024-08-17T02:25:14.684978+0000","last_became_active":"2024-08-17T02:25:14.677406+0000","last_became_peered":"2024-08-17T02:25:14.677406+0000","last_unstale":"2024-08-17T02:25:14.684978+0000","last_undegraded":"2024-08-17T02:25:14.684978+0000","last_fullsized":"2024-08-17T02:25:14.684978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:12.662553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678115+0000","last_change":"2024-08-17T02:25:14.668666+0000","last_active":"2024-08-17T02:25:14.678115+0000","last_peered":"2024-08-17T02:25:14.678115+0000","last_clean":"2024-08-17T02:25:14.678115+0000","last_became_active":"2024-08-17T02:25:14.668347+0000","last_became_peered":"2024-08-17T02:25:14.668347+0000","last_unstale":"2024-08-17T02:25:14.678115+0000","last_undegraded":"2024-08-17T02:25:14.678115+0000","last_fullsized":"2024-08-17T02:25:14.678115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:27:44.886508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670824+0000","last_change":"2024-08-17T02:25:14.668138+0000","last_active":"2024-08-17T02:25:14.670824+0000","last_peered":"2024-08-17T02:25:14.670824+0000","last_clean":"2024-08-17T02:25:14.670824+0000","last_became_active":"2024-08-17T02:25:14.667760+0000","last_became_peered":"2024-08-17T02:25:14.667760+0000","last_unstale":"2024-08-17T02:25:14.670824+0000","last_undegraded":"2024-08-17T02:25:14.670824+0000","last_fullsized":"2024-08-17T02:25:14.670824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:07.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683761+0000","last_change":"2024-08-17T02:25:14.674636+0000","last_active":"2024-08-17T02:25:14.683761+0000","last_peered":"2024-08-17T02:25:14.683761+0000","last_clean":"2024-08-17T02:25:14.683761+0000","last_became_active":"2024-08-17T02:25:14.674133+0000","last_became_peered":"2024-08-17T02:25:14.674133+0000","last_unstale":"2024-08-17T02:25:14.683761+0000","last_undegraded":"2024-08-17T02:25:14.683761+0000","last_fullsized":"2024-08-17T02:25:14.683761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689013+0000","last_change":"2024-08-17T02:25:14.677807+0000","last_active":"2024-08-17T02:25:14.689013+0000","last_peered":"2024-08-17T02:25:14.689013+0000","last_clean":"2024-08-17T02:25:14.689013+0000","last_became_active":"2024-08-17T02:25:14.677600+0000","last_became_peered":"2024-08-17T02:25:14.677600+0000","last_unstale":"2024-08-17T02:25:14.689013+0000","last_undegraded":"2024-08-17T02:25:14.689013+0000","last_fullsized":"2024-08-17T02:25:14.689013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:20.793789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700661+0000","last_change":"2024-08-17T02:25:13.676038+0000","last_active":"2024-08-17T02:25:14.700661+0000","last_peered":"2024-08-17T02:25:14.700661+0000","last_clean":"2024-08-17T02:25:14.700661+0000","last_became_active":"2024-08-17T02:25:13.675729+0000","last_became_peered":"2024-08-17T02:25:13.675729+0000","last_unstale":"2024-08-17T02:25:14.700661+0000","last_undegraded":"2024-08-17T02:25:14.700661+0000","last_fullsized":"2024-08-17T02:25:14.700661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684995+0000","last_change":"2024-08-17T02:25:14.680735+0000","last_active":"2024-08-17T02:25:14.684995+0000","last_peered":"2024-08-17T02:25:14.684995+0000","last_clean":"2024-08-17T02:25:14.684995+0000","last_became_active":"2024-08-17T02:25:14.679254+0000","last_became_peered":"2024-08-17T02:25:14.679254+0000","last_unstale":"2024-08-17T02:25:14.684995+0000","last_undegraded":"2024-08-17T02:25:14.684995+0000","last_fullsized":"2024-08-17T02:25:14.684995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700214+0000","last_change":"2024-08-17T02:25:13.685739+0000","last_active":"2024-08-17T02:25:14.700214+0000","last_peered":"2024-08-17T02:25:14.700214+0000","last_clean":"2024-08-17T02:25:14.700214+0000","last_became_active":"2024-08-17T02:25:13.685479+0000","last_became_peered":"2024-08-17T02:25:13.685479+0000","last_unstale":"2024-08-17T02:25:14.700214+0000","last_undegraded":"2024-08-17T02:25:14.700214+0000","last_fullsized":"2024-08-17T02:25:14.700214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660450+0000","last_change":"2024-08-17T02:25:13.674789+0000","last_active":"2024-08-17T02:25:14.660450+0000","last_peered":"2024-08-17T02:25:14.660450+0000","last_clean":"2024-08-17T02:25:14.660450+0000","last_became_active":"2024-08-17T02:25:13.674512+0000","last_became_peered":"2024-08-17T02:25:13.674512+0000","last_unstale":"2024-08-17T02:25:14.660450+0000","last_undegraded":"2024-08-17T02:25:14.660450+0000","last_fullsized":"2024-08-17T02:25:14.660450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671875+0000","last_change":"2024-08-17T02:25:14.663923+0000","last_active":"2024-08-17T02:25:14.671875+0000","last_peered":"2024-08-17T02:25:14.671875+0000","last_clean":"2024-08-17T02:25:14.671875+0000","last_became_active":"2024-08-17T02:25:14.663671+0000","last_became_peered":"2024-08-17T02:25:14.663671+0000","last_unstale":"2024-08-17T02:25:14.671875+0000","last_undegraded":"2024-08-17T02:25:14.671875+0000","last_fullsized":"2024-08-17T02:25:14.671875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.659542+0000","last_change":"2024-08-17T02:25:13.679503+0000","last_active":"2024-08-17T02:25:14.659542+0000","last_peered":"2024-08-17T02:25:14.659542+0000","last_clean":"2024-08-17T02:25:14.659542+0000","last_became_active":"2024-08-17T02:25:13.679226+0000","last_became_peered":"2024-08-17T02:25:13.679226+0000","last_unstale":"2024-08-17T02:25:14.659542+0000","last_undegraded":"2024-08-17T02:25:14.659542+0000","last_fullsized":"2024-08-17T02:25:14.659542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678019+0000","last_change":"2024-08-17T02:25:14.675096+0000","last_active":"2024-08-17T02:25:14.678019+0000","last_peered":"2024-08-17T02:25:14.678019+0000","last_clean":"2024-08-17T02:25:14.678019+0000","last_became_active":"2024-08-17T02:25:14.672309+0000","last_became_peered":"2024-08-17T02:25:14.672309+0000","last_unstale":"2024-08-17T02:25:14.678019+0000","last_undegraded":"2024-08-17T02:25:14.678019+0000","last_fullsized":"2024-08-17T02:25:14.678019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.676600+0000","last_change":"2024-08-17T02:25:13.676652+0000","last_active":"2024-08-17T02:25:14.676600+0000","last_peered":"2024-08-17T02:25:14.676600+0000","last_clean":"2024-08-17T02:25:14.676600+0000","last_became_active":"2024-08-17T02:25:13.676364+0000","last_became_peered":"2024-08-17T02:25:13.676364+0000","last_unstale":"2024-08-17T02:25:14.676600+0000","last_undegraded":"2024-08-17T02:25:14.676600+0000","last_fullsized":"2024-08-17T02:25:14.676600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.682522+0000","last_change":"2024-08-17T02:25:14.672988+0000","last_active":"2024-08-17T02:25:14.682522+0000","last_peered":"2024-08-17T02:25:14.682522+0000","last_clean":"2024-08-17T02:25:14.682522+0000","last_became_active":"2024-08-17T02:25:14.672662+0000","last_became_peered":"2024-08-17T02:25:14.672662+0000","last_unstale":"2024-08-17T02:25:14.682522+0000","last_undegraded":"2024-08-17T02:25:14.682522+0000","last_fullsized":"2024-08-17T02:25:14.682522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658744+0000","last_change":"2024-08-17T02:25:13.676993+0000","last_active":"2024-08-17T02:25:14.658744+0000","last_peered":"2024-08-17T02:25:14.658744+0000","last_clean":"2024-08-17T02:25:14.658744+0000","last_became_active":"2024-08-17T02:25:13.674529+0000","last_became_peered":"2024-08-17T02:25:13.674529+0000","last_unstale":"2024-08-17T02:25:14.658744+0000","last_undegraded":"2024-08-17T02:25:14.658744+0000","last_fullsized":"2024-08-17T02:25:14.658744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681456+0000","last_change":"2024-08-17T02:25:14.677046+0000","last_active":"2024-08-17T02:25:14.681456+0000","last_peered":"2024-08-17T02:25:14.681456+0000","last_clean":"2024-08-17T02:25:14.681456+0000","last_became_active":"2024-08-17T02:25:14.676726+0000","last_became_peered":"2024-08-17T02:25:14.676726+0000","last_unstale":"2024-08-17T02:25:14.681456+0000","last_undegraded":"2024-08-17T02:25:14.681456+0000","last_fullsized":"2024-08-17T02:25:14.681456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700073+0000","last_change":"2024-08-17T02:25:13.685185+0000","last_active":"2024-08-17T02:25:14.700073+0000","last_peered":"2024-08-17T02:25:14.700073+0000","last_clean":"2024-08-17T02:25:14.700073+0000","last_became_active":"2024-08-17T02:25:13.684855+0000","last_became_peered":"2024-08-17T02:25:13.684855+0000","last_unstale":"2024-08-17T02:25:14.700073+0000","last_undegraded":"2024-08-17T02:25:14.700073+0000","last_fullsized":"2024-08-17T02:25:14.700073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689679+0000","last_change":"2024-08-17T02:25:14.684052+0000","last_active":"2024-08-17T02:25:14.689679+0000","last_peered":"2024-08-17T02:25:14.689679+0000","last_clean":"2024-08-17T02:25:14.689679+0000","last_became_active":"2024-08-17T02:25:14.682595+0000","last_became_peered":"2024-08-17T02:25:14.682595+0000","last_unstale":"2024-08-17T02:25:14.689679+0000","last_undegraded":"2024-08-17T02:25:14.689679+0000","last_fullsized":"2024-08-17T02:25:14.689679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:49.693684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.702862+0000","last_change":"2024-08-17T02:25:13.679399+0000","last_active":"2024-08-17T02:25:14.702862+0000","last_peered":"2024-08-17T02:25:14.702862+0000","last_clean":"2024-08-17T02:25:14.702862+0000","last_became_active":"2024-08-17T02:25:13.679142+0000","last_became_peered":"2024-08-17T02:25:13.679142+0000","last_unstale":"2024-08-17T02:25:14.702862+0000","last_undegraded":"2024-08-17T02:25:14.702862+0000","last_fullsized":"2024-08-17T02:25:14.702862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690311+0000","last_change":"2024-08-17T02:25:14.682175+0000","last_active":"2024-08-17T02:25:14.690311+0000","last_peered":"2024-08-17T02:25:14.690311+0000","last_clean":"2024-08-17T02:25:14.690311+0000","last_became_active":"2024-08-17T02:25:14.681498+0000","last_became_peered":"2024-08-17T02:25:14.681498+0000","last_unstale":"2024-08-17T02:25:14.690311+0000","last_undegraded":"2024-08-17T02:25:14.690311+0000","last_fullsized":"2024-08-17T02:25:14.690311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699519+0000","last_change":"2024-08-17T02:25:13.681889+0000","last_active":"2024-08-17T02:25:14.699519+0000","last_peered":"2024-08-17T02:25:14.699519+0000","last_clean":"2024-08-17T02:25:14.699519+0000","last_became_active":"2024-08-17T02:25:13.681485+0000","last_became_peered":"2024-08-17T02:25:13.681485+0000","last_unstale":"2024-08-17T02:25:14.699519+0000","last_undegraded":"2024-08-17T02:25:14.699519+0000","last_fullsized":"2024-08-17T02:25:14.699519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683304+0000","last_change":"2024-08-17T02:25:14.678042+0000","last_active":"2024-08-17T02:25:14.683304+0000","last_peered":"2024-08-17T02:25:14.683304+0000","last_clean":"2024-08-17T02:25:14.683304+0000","last_became_active":"2024-08-17T02:25:14.677441+0000","last_became_peered":"2024-08-17T02:25:14.677441+0000","last_unstale":"2024-08-17T02:25:14.683304+0000","last_undegraded":"2024-08-17T02:25:14.683304+0000","last_fullsized":"2024-08-17T02:25:14.683304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658041+0000","last_change":"2024-08-17T02:25:13.672280+0000","last_active":"2024-08-17T02:25:14.658041+0000","last_peered":"2024-08-17T02:25:14.658041+0000","last_clean":"2024-08-17T02:25:14.658041+0000","last_became_active":"2024-08-17T02:25:13.672021+0000","last_became_peered":"2024-08-17T02:25:13.672021+0000","last_unstale":"2024-08-17T02:25:14.658041+0000","last_undegraded":"2024-08-17T02:25:14.658041+0000","last_fullsized":"2024-08-17T02:25:14.658041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694737+0000","last_change":"2024-08-17T02:25:14.690951+0000","last_active":"2024-08-17T02:25:14.694737+0000","last_peered":"2024-08-17T02:25:14.694737+0000","last_clean":"2024-08-17T02:25:14.694737+0000","last_became_active":"2024-08-17T02:25:14.690640+0000","last_became_peered":"2024-08-17T02:25:14.690640+0000","last_unstale":"2024-08-17T02:25:14.694737+0000","last_undegraded":"2024-08-17T02:25:14.694737+0000","last_fullsized":"2024-08-17T02:25:14.694737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:38.177445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.666609+0000","last_change":"2024-08-17T02:25:13.678799+0000","last_active":"2024-08-17T02:25:14.666609+0000","last_peered":"2024-08-17T02:25:14.666609+0000","last_clean":"2024-08-17T02:25:14.666609+0000","last_became_active":"2024-08-17T02:25:13.678338+0000","last_became_peered":"2024-08-17T02:25:13.678338+0000","last_unstale":"2024-08-17T02:25:14.666609+0000","last_undegraded":"2024-08-17T02:25:14.666609+0000","last_fullsized":"2024-08-17T02:25:14.666609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684933+0000","last_change":"2024-08-17T02:25:14.677309+0000","last_active":"2024-08-17T02:25:14.684933+0000","last_peered":"2024-08-17T02:25:14.684933+0000","last_clean":"2024-08-17T02:25:14.684933+0000","last_became_active":"2024-08-17T02:25:14.673828+0000","last_became_peered":"2024-08-17T02:25:14.673828+0000","last_unstale":"2024-08-17T02:25:14.684933+0000","last_undegraded":"2024-08-17T02:25:14.684933+0000","last_fullsized":"2024-08-17T02:25:14.684933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.701579+0000","last_change":"2024-08-17T02:25:13.679207+0000","last_active":"2024-08-17T02:25:14.701579+0000","last_peered":"2024-08-17T02:25:14.701579+0000","last_clean":"2024-08-17T02:25:14.701579+0000","last_became_active":"2024-08-17T02:25:13.678895+0000","last_became_peered":"2024-08-17T02:25:13.678895+0000","last_unstale":"2024-08-17T02:25:14.701579+0000","last_undegraded":"2024-08-17T02:25:14.701579+0000","last_fullsized":"2024-08-17T02:25:14.701579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693362+0000","last_change":"2024-08-17T02:25:14.684764+0000","last_active":"2024-08-17T02:25:14.693362+0000","last_peered":"2024-08-17T02:25:14.693362+0000","last_clean":"2024-08-17T02:25:14.693362+0000","last_became_active":"2024-08-17T02:25:14.682919+0000","last_became_peered":"2024-08-17T02:25:14.682919+0000","last_unstale":"2024-08-17T02:25:14.693362+0000","last_undegraded":"2024-08-17T02:25:14.693362+0000","last_fullsized":"2024-08-17T02:25:14.693362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:22.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699314+0000","last_change":"2024-08-17T02:25:13.680283+0000","last_active":"2024-08-17T02:25:14.699314+0000","last_peered":"2024-08-17T02:25:14.699314+0000","last_clean":"2024-08-17T02:25:14.699314+0000","last_became_active":"2024-08-17T02:25:13.679891+0000","last_became_peered":"2024-08-17T02:25:13.679891+0000","last_unstale":"2024-08-17T02:25:14.699314+0000","last_undegraded":"2024-08-17T02:25:14.699314+0000","last_fullsized":"2024-08-17T02:25:14.699314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694975+0000","last_change":"2024-08-17T02:25:14.691471+0000","last_active":"2024-08-17T02:25:14.694975+0000","last_peered":"2024-08-17T02:25:14.694975+0000","last_clean":"2024-08-17T02:25:14.694975+0000","last_became_active":"2024-08-17T02:25:14.691171+0000","last_became_peered":"2024-08-17T02:25:14.691171+0000","last_unstale":"2024-08-17T02:25:14.694975+0000","last_undegraded":"2024-08-17T02:25:14.694975+0000","last_fullsized":"2024-08-17T02:25:14.694975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:19.535692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700333+0000","last_change":"2024-08-17T02:25:13.677536+0000","last_active":"2024-08-17T02:25:14.700333+0000","last_peered":"2024-08-17T02:25:14.700333+0000","last_clean":"2024-08-17T02:25:14.700333+0000","last_became_active":"2024-08-17T02:25:13.675183+0000","last_became_peered":"2024-08-17T02:25:13.675183+0000","last_unstale":"2024-08-17T02:25:14.700333+0000","last_undegraded":"2024-08-17T02:25:14.700333+0000","last_fullsized":"2024-08-17T02:25:14.700333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.695063+0000","last_change":"2024-08-17T02:25:14.692018+0000","last_active":"2024-08-17T02:25:14.695063+0000","last_peered":"2024-08-17T02:25:14.695063+0000","last_clean":"2024-08-17T02:25:14.695063+0000","last_became_active":"2024-08-17T02:25:14.691753+0000","last_became_peered":"2024-08-17T02:25:14.691753+0000","last_unstale":"2024-08-17T02:25:14.695063+0000","last_undegraded":"2024-08-17T02:25:14.695063+0000","last_fullsized":"2024-08-17T02:25:14.695063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:57.832736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699649+0000","last_change":"2024-08-17T02:25:13.684009+0000","last_active":"2024-08-17T02:25:14.699649+0000","last_peered":"2024-08-17T02:25:14.699649+0000","last_clean":"2024-08-17T02:25:14.699649+0000","last_became_active":"2024-08-17T02:25:13.683242+0000","last_became_peered":"2024-08-17T02:25:13.683242+0000","last_unstale":"2024-08-17T02:25:14.699649+0000","last_undegraded":"2024-08-17T02:25:14.699649+0000","last_fullsized":"2024-08-17T02:25:14.699649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:48.757464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678098+0000","last_change":"2024-08-17T02:25:14.667634+0000","last_active":"2024-08-17T02:25:14.678098+0000","last_peered":"2024-08-17T02:25:14.678098+0000","last_clean":"2024-08-17T02:25:14.678098+0000","last_became_active":"2024-08-17T02:25:14.667363+0000","last_became_peered":"2024-08-17T02:25:14.667363+0000","last_unstale":"2024-08-17T02:25:14.678098+0000","last_undegraded":"2024-08-17T02:25:14.678098+0000","last_fullsized":"2024-08-17T02:25:14.678098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:59.372660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660728+0000","last_change":"2024-08-17T02:25:13.668855+0000","last_active":"2024-08-17T02:25:14.660728+0000","last_peered":"2024-08-17T02:25:14.660728+0000","last_clean":"2024-08-17T02:25:14.660728+0000","last_became_active":"2024-08-17T02:25:13.668568+0000","last_became_peered":"2024-08-17T02:25:13.668568+0000","last_unstale":"2024-08-17T02:25:14.660728+0000","last_undegraded":"2024-08-17T02:25:14.660728+0000","last_fullsized":"2024-08-17T02:25:14.660728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694943+0000","last_change":"2024-08-17T02:25:14.691327+0000","last_active":"2024-08-17T02:25:14.694943+0000","last_peered":"2024-08-17T02:25:14.694943+0000","last_clean":"2024-08-17T02:25:14.694943+0000","last_became_active":"2024-08-17T02:25:14.690760+0000","last_became_peered":"2024-08-17T02:25:14.690760+0000","last_unstale":"2024-08-17T02:25:14.694943+0000","last_undegraded":"2024-08-17T02:25:14.694943+0000","last_fullsized":"2024-08-17T02:25:14.694943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.664056+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:25:14.664056+0000","last_peered":"2024-08-17T02:25:14.664056+0000","last_clean":"2024-08-17T02:25:14.664056+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:25:14.664056+0000","last_undegraded":"2024-08-17T02:25:14.664056+0000","last_fullsized":"2024-08-17T02:25:14.664056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.657956+0000","last_change":"2024-08-17T02:25:13.671609+0000","last_active":"2024-08-17T02:25:14.657956+0000","last_peered":"2024-08-17T02:25:14.657956+0000","last_clean":"2024-08-17T02:25:14.657956+0000","last_became_active":"2024-08-17T02:25:13.665871+0000","last_became_peered":"2024-08-17T02:25:13.665871+0000","last_unstale":"2024-08-17T02:25:14.657956+0000","last_undegraded":"2024-08-17T02:25:14.657956+0000","last_fullsized":"2024-08-17T02:25:14.657956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679635+0000","last_change":"2024-08-17T02:25:14.671245+0000","last_active":"2024-08-17T02:25:14.679635+0000","last_peered":"2024-08-17T02:25:14.679635+0000","last_clean":"2024-08-17T02:25:14.679635+0000","last_became_active":"2024-08-17T02:25:14.670965+0000","last_became_peered":"2024-08-17T02:25:14.670965+0000","last_unstale":"2024-08-17T02:25:14.679635+0000","last_undegraded":"2024-08-17T02:25:14.679635+0000","last_fullsized":"2024-08-17T02:25:14.679635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.663915+0000","last_change":"2024-08-17T02:25:13.687566+0000","last_active":"2024-08-17T02:25:14.663915+0000","last_peered":"2024-08-17T02:25:14.663915+0000","last_clean":"2024-08-17T02:25:14.663915+0000","last_became_active":"2024-08-17T02:25:13.687289+0000","last_became_peered":"2024-08-17T02:25:13.687289+0000","last_unstale":"2024-08-17T02:25:14.663915+0000","last_undegraded":"2024-08-17T02:25:14.663915+0000","last_fullsized":"2024-08-17T02:25:14.663915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684731+0000","last_change":"2024-08-17T02:25:14.678546+0000","last_active":"2024-08-17T02:25:14.684731+0000","last_peered":"2024-08-17T02:25:14.684731+0000","last_clean":"2024-08-17T02:25:14.684731+0000","last_became_active":"2024-08-17T02:25:14.677779+0000","last_became_peered":"2024-08-17T02:25:14.677779+0000","last_unstale":"2024-08-17T02:25:14.684731+0000","last_undegraded":"2024-08-17T02:25:14.684731+0000","last_fullsized":"2024-08-17T02:25:14.684731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660654+0000","last_change":"2024-08-17T02:25:13.668305+0000","last_active":"2024-08-17T02:25:14.660654+0000","last_peered":"2024-08-17T02:25:14.660654+0000","last_clean":"2024-08-17T02:25:14.660654+0000","last_became_active":"2024-08-17T02:25:13.667891+0000","last_became_peered":"2024-08-17T02:25:13.667891+0000","last_unstale":"2024-08-17T02:25:14.660654+0000","last_undegraded":"2024-08-17T02:25:14.660654+0000","last_fullsized":"2024-08-17T02:25:14.660654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.672921+0000","last_change":"2024-08-17T02:25:14.671227+0000","last_active":"2024-08-17T02:25:14.672921+0000","last_peered":"2024-08-17T02:25:14.672921+0000","last_clean":"2024-08-17T02:25:14.672921+0000","last_became_active":"2024-08-17T02:25:14.670957+0000","last_became_peered":"2024-08-17T02:25:14.670957+0000","last_unstale":"2024-08-17T02:25:14.672921+0000","last_undegraded":"2024-08-17T02:25:14.672921+0000","last_fullsized":"2024-08-17T02:25:14.672921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658042+0000","last_change":"2024-08-17T02:25:13.682523+0000","last_active":"2024-08-17T02:25:14.658042+0000","last_peered":"2024-08-17T02:25:14.658042+0000","last_clean":"2024-08-17T02:25:14.658042+0000","last_became_active":"2024-08-17T02:25:13.681263+0000","last_became_peered":"2024-08-17T02:25:13.681263+0000","last_unstale":"2024-08-17T02:25:14.658042+0000","last_undegraded":"2024-08-17T02:25:14.658042+0000","last_fullsized":"2024-08-17T02:25:14.658042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689867+0000","last_change":"2024-08-17T02:25:14.684673+0000","last_active":"2024-08-17T02:25:14.689867+0000","last_peered":"2024-08-17T02:25:14.689867+0000","last_clean":"2024-08-17T02:25:14.689867+0000","last_became_active":"2024-08-17T02:25:14.684108+0000","last_became_peered":"2024-08-17T02:25:14.684108+0000","last_unstale":"2024-08-17T02:25:14.689867+0000","last_undegraded":"2024-08-17T02:25:14.689867+0000","last_fullsized":"2024-08-17T02:25:14.689867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:49.762929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671095+0000","last_change":"2024-08-17T02:25:13.683299+0000","last_active":"2024-08-17T02:25:14.671095+0000","last_peered":"2024-08-17T02:25:14.671095+0000","last_clean":"2024-08-17T02:25:14.671095+0000","last_became_active":"2024-08-17T02:25:13.682446+0000","last_became_peered":"2024-08-17T02:25:13.682446+0000","last_unstale":"2024-08-17T02:25:14.671095+0000","last_undegraded":"2024-08-17T02:25:14.671095+0000","last_fullsized":"2024-08-17T02:25:14.671095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:48.688219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683680+0000","last_change":"2024-08-17T02:25:14.670920+0000","last_active":"2024-08-17T02:25:14.683680+0000","last_peered":"2024-08-17T02:25:14.683680+0000","last_clean":"2024-08-17T02:25:14.683680+0000","last_became_active":"2024-08-17T02:25:14.670641+0000","last_became_peered":"2024-08-17T02:25:14.670641+0000","last_unstale":"2024-08-17T02:25:14.683680+0000","last_undegraded":"2024-08-17T02:25:14.683680+0000","last_fullsized":"2024-08-17T02:25:14.683680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.666369+0000","last_change":"2024-08-17T02:25:13.686375+0000","last_active":"2024-08-17T02:25:14.666369+0000","last_peered":"2024-08-17T02:25:14.666369+0000","last_clean":"2024-08-17T02:25:14.666369+0000","last_became_active":"2024-08-17T02:25:13.686118+0000","last_became_peered":"2024-08-17T02:25:13.686118+0000","last_unstale":"2024-08-17T02:25:14.666369+0000","last_undegraded":"2024-08-17T02:25:14.666369+0000","last_fullsized":"2024-08-17T02:25:14.666369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:48.688219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.673713+0000","last_change":"2024-08-17T02:25:14.672615+0000","last_active":"2024-08-17T02:25:14.673713+0000","last_peered":"2024-08-17T02:25:14.673713+0000","last_clean":"2024-08-17T02:25:14.673713+0000","last_became_active":"2024-08-17T02:25:14.672282+0000","last_became_peered":"2024-08-17T02:25:14.672282+0000","last_unstale":"2024-08-17T02:25:14.673713+0000","last_undegraded":"2024-08-17T02:25:14.673713+0000","last_fullsized":"2024-08-17T02:25:14.673713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:15.670485+0000","last_change":"2024-08-17T02:25:13.683744+0000","last_active":"2024-08-17T02:25:15.670485+0000","last_peered":"2024-08-17T02:25:15.670485+0000","last_clean":"2024-08-17T02:25:15.670485+0000","last_became_active":"2024-08-17T02:25:13.683299+0000","last_became_peered":"2024-08-17T02:25:13.683299+0000","last_unstale":"2024-08-17T02:25:15.670485+0000","last_undegraded":"2024-08-17T02:25:15.670485+0000","last_fullsized":"2024-08-17T02:25:15.670485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:06.729225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686757+0000","last_change":"2024-08-17T02:25:14.680936+0000","last_active":"2024-08-17T02:25:14.686757+0000","last_peered":"2024-08-17T02:25:14.686757+0000","last_clean":"2024-08-17T02:25:14.686757+0000","last_became_active":"2024-08-17T02:25:14.680661+0000","last_became_peered":"2024-08-17T02:25:14.680661+0000","last_unstale":"2024-08-17T02:25:14.686757+0000","last_undegraded":"2024-08-17T02:25:14.686757+0000","last_fullsized":"2024-08-17T02:25:14.686757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.701405+0000","last_change":"2024-08-17T02:25:13.677363+0000","last_active":"2024-08-17T02:25:14.701405+0000","last_peered":"2024-08-17T02:25:14.701405+0000","last_clean":"2024-08-17T02:25:14.701405+0000","last_became_active":"2024-08-17T02:25:13.677094+0000","last_became_peered":"2024-08-17T02:25:13.677094+0000","last_unstale":"2024-08-17T02:25:14.701405+0000","last_undegraded":"2024-08-17T02:25:14.701405+0000","last_fullsized":"2024-08-17T02:25:14.701405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686590+0000","last_change":"2024-08-17T02:25:14.683885+0000","last_active":"2024-08-17T02:25:14.686590+0000","last_peered":"2024-08-17T02:25:14.686590+0000","last_clean":"2024-08-17T02:25:14.686590+0000","last_became_active":"2024-08-17T02:25:14.679041+0000","last_became_peered":"2024-08-17T02:25:14.679041+0000","last_unstale":"2024-08-17T02:25:14.686590+0000","last_undegraded":"2024-08-17T02:25:14.686590+0000","last_fullsized":"2024-08-17T02:25:14.686590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.661849+0000","last_change":"2024-08-17T02:25:13.685837+0000","last_active":"2024-08-17T02:25:14.661849+0000","last_peered":"2024-08-17T02:25:14.661849+0000","last_clean":"2024-08-17T02:25:14.661849+0000","last_became_active":"2024-08-17T02:25:13.685565+0000","last_became_peered":"2024-08-17T02:25:13.685565+0000","last_unstale":"2024-08-17T02:25:14.661849+0000","last_undegraded":"2024-08-17T02:25:14.661849+0000","last_fullsized":"2024-08-17T02:25:14.661849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:33.349779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.672818+0000","last_change":"2024-08-17T02:25:14.668966+0000","last_active":"2024-08-17T02:25:14.672818+0000","last_peered":"2024-08-17T02:25:14.672818+0000","last_clean":"2024-08-17T02:25:14.672818+0000","last_became_active":"2024-08-17T02:25:14.668718+0000","last_became_peered":"2024-08-17T02:25:14.668718+0000","last_unstale":"2024-08-17T02:25:14.672818+0000","last_undegraded":"2024-08-17T02:25:14.672818+0000","last_fullsized":"2024-08-17T02:25:14.672818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:34.355244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670142+0000","last_change":"2024-08-17T02:25:13.687912+0000","last_active":"2024-08-17T02:25:14.670142+0000","last_peered":"2024-08-17T02:25:14.670142+0000","last_clean":"2024-08-17T02:25:14.670142+0000","last_became_active":"2024-08-17T02:25:13.687603+0000","last_became_peered":"2024-08-17T02:25:13.687603+0000","last_unstale":"2024-08-17T02:25:14.670142+0000","last_undegraded":"2024-08-17T02:25:14.670142+0000","last_fullsized":"2024-08-17T02:25:14.670142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:33.349779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679271+0000","last_change":"2024-08-17T02:25:14.674759+0000","last_active":"2024-08-17T02:25:14.679271+0000","last_peered":"2024-08-17T02:25:14.679271+0000","last_clean":"2024-08-17T02:25:14.679271+0000","last_became_active":"2024-08-17T02:25:14.674396+0000","last_became_peered":"2024-08-17T02:25:14.674396+0000","last_unstale":"2024-08-17T02:25:14.679271+0000","last_undegraded":"2024-08-17T02:25:14.679271+0000","last_fullsized":"2024-08-17T02:25:14.679271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671878+0000","last_change":"2024-08-17T02:25:13.678511+0000","last_active":"2024-08-17T02:25:14.671878+0000","last_peered":"2024-08-17T02:25:14.671878+0000","last_clean":"2024-08-17T02:25:14.671878+0000","last_became_active":"2024-08-17T02:25:13.678154+0000","last_became_peered":"2024-08-17T02:25:13.678154+0000","last_unstale":"2024-08-17T02:25:14.671878+0000","last_undegraded":"2024-08-17T02:25:14.671878+0000","last_fullsized":"2024-08-17T02:25:14.671878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670650+0000","last_change":"2024-08-17T02:25:14.664508+0000","last_active":"2024-08-17T02:25:14.670650+0000","last_peered":"2024-08-17T02:25:14.670650+0000","last_clean":"2024-08-17T02:25:14.670650+0000","last_became_active":"2024-08-17T02:25:14.664227+0000","last_became_peered":"2024-08-17T02:25:14.664227+0000","last_unstale":"2024-08-17T02:25:14.670650+0000","last_undegraded":"2024-08-17T02:25:14.670650+0000","last_fullsized":"2024-08-17T02:25:14.670650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700270+0000","last_change":"2024-08-17T02:25:13.688660+0000","last_active":"2024-08-17T02:25:14.700270+0000","last_peered":"2024-08-17T02:25:14.700270+0000","last_clean":"2024-08-17T02:25:14.700270+0000","last_became_active":"2024-08-17T02:25:13.688164+0000","last_became_peered":"2024-08-17T02:25:13.688164+0000","last_unstale":"2024-08-17T02:25:14.700270+0000","last_undegraded":"2024-08-17T02:25:14.700270+0000","last_fullsized":"2024-08-17T02:25:14.700270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:48.757464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.685034+0000","last_change":"2024-08-17T02:25:14.673503+0000","last_active":"2024-08-17T02:25:14.685034+0000","last_peered":"2024-08-17T02:25:14.685034+0000","last_clean":"2024-08-17T02:25:14.685034+0000","last_became_active":"2024-08-17T02:25:14.673240+0000","last_became_peered":"2024-08-17T02:25:14.673240+0000","last_unstale":"2024-08-17T02:25:14.685034+0000","last_undegraded":"2024-08-17T02:25:14.685034+0000","last_fullsized":"2024-08-17T02:25:14.685034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683703+0000","last_change":"2024-08-17T02:25:14.676439+0000","last_active":"2024-08-17T02:25:14.683703+0000","last_peered":"2024-08-17T02:25:14.683703+0000","last_clean":"2024-08-17T02:25:14.683703+0000","last_became_active":"2024-08-17T02:25:14.676156+0000","last_became_peered":"2024-08-17T02:25:14.676156+0000","last_unstale":"2024-08-17T02:25:14.683703+0000","last_undegraded":"2024-08-17T02:25:14.683703+0000","last_fullsized":"2024-08-17T02:25:14.683703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:19.535692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700344+0000","last_change":"2024-08-17T02:25:13.686099+0000","last_active":"2024-08-17T02:25:14.700344+0000","last_peered":"2024-08-17T02:25:14.700344+0000","last_clean":"2024-08-17T02:25:14.700344+0000","last_became_active":"2024-08-17T02:25:13.685723+0000","last_became_peered":"2024-08-17T02:25:13.685723+0000","last_unstale":"2024-08-17T02:25:14.700344+0000","last_undegraded":"2024-08-17T02:25:14.700344+0000","last_fullsized":"2024-08-17T02:25:14.700344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:06.729225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684455+0000","last_change":"2024-08-17T02:25:14.678735+0000","last_active":"2024-08-17T02:25:14.684455+0000","last_peered":"2024-08-17T02:25:14.684455+0000","last_clean":"2024-08-17T02:25:14.684455+0000","last_became_active":"2024-08-17T02:25:14.676285+0000","last_became_peered":"2024-08-17T02:25:14.676285+0000","last_unstale":"2024-08-17T02:25:14.684455+0000","last_undegraded":"2024-08-17T02:25:14.684455+0000","last_fullsized":"2024-08-17T02:25:14.684455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:22.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700787+0000","last_change":"2024-08-17T02:25:13.686181+0000","last_active":"2024-08-17T02:25:14.700787+0000","last_peered":"2024-08-17T02:25:14.700787+0000","last_clean":"2024-08-17T02:25:14.700787+0000","last_became_active":"2024-08-17T02:25:13.685840+0000","last_became_peered":"2024-08-17T02:25:13.685840+0000","last_unstale":"2024-08-17T02:25:14.700787+0000","last_undegraded":"2024-08-17T02:25:14.700787+0000","last_fullsized":"2024-08-17T02:25:14.700787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681432+0000","last_change":"2024-08-17T02:25:14.677008+0000","last_active":"2024-08-17T02:25:14.681432+0000","last_peered":"2024-08-17T02:25:14.681432+0000","last_clean":"2024-08-17T02:25:14.681432+0000","last_became_active":"2024-08-17T02:25:14.675860+0000","last_became_peered":"2024-08-17T02:25:14.675860+0000","last_unstale":"2024-08-17T02:25:14.681432+0000","last_undegraded":"2024-08-17T02:25:14.681432+0000","last_fullsized":"2024-08-17T02:25:14.681432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699765+0000","last_change":"2024-08-17T02:25:13.680804+0000","last_active":"2024-08-17T02:25:14.699765+0000","last_peered":"2024-08-17T02:25:14.699765+0000","last_clean":"2024-08-17T02:25:14.699765+0000","last_became_active":"2024-08-17T02:25:13.679930+0000","last_became_peered":"2024-08-17T02:25:13.679930+0000","last_unstale":"2024-08-17T02:25:14.699765+0000","last_undegraded":"2024-08-17T02:25:14.699765+0000","last_fullsized":"2024-08-17T02:25:14.699765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.685317+0000","last_change":"2024-08-17T02:25:14.678511+0000","last_active":"2024-08-17T02:25:14.685317+0000","last_peered":"2024-08-17T02:25:14.685317+0000","last_clean":"2024-08-17T02:25:14.685317+0000","last_became_active":"2024-08-17T02:25:14.677265+0000","last_became_peered":"2024-08-17T02:25:14.677265+0000","last_unstale":"2024-08-17T02:25:14.685317+0000","last_undegraded":"2024-08-17T02:25:14.685317+0000","last_fullsized":"2024-08-17T02:25:14.685317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700062+0000","last_change":"2024-08-17T02:25:13.688293+0000","last_active":"2024-08-17T02:25:14.700062+0000","last_peered":"2024-08-17T02:25:14.700062+0000","last_clean":"2024-08-17T02:25:14.700062+0000","last_became_active":"2024-08-17T02:25:13.688046+0000","last_became_peered":"2024-08-17T02:25:13.688046+0000","last_unstale":"2024-08-17T02:25:14.700062+0000","last_undegraded":"2024-08-17T02:25:14.700062+0000","last_fullsized":"2024-08-17T02:25:14.700062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301728,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070112,"statfs":{"total":96636764160,"available":96327794688,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0329999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301716,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070124,"statfs":{"total":96636764160,"available":96327806976,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:23.916 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:25:23.916 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-17T02:25:23.916 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-08-17T02:25:23.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-08-17T02:25:23.917 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-08-17T02:25:24.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.102+0000 7f05fa800640 1 Processor -- start 2024-08-17T02:25:24.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.102+0000 7f05fa800640 1 -- start start 2024-08-17T02:25:24.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.103+0000 7f05fa800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05f4155900 0x7f05f4155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.103+0000 7f05fa800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f05f4158b30 0x7f05f40ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.103+0000 7f05fa800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f4157690 con 0x7f05f40b0270 2024-08-17T02:25:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.103+0000 7f05fa800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f4156a80 con 0x7f05f4155900 2024-08-17T02:25:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.103+0000 7f05fa800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f4156d60 con 0x7f05f4158b30 2024-08-17T02:25:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.103+0000 7f05f9400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05f4155900 0x7f05f4155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.103+0000 7f05f9400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05f4155900 0x7f05f4155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56914/0 (socket says 172.21.15.45:56914) 2024-08-17T02:25:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.103+0000 7f05f9400640 1 -- 172.21.15.45:0/1284945685 learned_addr learned my addr 172.21.15.45:0/1284945685 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.104+0000 7f05f9400640 1 -- 172.21.15.45:0/1284945685 >> v2:172.21.15.169:3300/0 conn(0x7f05f4158b30 msgr2=0x7f05f40ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.104+0000 7f05f9400640 1 --2- 172.21.15.45:0/1284945685 >> v2:172.21.15.169:3300/0 conn(0x7f05f4158b30 0x7f05f40ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.104+0000 7f05f9400640 1 -- 172.21.15.45:0/1284945685 >> v1:172.21.15.169:6789/0 conn(0x7f05f40b0270 legacy=0x7f05f4156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.104+0000 7f05f9400640 1 -- 172.21.15.45:0/1284945685 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f4157040 con 0x7f05f4155900 2024-08-17T02:25:24.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.105+0000 7f05f9400640 1 --2- 172.21.15.45:0/1284945685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f4155900 0x7f05f4155cd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f05f40b06c0 tx=0x7f05e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8f66e38f1b8bc0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.105+0000 7f05f3e00640 1 -- 172.21.15.45:0/1284945685 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e802add0 con 0x7f05f4155900 2024-08-17T02:25:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.105+0000 7f05f3e00640 1 -- 172.21.15.45:0/1284945685 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e8032440 con 0x7f05f4155900 2024-08-17T02:25:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.105+0000 7f05f3e00640 1 -- 172.21.15.45:0/1284945685 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e8032820 con 0x7f05f4155900 2024-08-17T02:25:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.105+0000 7f05fa800640 1 -- 172.21.15.45:0/1284945685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f4155900 msgr2=0x7f05f4155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.105+0000 7f05fa800640 1 --2- 172.21.15.45:0/1284945685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f4155900 0x7f05f4155cd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f05f40b06c0 tx=0x7f05e80091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.105+0000 7f05fa800640 1 -- 172.21.15.45:0/1284945685 shutdown_connections 2024-08-17T02:25:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.105+0000 7f05fa800640 1 --2- 172.21.15.45:0/1284945685 >> v2:172.21.15.169:3300/0 conn(0x7f05f4158b30 0x7f05f40ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.105+0000 7f05fa800640 1 --2- 172.21.15.45:0/1284945685 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f4155900 0x7f05f4155cd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.105+0000 7f05fa800640 1 -- 172.21.15.45:0/1284945685 >> 172.21.15.45:0/1284945685 conn(0x7f05f4067750 msgr2=0x7f05f40cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.106+0000 7f05fa800640 1 -- 172.21.15.45:0/1284945685 shutdown_connections 2024-08-17T02:25:24.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.106+0000 7f05fa800640 1 -- 172.21.15.45:0/1284945685 wait complete. 2024-08-17T02:25:24.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.107+0000 7f05fa800640 1 Processor -- start 2024-08-17T02:25:24.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.107+0000 7f05fa800640 1 -- start start 2024-08-17T02:25:24.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.108+0000 7f05fa800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f40b0270 0x7f05f40ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.108+0000 7f05fa800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f4155900 0x7f05f40aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.108+0000 7f05fa800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f4158b30 0x7f05f4153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.108+0000 7f05fa800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f40aa6f0 con 0x7f05f4158b30 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.108+0000 7f05fa800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f40a9d20 con 0x7f05f40b0270 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.108+0000 7f05fa800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f41541d0 con 0x7f05f4155900 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.108+0000 7f05f9e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f4158b30 0x7f05f4153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.108+0000 7f05f9400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f40b0270 0x7f05f40ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.108+0000 7f05f8a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f4155900 0x7f05f40aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.108+0000 7f05f9400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f40b0270 0x7f05f40ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38186/0 (socket says 172.21.15.45:38186) 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.108+0000 7f05f9400640 1 -- 172.21.15.45:0/3879068496 learned_addr learned my addr 172.21.15.45:0/3879068496 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05f8a00640 1 -- 172.21.15.45:0/3879068496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f40b0270 msgr2=0x7f05f40ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05f8a00640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f40b0270 0x7f05f40ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05f8a00640 1 -- 172.21.15.45:0/3879068496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f4158b30 msgr2=0x7f05f4153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05f8a00640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f4158b30 0x7f05f4153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05f8a00640 1 -- 172.21.15.45:0/3879068496 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e8009450 con 0x7f05f4155900 2024-08-17T02:25:24.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05f9400640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f40b0270 0x7f05f40ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:24.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05f8a00640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f4155900 0x7f05f40aa1b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f05e000b4e0 tx=0x7f05e0009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05f0c00640 1 -- 172.21.15.45:0/3879068496 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000f510 con 0x7f05f4155900 2024-08-17T02:25:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05f0c00640 1 -- 172.21.15.45:0/3879068496 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e000f670 con 0x7f05f4155900 2024-08-17T02:25:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05f0c00640 1 -- 172.21.15.45:0/3879068496 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e000fa30 con 0x7f05f4155900 2024-08-17T02:25:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05fa800640 1 -- 172.21.15.45:0/3879068496 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f40aba00 con 0x7f05f4155900 2024-08-17T02:25:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.109+0000 7f05fa800640 1 -- 172.21.15.45:0/3879068496 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f40a96d0 con 0x7f05f4155900 2024-08-17T02:25:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.110+0000 7f05fa800640 1 -- 172.21.15.45:0/3879068496 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f40a9ed0 con 0x7f05f4155900 2024-08-17T02:25:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.111+0000 7f05f0c00640 1 -- 172.21.15.45:0/3879068496 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f05e001a400 con 0x7f05f4155900 2024-08-17T02:25:24.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.112+0000 7f05f0c00640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f05d4065150 0x7f05d4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.112+0000 7f05f0c00640 1 -- 172.21.15.45:0/3879068496 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05e0081e70 con 0x7f05f4155900 2024-08-17T02:25:24.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.112+0000 7f05f9400640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f05d4065150 0x7f05d4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.113+0000 7f05f9400640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f05d4065150 0x7f05d4067600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009210 tx=0x7f05e8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.117+0000 7f05f0c00640 1 -- 172.21.15.45:0/3879068496 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f05f40a9ed0 con 0x7f05f4155900 2024-08-17T02:25:24.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.344+0000 7f05fa800640 1 -- 172.21.15.45:0/3879068496 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f05f40a9e90 con 0x7f05f4155900 2024-08-17T02:25:24.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.348+0000 7f05f0c00640 1 -- 172.21.15.45:0/3879068496 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+161031 (secure 0 0 0) 0x7f05e004ff40 con 0x7f05f4155900 2024-08-17T02:25:24.351 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:24.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 -- 172.21.15.45:0/3879068496 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f05d4065150 msgr2=0x7f05d4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f05d4065150 0x7f05d4067600 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f05e8009210 tx=0x7f05e8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:24.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 -- 172.21.15.45:0/3879068496 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f4155900 msgr2=0x7f05f40aa1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f4155900 0x7f05f40aa1b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f05e000b4e0 tx=0x7f05e0009060 comp rx=0 tx=0).stop 2024-08-17T02:25:24.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 -- 172.21.15.45:0/3879068496 shutdown_connections 2024-08-17T02:25:24.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05f4158b30 0x7f05f4153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f05d4065150 0x7f05d4067600 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05f4155900 0x7f05f40aa1b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 --2- 172.21.15.45:0/3879068496 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05f40b0270 0x7f05f40ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 -- 172.21.15.45:0/3879068496 >> 172.21.15.45:0/3879068496 conn(0x7f05f4067750 msgr2=0x7f05f40af250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 -- 172.21.15.45:0/3879068496 shutdown_connections 2024-08-17T02:25:24.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.351+0000 7f05fa800640 1 -- 172.21.15.45:0/3879068496 wait complete. 2024-08-17T02:25:24.366 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":37172},{"type":"v1","addr":"172.21.15.45:6833","nonce":37172}]},"active_addr":"172.21.15.45:6833/37172","active_change":"2024-08-17T02:24:55.639205+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4109,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":3942440253}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":4201450561}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":3450466119}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1255195540}]}]} 2024-08-17T02:25:24.369 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-08-17T02:25:24.370 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-08-17T02:25:24.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:24.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.520+0000 7fbc2be00640 1 Processor -- start 2024-08-17T02:25:24.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.520+0000 7fbc2be00640 1 -- start start 2024-08-17T02:25:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc2c156ad0 0x7fbc2c0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbc2c156ea0 0x7fbc2c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2be00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbc2c06dab0 0x7fbc2c06df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2be00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2c06e450 con 0x7fbc2c156ad0 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2be00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc2c0ca900 con 0x7fbc2c06dab0 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2be00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c0cc560 con 0x7fbc2c156ea0 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2aa00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc2c156ad0 0x7fbc2c0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2aa00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc2c156ad0 0x7fbc2c0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56936/0 (socket says 172.21.15.45:56936) 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2aa00640 1 -- 172.21.15.45:0/574882625 learned_addr learned my addr 172.21.15.45:0/574882625 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2a000640 1 --2- 172.21.15.45:0/574882625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbc2c156ea0 0x7fbc2c06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2b400640 1 --2- 172.21.15.45:0/574882625 >> v2:172.21.15.169:3300/0 conn(0x7fbc2c06dab0 0x7fbc2c06df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2aa00640 1 -- 172.21.15.45:0/574882625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbc2c156ea0 msgr2=0x7fbc2c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2aa00640 1 --2- 172.21.15.45:0/574882625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbc2c156ea0 0x7fbc2c06d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2aa00640 1 -- 172.21.15.45:0/574882625 >> v2:172.21.15.169:3300/0 conn(0x7fbc2c06dab0 msgr2=0x7fbc2c06df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2aa00640 1 --2- 172.21.15.45:0/574882625 >> v2:172.21.15.169:3300/0 conn(0x7fbc2c06dab0 0x7fbc2c06df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2aa00640 1 -- 172.21.15.45:0/574882625 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c0caaf0 con 0x7fbc2c156ad0 2024-08-17T02:25:24.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.522+0000 7fbc2a000640 1 --2- 172.21.15.45:0/574882625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbc2c156ea0 0x7fbc2c06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.523+0000 7fbc2aa00640 1 --2- 172.21.15.45:0/574882625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c156ad0 0x7fbc2c0cbea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0cb740 tx=0x7fbc1c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b067d3f61f7ce93f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.524+0000 7fbc29600640 1 -- 172.21.15.45:0/574882625 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c02ade0 con 0x7fbc2c156ad0 2024-08-17T02:25:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.524+0000 7fbc29600640 1 -- 172.21.15.45:0/574882625 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c032440 con 0x7fbc2c156ad0 2024-08-17T02:25:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.524+0000 7fbc29600640 1 -- 172.21.15.45:0/574882625 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c0327e0 con 0x7fbc2c156ad0 2024-08-17T02:25:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.524+0000 7fbc2be00640 1 -- 172.21.15.45:0/574882625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c156ad0 msgr2=0x7fbc2c0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.524+0000 7fbc2be00640 1 --2- 172.21.15.45:0/574882625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c156ad0 0x7fbc2c0cbea0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0cb740 tx=0x7fbc1c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.524+0000 7fbc2be00640 1 -- 172.21.15.45:0/574882625 shutdown_connections 2024-08-17T02:25:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.524+0000 7fbc2be00640 1 --2- 172.21.15.45:0/574882625 >> v2:172.21.15.169:3300/0 conn(0x7fbc2c06dab0 0x7fbc2c06df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.524+0000 7fbc2be00640 1 --2- 172.21.15.45:0/574882625 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbc2c156ea0 0x7fbc2c06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.524+0000 7fbc2be00640 1 --2- 172.21.15.45:0/574882625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c156ad0 0x7fbc2c0cbea0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.524+0000 7fbc2be00640 1 -- 172.21.15.45:0/574882625 >> 172.21.15.45:0/574882625 conn(0x7fbc2c067750 msgr2=0x7fbc2c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.524+0000 7fbc2be00640 1 -- 172.21.15.45:0/574882625 shutdown_connections 2024-08-17T02:25:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.525+0000 7fbc2be00640 1 -- 172.21.15.45:0/574882625 wait complete. 2024-08-17T02:25:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.526+0000 7fbc2be00640 1 Processor -- start 2024-08-17T02:25:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.526+0000 7fbc2be00640 1 -- start start 2024-08-17T02:25:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06dab0 0x7fbc2c15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc2c156ad0 0x7fbc2c1533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbc2c156ea0 0x7fbc2c0b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2be00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c169170 con 0x7fbc2c06dab0 2024-08-17T02:25:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2be00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c153930 con 0x7fbc2c156ad0 2024-08-17T02:25:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2be00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c15ccb0 con 0x7fbc2c156ea0 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2aa00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06dab0 0x7fbc2c15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2aa00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06dab0 0x7fbc2c15c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56940/0 (socket says 172.21.15.45:56940) 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2aa00640 1 -- 172.21.15.45:0/1666002621 learned_addr learned my addr 172.21.15.45:0/1666002621 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2b400640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbc2c156ea0 0x7fbc2c0b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2a000640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc2c156ad0 0x7fbc2c1533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2aa00640 1 -- 172.21.15.45:0/1666002621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbc2c156ea0 msgr2=0x7fbc2c0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2aa00640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbc2c156ea0 0x7fbc2c0b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2aa00640 1 -- 172.21.15.45:0/1666002621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc2c156ad0 msgr2=0x7fbc2c1533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2aa00640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc2c156ad0 0x7fbc2c1533f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.527+0000 7fbc2aa00640 1 -- 172.21.15.45:0/1666002621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc1c009450 con 0x7fbc2c06dab0 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.528+0000 7fbc2aa00640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06dab0 0x7fbc2c15c670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0099a0 tx=0x7fbc1c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.528+0000 7fbc22000640 1 -- 172.21.15.45:0/1666002621 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c031c80 con 0x7fbc2c06dab0 2024-08-17T02:25:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.528+0000 7fbc22000640 1 -- 172.21.15.45:0/1666002621 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c031e00 con 0x7fbc2c06dab0 2024-08-17T02:25:24.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.528+0000 7fbc2be00640 1 -- 172.21.15.45:0/1666002621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2c15cf90 con 0x7fbc2c06dab0 2024-08-17T02:25:24.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.528+0000 7fbc22000640 1 -- 172.21.15.45:0/1666002621 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c03d670 con 0x7fbc2c06dab0 2024-08-17T02:25:24.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.528+0000 7fbc2be00640 1 -- 172.21.15.45:0/1666002621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2c15d550 con 0x7fbc2c06dab0 2024-08-17T02:25:24.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.529+0000 7fbc2be00640 1 -- 172.21.15.45:0/1666002621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2c06d910 con 0x7fbc2c06dab0 2024-08-17T02:25:24.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.530+0000 7fbc22000640 1 -- 172.21.15.45:0/1666002621 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbc1c039040 con 0x7fbc2c06dab0 2024-08-17T02:25:24.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.531+0000 7fbc22000640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbc0c065150 0x7fbc0c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.531+0000 7fbc22000640 1 -- 172.21.15.45:0/1666002621 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc1c0a26b0 con 0x7fbc2c06dab0 2024-08-17T02:25:24.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.531+0000 7fbc2a000640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbc0c065150 0x7fbc0c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.532+0000 7fbc2a000640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbc0c065150 0x7fbc0c067600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc18006fd0 tx=0x7fbc18008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.535+0000 7fbc22000640 1 -- 172.21.15.45:0/1666002621 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbc2c06d910 con 0x7fbc2c06dab0 2024-08-17T02:25:24.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.723+0000 7fbc2be00640 1 -- 172.21.15.45:0/1666002621 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc2c06d910 con 0x7fbc2c06dab0 2024-08-17T02:25:24.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.724+0000 7fbc22000640 1 -- 172.21.15.45:0/1666002621 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fbc2c06d910 con 0x7fbc2c06dab0 2024-08-17T02:25:24.724 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:24.724 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:24.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 -- 172.21.15.45:0/1666002621 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbc0c065150 msgr2=0x7fbc0c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbc0c065150 0x7fbc0c067600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbc18006fd0 tx=0x7fbc18008040 comp rx=0 tx=0).stop 2024-08-17T02:25:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 -- 172.21.15.45:0/1666002621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06dab0 msgr2=0x7fbc2c15c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06dab0 0x7fbc2c15c670 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c0099a0 tx=0x7fbc1c032000 comp rx=0 tx=0).stop 2024-08-17T02:25:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 -- 172.21.15.45:0/1666002621 shutdown_connections 2024-08-17T02:25:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbc0c065150 0x7fbc0c067600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbc2c156ea0 0x7fbc2c0b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbc2c156ad0 0x7fbc2c1533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 --2- 172.21.15.45:0/1666002621 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2c06dab0 0x7fbc2c15c670 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 -- 172.21.15.45:0/1666002621 >> 172.21.15.45:0/1666002621 conn(0x7fbc2c067750 msgr2=0x7fbc2c154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 -- 172.21.15.45:0/1666002621 shutdown_connections 2024-08-17T02:25:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.726+0000 7fbc2be00640 1 -- 172.21.15.45:0/1666002621 wait complete. 2024-08-17T02:25:24.743 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-08-17T02:25:24.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:24.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.893+0000 7f5079e00640 1 Processor -- start 2024-08-17T02:25:24.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.893+0000 7f5079e00640 1 -- start start 2024-08-17T02:25:24.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.894+0000 7f5079e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50740aed50 0x7f50740ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.894+0000 7f5079e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740cc890 con 0x7f50740c5c40 2024-08-17T02:25:24.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.894+0000 7f5079e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50740ceb20 con 0x7f50740ce6d0 2024-08-17T02:25:24.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.894+0000 7f5079e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50740cb4c0 con 0x7f50740aed50 2024-08-17T02:25:24.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.895+0000 7f5079400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f50740c5c40 0x7f50741627a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33382/0 (socket says 172.21.15.45:33382) 2024-08-17T02:25:24.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.895+0000 7f5078a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50740aed50 0x7f50740ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.895+0000 7f5079400640 1 -- 172.21.15.45:0/3828298233 learned_addr learned my addr 172.21.15.45:0/3828298233 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:24.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.895+0000 7f5078a00640 1 -- 172.21.15.45:0/3828298233 >> v1:172.21.15.169:6789/0 conn(0x7f50740ce6d0 legacy=0x7f50740ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:24.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.895+0000 7f5078a00640 1 -- 172.21.15.45:0/3828298233 >> v1:172.21.15.45:6789/0 conn(0x7f50740c5c40 legacy=0x7f50741627a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.895+0000 7f5078a00640 1 -- 172.21.15.45:0/3828298233 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50740cb7a0 con 0x7f50740aed50 2024-08-17T02:25:24.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.895+0000 7f5073400640 1 -- 172.21.15.45:0/3828298233 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838174661 0 0) 0x7f50740cc890 con 0x7f50740c5c40 2024-08-17T02:25:24.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.896+0000 7f5078a00640 1 --2- 172.21.15.45:0/3828298233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740aed50 0x7f50740ce190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5068009850 tx=0x7f50680090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b93d437fe55544f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.896+0000 7f5073400640 1 -- 172.21.15.45:0/3828298233 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506802adb0 con 0x7f50740aed50 2024-08-17T02:25:24.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.896+0000 7f5073400640 1 -- 172.21.15.45:0/3828298233 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068032440 con 0x7f50740aed50 2024-08-17T02:25:24.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.896+0000 7f5073400640 1 -- 172.21.15.45:0/3828298233 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680327e0 con 0x7f50740aed50 2024-08-17T02:25:24.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.897+0000 7f5079e00640 1 -- 172.21.15.45:0/3828298233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740aed50 msgr2=0x7f50740ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.897+0000 7f5079e00640 1 --2- 172.21.15.45:0/3828298233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740aed50 0x7f50740ce190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5068009850 tx=0x7f50680090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.897+0000 7f5079e00640 1 -- 172.21.15.45:0/3828298233 shutdown_connections 2024-08-17T02:25:24.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.897+0000 7f5079e00640 1 --2- 172.21.15.45:0/3828298233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740aed50 0x7f50740ce190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.897+0000 7f5079e00640 1 -- 172.21.15.45:0/3828298233 >> 172.21.15.45:0/3828298233 conn(0x7f5074098e30 msgr2=0x7f507406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:24.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.897+0000 7f5079e00640 1 -- 172.21.15.45:0/3828298233 shutdown_connections 2024-08-17T02:25:24.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.897+0000 7f5079e00640 1 -- 172.21.15.45:0/3828298233 wait complete. 2024-08-17T02:25:24.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.898+0000 7f5079e00640 1 Processor -- start 2024-08-17T02:25:24.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.899+0000 7f5079e00640 1 -- start start 2024-08-17T02:25:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.899+0000 7f5079e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740aed50 0x7f5074169fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.899+0000 7f5079e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50740c5c40 0x7f50740b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.899+0000 7f5079e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50740ce6d0 0x7f5074156710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.899+0000 7f5079e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740b47e0 con 0x7f50740aed50 2024-08-17T02:25:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.899+0000 7f5079e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740af1b0 con 0x7f50740c5c40 2024-08-17T02:25:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.899+0000 7f5079e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50740b49f0 con 0x7f50740ce6d0 2024-08-17T02:25:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5078a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740aed50 0x7f5074169fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5078a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740aed50 0x7f5074169fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56954/0 (socket says 172.21.15.45:56954) 2024-08-17T02:25:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5078a00640 1 -- 172.21.15.45:0/581988375 learned_addr learned my addr 172.21.15.45:0/581988375 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5079400640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50740ce6d0 0x7f5074156710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5073e00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50740c5c40 0x7f50740b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5078a00640 1 -- 172.21.15.45:0/581988375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50740ce6d0 msgr2=0x7f5074156710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5078a00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50740ce6d0 0x7f5074156710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5078a00640 1 -- 172.21.15.45:0/581988375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50740c5c40 msgr2=0x7f50740b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5078a00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50740c5c40 0x7f50740b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5078a00640 1 -- 172.21.15.45:0/581988375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5068009390 con 0x7f50740aed50 2024-08-17T02:25:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5073e00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50740c5c40 0x7f50740b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:24.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.900+0000 7f5078a00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740aed50 0x7f5074169fd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5068009360 tx=0x7f5068032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.901+0000 7f5067e00640 1 -- 172.21.15.45:0/581988375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068031b30 con 0x7f50740aed50 2024-08-17T02:25:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.901+0000 7f5067e00640 1 -- 172.21.15.45:0/581988375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068031c90 con 0x7f50740aed50 2024-08-17T02:25:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.901+0000 7f5067e00640 1 -- 172.21.15.45:0/581988375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506803b630 con 0x7f50740aed50 2024-08-17T02:25:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.901+0000 7f5079e00640 1 -- 172.21.15.45:0/581988375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50740b4cd0 con 0x7f50740aed50 2024-08-17T02:25:24.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.901+0000 7f5079e00640 1 -- 172.21.15.45:0/581988375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50740b5290 con 0x7f50740aed50 2024-08-17T02:25:24.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.902+0000 7f5079e00640 1 -- 172.21.15.45:0/581988375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5074071050 con 0x7f50740aed50 2024-08-17T02:25:24.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.903+0000 7f5067e00640 1 -- 172.21.15.45:0/581988375 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5068043030 con 0x7f50740aed50 2024-08-17T02:25:24.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.903+0000 7f5067e00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5054065180 0x7f5054067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:24.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.904+0000 7f5067e00640 1 -- 172.21.15.45:0/581988375 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5068041070 con 0x7f50740aed50 2024-08-17T02:25:24.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.904+0000 7f5073e00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5054065180 0x7f5054067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:24.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.904+0000 7f5073e00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5054065180 0x7f5054067630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50740ca010 tx=0x7f5060008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:24.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:24.908+0000 7f5067e00640 1 -- 172.21.15.45:0/581988375 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5068070e90 con 0x7f50740aed50 2024-08-17T02:25:25.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.089+0000 7f5079e00640 1 -- 172.21.15.45:0/581988375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5074089ea0 con 0x7f50740aed50 2024-08-17T02:25:25.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.090+0000 7f5067e00640 1 -- 172.21.15.45:0/581988375 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f506804b020 con 0x7f50740aed50 2024-08-17T02:25:25.091 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:25.091 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.092+0000 7f5079e00640 1 -- 172.21.15.45:0/581988375 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5054065180 msgr2=0x7f5054067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.092+0000 7f5079e00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5054065180 0x7f5054067630 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f50740ca010 tx=0x7f5060008040 comp rx=0 tx=0).stop 2024-08-17T02:25:25.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.092+0000 7f5079e00640 1 -- 172.21.15.45:0/581988375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740aed50 msgr2=0x7f5074169fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.092+0000 7f5079e00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740aed50 0x7f5074169fd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5068009360 tx=0x7f5068032000 comp rx=0 tx=0).stop 2024-08-17T02:25:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.092+0000 7f5079e00640 1 -- 172.21.15.45:0/581988375 shutdown_connections 2024-08-17T02:25:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.092+0000 7f5079e00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5054065180 0x7f5054067630 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.092+0000 7f5079e00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50740ce6d0 0x7f5074156710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.092+0000 7f5079e00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50740c5c40 0x7f50740b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.092+0000 7f5079e00640 1 --2- 172.21.15.45:0/581988375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50740aed50 0x7f5074169fd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.092+0000 7f5079e00640 1 -- 172.21.15.45:0/581988375 >> 172.21.15.45:0/581988375 conn(0x7f5074098e30 msgr2=0x7f5074068590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.093+0000 7f5079e00640 1 -- 172.21.15.45:0/581988375 shutdown_connections 2024-08-17T02:25:25.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.093+0000 7f5079e00640 1 -- 172.21.15.45:0/581988375 wait complete. 2024-08-17T02:25:25.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-08-17T02:25:25.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-08-17T02:25:25.111 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-08-17T02:25:25.111 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-08-17T02:25:25.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-08-17T02:25:25.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-08-17T02:25:25.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-08-17T02:25:25.113 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-08-17T02:25:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.381+0000 7f18b5600640 1 Processor -- start 2024-08-17T02:25:25.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.381+0000 7f18b5600640 1 -- start start 2024-08-17T02:25:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.382+0000 7fe401a00640 1 Processor -- start 2024-08-17T02:25:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.382+0000 7fe401a00640 1 -- start start 2024-08-17T02:25:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.384+0000 7fe401a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3fc0cd700 0x7fe3fc0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.384+0000 7fe401a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc0cc9d0 0x7fe3fc0acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.384+0000 7fe401a00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3fc0cf9d0 con 0x7fe3fc158c80 2024-08-17T02:25:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.384+0000 7fe401a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3fc0ceb60 con 0x7fe3fc0cd700 2024-08-17T02:25:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.384+0000 7fe3fbe00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe3fc158c80 0x7fe3fc0cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33390/0 (socket says 172.21.15.45:33390) 2024-08-17T02:25:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.384+0000 7fe3fbe00640 1 -- 172.21.15.45:0/2601238840 learned_addr learned my addr 172.21.15.45:0/2601238840 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.384+0000 7fe401a00640 1 -- 172.21.15.45:0/2601238840 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cedc0 con 0x7fe3fc0cc9d0 2024-08-17T02:25:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.384+0000 7f18b5600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f18a80e1bd0 0x7f18a80e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.385+0000 7f18b5600640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f18a8006150 0x7f18a80065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.385+0000 7f18b5600640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a80e24e0 con 0x7f18a80e5c30 2024-08-17T02:25:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.385+0000 7f18b5600640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a8006c10 con 0x7f18a80e1bd0 2024-08-17T02:25:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.385+0000 7f18b5600640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a8006ef0 con 0x7f18a8006150 2024-08-17T02:25:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.385+0000 7f18afe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f18a80e1bd0 0x7f18a80e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.385+0000 7f18b4c00640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f18a80e5c30 0x7f18a80e6050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:50448/0 (socket says 172.21.15.45:50448) 2024-08-17T02:25:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.386+0000 7f18b4c00640 1 -- 172.21.15.45:0/4215632359 learned_addr learned my addr 172.21.15.45:0/4215632359 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.385+0000 7f18af400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f18a8006150 0x7f18a80065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.385+0000 7fe401000640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc0cc9d0 0x7fe3fc0acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.385+0000 7fe3fb400640 1 --2- 172.21.15.45:0/2601238840 >> v2:172.21.15.45:3300/0 conn(0x7fe3fc0cd700 0x7fe3fc0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.386+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485247491 0 0) 0x7fe3fc0cf9d0 con 0x7fe3fc158c80 2024-08-17T02:25:25.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.386+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3e00034e0 con 0x7fe3fc158c80 2024-08-17T02:25:25.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.386+0000 7f18aea00640 1 -- 172.21.15.45:0/4215632359 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752540670 0 0) 0x7f18a80e24e0 con 0x7f18a80e5c30 2024-08-17T02:25:25.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7f18afe00640 1 -- 172.21.15.45:0/4215632359 >> v2:172.21.15.169:3300/0 conn(0x7f18a8006150 msgr2=0x7f18a80065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7f18afe00640 1 --2- 172.21.15.45:0/4215632359 >> v2:172.21.15.169:3300/0 conn(0x7f18a8006150 0x7f18a80065d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7f18afe00640 1 -- 172.21.15.45:0/4215632359 >> v1:172.21.15.169:6789/0 conn(0x7f18a80e5c30 legacy=0x7f18a80e6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7f18afe00640 1 -- 172.21.15.45:0/4215632359 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80071d0 con 0x7f18a80e1bd0 2024-08-17T02:25:25.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3333833524 0 0) 0x7fe3e00034e0 con 0x7fe3fc158c80 2024-08-17T02:25:25.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc0cc9d0 msgr2=0x7fe3fc0acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc0cc9d0 0x7fe3fc0acfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 >> v2:172.21.15.45:3300/0 conn(0x7fe3fc0cd700 msgr2=0x7fe3fc0ce620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 --2- 172.21.15.45:0/2601238840 >> v2:172.21.15.45:3300/0 conn(0x7fe3fc0cd700 0x7fe3fc0ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0cf0a0 con 0x7fe3fc158c80 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7fe3ec001470 con 0x7fe3fc158c80 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 >> v1:172.21.15.45:6789/0 conn(0x7fe3fc158c80 legacy=0x7fe3fc0cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3e0003a50 0x7fe3e0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc0cc9d0 0x7fe3e0004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e0004cc0 0x7fe3e0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0ceb60 con 0x7fe3e0004cc0 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0cedc0 con 0x7fe3e0003a50 2024-08-17T02:25:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e000bbe0 con 0x7fe3fc0cc9d0 2024-08-17T02:25:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.387+0000 7fe3fb400640 1 --2- 172.21.15.45:0/2601238840 >> v2:172.21.15.45:3300/0 conn(0x7fe3fc0cd700 0x7fe3fc0ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.388+0000 7fe3fb400640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc0cc9d0 0x7fe3e0004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.389+0000 7fe3fbe00640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3e0003a50 0x7fe3e0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.389+0000 7fe401000640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e0004cc0 0x7fe3e0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.389+0000 7fe3fb400640 1 -- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3e0003a50 msgr2=0x7fe3e0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.389+0000 7fe3fb400640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3e0003a50 0x7fe3e0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.389+0000 7fe3fb400640 1 -- 172.21.15.45:0/2601238840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e0004cc0 msgr2=0x7fe3e0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.389+0000 7f18afe00640 1 --2- 172.21.15.45:0/4215632359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18a80e1bd0 0x7f18a80e1fa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f18a804c9b0 tx=0x7f18a40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfb16e53d4e2959 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.389+0000 7fe3fb400640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e0004cc0 0x7fe3e0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.389+0000 7fe3fb400640 1 -- 172.21.15.45:0/2601238840 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc0cf0a0 con 0x7fe3fc0cc9d0 2024-08-17T02:25:25.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.390+0000 7f18aea00640 1 -- 172.21.15.45:0/4215632359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a402adb0 con 0x7f18a80e1bd0 2024-08-17T02:25:25.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.390+0000 7f18aea00640 1 -- 172.21.15.45:0/4215632359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4032440 con 0x7f18a80e1bd0 2024-08-17T02:25:25.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.390+0000 7f18aea00640 1 -- 172.21.15.45:0/4215632359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a4032820 con 0x7f18a80e1bd0 2024-08-17T02:25:25.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.390+0000 7f786f000640 1 Processor -- start 2024-08-17T02:25:25.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.390+0000 7f00e1a00640 1 Processor -- start 2024-08-17T02:25:25.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.390+0000 7fe401000640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e0004cc0 0x7fe3e0005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:25.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.390+0000 7f786f000640 1 -- start start 2024-08-17T02:25:25.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.391+0000 7f18b5600640 1 -- 172.21.15.45:0/4215632359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18a80e1bd0 msgr2=0x7f18a80e1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.391+0000 7f18b5600640 1 --2- 172.21.15.45:0/4215632359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18a80e1bd0 0x7f18a80e1fa0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f18a804c9b0 tx=0x7f18a40090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.390+0000 7f00e1a00640 1 -- start start 2024-08-17T02:25:25.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.391+0000 7f18b5600640 1 -- 172.21.15.45:0/4215632359 shutdown_connections 2024-08-17T02:25:25.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.391+0000 7f18b5600640 1 --2- 172.21.15.45:0/4215632359 >> v2:172.21.15.169:3300/0 conn(0x7f18a8006150 0x7f18a80065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.391+0000 7f18b5600640 1 --2- 172.21.15.45:0/4215632359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18a80e1bd0 0x7f18a80e1fa0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.391+0000 7f18b5600640 1 -- 172.21.15.45:0/4215632359 >> 172.21.15.45:0/4215632359 conn(0x7f18a800f070 msgr2=0x7f18a8058f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.391+0000 7f7351800640 1 Processor -- start 2024-08-17T02:25:25.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.391+0000 7f18b5600640 1 -- 172.21.15.45:0/4215632359 shutdown_connections 2024-08-17T02:25:25.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f18b5600640 1 -- 172.21.15.45:0/4215632359 wait complete. 2024-08-17T02:25:25.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f7351800640 1 -- start start 2024-08-17T02:25:25.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7fe3fb400640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc0cc9d0 0x7fe3e0004780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400c520 tx=0x7fe3f4007740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c431dada398140 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f786f000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f78600dead0 0x7f7860053da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f786f000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78600deea0 0x7f78600554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f786f000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7860050fb0 0x7f78600e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f786f000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78600df2f0 con 0x7f78600deea0 2024-08-17T02:25:25.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f786f000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7860055020 con 0x7f78600dead0 2024-08-17T02:25:25.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f786f000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7860054410 con 0x7f7860050fb0 2024-08-17T02:25:25.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f402b5e0 con 0x7fe3fc0cc9d0 2024-08-17T02:25:25.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f00e1a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f00d40e1bd0 0x7f00d40e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f00e1a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f00d4006150 0x7f00d40065d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f00e1a00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d40e24e0 con 0x7f00d40e5c30 2024-08-17T02:25:25.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f00e1a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d4006c10 con 0x7f00d4006150 2024-08-17T02:25:25.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.392+0000 7f00e1a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d4006ef0 con 0x7f00d40e1bd0 2024-08-17T02:25:25.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.393+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f402b740 con 0x7fe3fc0cc9d0 2024-08-17T02:25:25.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.393+0000 7f786d200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78600deea0 0x7f78600554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.393+0000 7f786dc00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f78600dead0 0x7f7860053da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.393+0000 7f786dc00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f78600dead0 0x7f7860053da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38250/0 (socket says 172.21.15.45:38250) 2024-08-17T02:25:25.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.393+0000 7f786dc00640 1 -- 172.21.15.45:0/4106979004 learned_addr learned my addr 172.21.15.45:0/4106979004 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.393+0000 7fe3faa00640 1 -- 172.21.15.45:0/2601238840 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f402bb40 con 0x7fe3fc0cc9d0 2024-08-17T02:25:25.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.393+0000 7f00dbe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f00d40e1bd0 0x7f00d40e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7f00dbe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f00d40e1bd0 0x7f00d40e1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38252/0 (socket says 172.21.15.45:38252) 2024-08-17T02:25:25.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7f00dbe00640 1 -- 172.21.15.45:0/2064959873 learned_addr learned my addr 172.21.15.45:0/2064959873 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7f786dc00640 1 -- 172.21.15.45:0/4106979004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7860050fb0 msgr2=0x7f78600e2a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:25:25.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7f786dc00640 1 --2- 172.21.15.45:0/4106979004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7860050fb0 0x7f78600e2a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7f786dc00640 1 -- 172.21.15.45:0/4106979004 >> v2:172.21.15.45:3300/0 conn(0x7f78600deea0 msgr2=0x7f78600554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7f786dc00640 1 --2- 172.21.15.45:0/4106979004 >> v2:172.21.15.45:3300/0 conn(0x7f78600deea0 0x7f78600554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7f786dc00640 1 -- 172.21.15.45:0/4106979004 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78600546f0 con 0x7f78600dead0 2024-08-17T02:25:25.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7f00db400640 1 --2- 172.21.15.45:0/2064959873 >> v2:172.21.15.45:3300/0 conn(0x7f00d4006150 0x7f00d40065d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7f786d200640 1 --2- 172.21.15.45:0/4106979004 >> v2:172.21.15.45:3300/0 conn(0x7f78600deea0 0x7f78600554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:25.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7fe401a00640 1 -- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc0cc9d0 msgr2=0x7fe3e0004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7fe401a00640 1 --2- 172.21.15.45:0/2601238840 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc0cc9d0 0x7fe3e0004780 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe3f400c520 tx=0x7fe3f4007740 comp rx=0 tx=0).stop 2024-08-17T02:25:25.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7fe401000640 1 -- 172.21.15.45:0/2601238840 reap_dead start 2024-08-17T02:25:25.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7fe401a00640 1 -- 172.21.15.45:0/2601238840 shutdown_connections 2024-08-17T02:25:25.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7fe401a00640 1 -- 172.21.15.45:0/2601238840 >> 172.21.15.45:0/2601238840 conn(0x7fe3fc098e30 msgr2=0x7fe3fc06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.394+0000 7f7351800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7344006270 0x7f7344039da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7f7351800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73440077e0 con 0x7f7344034bb0 2024-08-17T02:25:25.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7fe401a00640 1 -- 172.21.15.45:0/2601238840 shutdown_connections 2024-08-17T02:25:25.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7f786dc00640 1 --2- 172.21.15.45:0/4106979004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78600dead0 0x7f7860053da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7860009710 tx=0x7f785c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19bd77b7e5081f3e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7f18b5600640 1 Processor -- start 2024-08-17T02:25:25.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7f7351800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7344006bf0 con 0x7f73440066c0 2024-08-17T02:25:25.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7f7351800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7344007c70 con 0x7f7344006270 2024-08-17T02:25:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7fe401a00640 1 -- 172.21.15.45:0/2601238840 wait complete. 2024-08-17T02:25:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7f00daa00640 1 -- 172.21.15.45:0/2064959873 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041644140 0 0) 0x7f00d40e24e0 con 0x7f00d40e5c30 2024-08-17T02:25:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.395+0000 7f00daa00640 1 -- 172.21.15.45:0/2064959873 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c40034e0 con 0x7f00d40e5c30 2024-08-17T02:25:25.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.396+0000 7f734b400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7344006270 0x7f7344039da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.396+0000 7f734be00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7344034bb0 0x7f7344034f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33410/0 (socket says 172.21.15.45:33410) 2024-08-17T02:25:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.396+0000 7f734be00640 1 -- 172.21.15.45:0/3397319172 learned_addr learned my addr 172.21.15.45:0/3397319172 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.396+0000 7f7867e00640 1 -- 172.21.15.45:0/4106979004 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c02ad60 con 0x7f78600dead0 2024-08-17T02:25:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.396+0000 7f18b5600640 1 -- start start 2024-08-17T02:25:25.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.396+0000 7f7867e00640 1 -- 172.21.15.45:0/4106979004 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f785c032440 con 0x7f78600dead0 2024-08-17T02:25:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.396+0000 7f7867e00640 1 -- 172.21.15.45:0/4106979004 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f785c032820 con 0x7f78600dead0 2024-08-17T02:25:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.396+0000 7f00dbe00640 1 -- 172.21.15.45:0/2064959873 >> v2:172.21.15.45:3300/0 conn(0x7f00d4006150 msgr2=0x7f00d40065d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.396+0000 7f00dbe00640 1 --2- 172.21.15.45:0/2064959873 >> v2:172.21.15.45:3300/0 conn(0x7f00d4006150 0x7f00d40065d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.397+0000 7f00dbe00640 1 -- 172.21.15.45:0/2064959873 >> v1:172.21.15.45:6789/0 conn(0x7f00d40e5c30 legacy=0x7f00d40e6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.397+0000 7f00dbe00640 1 -- 172.21.15.45:0/2064959873 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d40071d0 con 0x7f00d40e1bd0 2024-08-17T02:25:25.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.397+0000 7f734aa00640 1 -- 172.21.15.45:0/3397319172 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4046289274 0 0) 0x7f7344006bf0 con 0x7f73440066c0 2024-08-17T02:25:25.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.397+0000 7f786f000640 1 -- 172.21.15.45:0/4106979004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78600dead0 msgr2=0x7f7860053da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.397+0000 7f786f000640 1 --2- 172.21.15.45:0/4106979004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78600dead0 0x7f7860053da0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7860009710 tx=0x7f785c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.397+0000 7f00db400640 1 --2- 172.21.15.45:0/2064959873 >> v2:172.21.15.45:3300/0 conn(0x7f00d4006150 0x7f00d40065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.397+0000 7f734aa00640 1 -- 172.21.15.45:0/3397319172 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73340034e0 con 0x7f73440066c0 2024-08-17T02:25:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.398+0000 7f734aa00640 1 -- 172.21.15.45:0/3397319172 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186448753 0 0) 0x7f73440077e0 con 0x7f7344034bb0 2024-08-17T02:25:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.398+0000 7f734aa00640 1 -- 172.21.15.45:0/3397319172 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7344006bf0 con 0x7f7344034bb0 2024-08-17T02:25:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.398+0000 7f734b400640 1 -- 172.21.15.45:0/3397319172 >> v1:172.21.15.169:6789/0 conn(0x7f73440066c0 legacy=0x7f73440ddc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.398+0000 7f786f000640 1 -- 172.21.15.45:0/4106979004 shutdown_connections 2024-08-17T02:25:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.398+0000 7f786f000640 1 --2- 172.21.15.45:0/4106979004 >> v2:172.21.15.45:3300/0 conn(0x7f78600deea0 0x7f78600554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.398+0000 7f786f000640 1 --2- 172.21.15.45:0/4106979004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7860050fb0 0x7f78600e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.398+0000 7f786f000640 1 --2- 172.21.15.45:0/4106979004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78600dead0 0x7f7860053da0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.398+0000 7f786f000640 1 -- 172.21.15.45:0/4106979004 >> 172.21.15.45:0/4106979004 conn(0x7f7860055ca0 msgr2=0x7f78600560a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.398+0000 7f734b400640 1 -- 172.21.15.45:0/3397319172 >> v1:172.21.15.45:6789/0 conn(0x7f7344034bb0 legacy=0x7f7344034f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.398+0000 7f734b400640 1 -- 172.21.15.45:0/3397319172 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7344006eb0 con 0x7f7344006270 2024-08-17T02:25:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7f18b5600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18a8006150 0x7f18a80f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7f18b5600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18a80e1bd0 0x7f18a80e1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7f18b5600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18a80e5c30 0x7f18a80df1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7f18b5600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80e37a0 con 0x7f18a8006150 2024-08-17T02:25:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7f18b5600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80e2b90 con 0x7f18a80e5c30 2024-08-17T02:25:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7f18b5600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80e2e70 con 0x7f18a80e1bd0 2024-08-17T02:25:25.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7f00dbe00640 1 --2- 172.21.15.45:0/2064959873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00d40e1bd0 0x7f00d40e1fa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00d4011c70 tx=0x7f00c80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d344feb362e874 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7fe401a00640 1 Processor -- start 2024-08-17T02:25:25.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7f786f000640 1 -- 172.21.15.45:0/4106979004 shutdown_connections 2024-08-17T02:25:25.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7f786f000640 1 -- 172.21.15.45:0/4106979004 wait complete. 2024-08-17T02:25:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7f18afe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18a8006150 0x7f18a80f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7f18afe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18a8006150 0x7f18a80f2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57014/0 (socket says 172.21.15.45:57014) 2024-08-17T02:25:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f00daa00640 1 -- 172.21.15.45:0/2064959873 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d0001470 con 0x7f00d40e1bd0 2024-08-17T02:25:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f00daa00640 1 -- 172.21.15.45:0/2064959873 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c802aa40 con 0x7f00d40e1bd0 2024-08-17T02:25:25.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f00daa00640 1 -- 172.21.15.45:0/2064959873 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c802ade0 con 0x7f00d40e1bd0 2024-08-17T02:25:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f18afe00640 1 -- 172.21.15.45:0/3990598911 learned_addr learned my addr 172.21.15.45:0/3990598911 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f18af400640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18a80e1bd0 0x7f18a80e1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f18b4c00640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18a80e5c30 0x7f18a80df1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f18af400640 1 -- 172.21.15.45:0/3990598911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18a80e5c30 msgr2=0x7f18a80df1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f18af400640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18a80e5c30 0x7f18a80df1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f18af400640 1 -- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18a8006150 msgr2=0x7f18a80f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f18af400640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18a8006150 0x7f18a80f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.413 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f18af400640 1 -- 172.21.15.45:0/3990598911 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a4009390 con 0x7f18a80e1bd0 2024-08-17T02:25:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f734b400640 1 --2- 172.21.15.45:0/3397319172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344006270 0x7f7344039da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f733800b1e0 tx=0x7f73380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd206bf2c29f5c6e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.400+0000 7f734aa00640 1 -- 172.21.15.45:0/3397319172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733802c630 con 0x7f7344006270 2024-08-17T02:25:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.399+0000 7fe401a00640 1 -- start start 2024-08-17T02:25:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f00e1a00640 1 -- 172.21.15.45:0/2064959873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00d40e1bd0 msgr2=0x7f00d40e1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f00e1a00640 1 --2- 172.21.15.45:0/2064959873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00d40e1bd0 0x7f00d40e1fa0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00d4011c70 tx=0x7f00c80091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f734aa00640 1 -- 172.21.15.45:0/3397319172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733802c790 con 0x7f7344006270 2024-08-17T02:25:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f734aa00640 1 -- 172.21.15.45:0/3397319172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733802cb30 con 0x7f7344006270 2024-08-17T02:25:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f00e1a00640 1 -- 172.21.15.45:0/2064959873 shutdown_connections 2024-08-17T02:25:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f00e1a00640 1 --2- 172.21.15.45:0/2064959873 >> v2:172.21.15.45:3300/0 conn(0x7f00d4006150 0x7f00d40065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f00e1a00640 1 --2- 172.21.15.45:0/2064959873 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00d40e1bd0 0x7f00d40e1fa0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f00e1a00640 1 -- 172.21.15.45:0/2064959873 >> 172.21.15.45:0/2064959873 conn(0x7f00d400f070 msgr2=0x7f00d4058f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f18af400640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18a80e1bd0 0x7f18a80e1120 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f189c00d890 tx=0x7f189c008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f00e1a00640 1 -- 172.21.15.45:0/2064959873 shutdown_connections 2024-08-17T02:25:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f7351800640 1 -- 172.21.15.45:0/3397319172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344006270 msgr2=0x7f7344039da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.416 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.401+0000 7f7351800640 1 --2- 172.21.15.45:0/3397319172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344006270 0x7f7344039da0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f733800b1e0 tx=0x7f73380090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7f00e1a00640 1 -- 172.21.15.45:0/2064959873 wait complete. 2024-08-17T02:25:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7fe401a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3fc0cc9d0 0x7fe3fc0b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7fe401a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc16c9b0 0x7fe3fc0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7fe401a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3fc0c7bb0 0x7fe3fc0c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7fe401a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c8560 con 0x7fe3fc0c7bb0 2024-08-17T02:25:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7fe401a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc0c4290 con 0x7fe3fc0cc9d0 2024-08-17T02:25:25.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7fe401a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3fc16d170 con 0x7fe3fc16c9b0 2024-08-17T02:25:25.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7f18a3400640 1 -- 172.21.15.45:0/3990598911 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c00dea0 con 0x7f18a80e1bd0 2024-08-17T02:25:25.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7fe3fb400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc16c9b0 0x7fe3fc0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7fe401000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3fc0c7bb0 0x7fe3fc0c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7fe3fb400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc16c9b0 0x7fe3fc0b4700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:58404/0 (socket says 172.21.15.45:58404) 2024-08-17T02:25:25.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.402+0000 7fe3fb400640 1 -- 172.21.15.45:0/2729027707 learned_addr learned my addr 172.21.15.45:0/2729027707 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7f18a3400640 1 -- 172.21.15.45:0/3990598911 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c00b6c0 con 0x7f18a80e1bd0 2024-08-17T02:25:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7f18a3400640 1 -- 172.21.15.45:0/3990598911 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c00ba60 con 0x7f18a80e1bd0 2024-08-17T02:25:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7f18b5600640 1 -- 172.21.15.45:0/3990598911 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a80e3150 con 0x7f18a80e1bd0 2024-08-17T02:25:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7f18b5600640 1 -- 172.21.15.45:0/3990598911 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a8052c10 con 0x7f18a80e1bd0 2024-08-17T02:25:25.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7f7351800640 1 -- 172.21.15.45:0/3397319172 shutdown_connections 2024-08-17T02:25:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7f7351800640 1 --2- 172.21.15.45:0/3397319172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344006270 0x7f7344039da0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7f7351800640 1 -- 172.21.15.45:0/3397319172 >> 172.21.15.45:0/3397319172 conn(0x7f7344055aa0 msgr2=0x7f7344051a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7f01f2a00640 1 Processor -- start 2024-08-17T02:25:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7fe401000640 1 -- 172.21.15.45:0/2729027707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc16c9b0 msgr2=0x7fe3fc0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7fe401000640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe3fc16c9b0 0x7fe3fc0b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7fe401000640 1 -- 172.21.15.45:0/2729027707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3fc0cc9d0 msgr2=0x7fe3fc0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7fe401000640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe3fc0cc9d0 0x7fe3fc0b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7fe401000640 1 -- 172.21.15.45:0/2729027707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3fc16d450 con 0x7fe3fc0c7bb0 2024-08-17T02:25:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.403+0000 7f01f2a00640 1 -- start start 2024-08-17T02:25:25.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7f786f000640 1 Processor -- start 2024-08-17T02:25:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7fe401000640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3fc0c7bb0 0x7fe3fc0c8020 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc069ee0 tx=0x7fe3e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7f72dbc00640 1 Processor -- start 2024-08-17T02:25:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7fe3f3400640 1 -- 172.21.15.45:0/2729027707 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8010c70 con 0x7fe3fc0c7bb0 2024-08-17T02:25:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7fe3f3400640 1 -- 172.21.15.45:0/2729027707 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e8010df0 con 0x7fe3fc0c7bb0 2024-08-17T02:25:25.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7fe3f3400640 1 -- 172.21.15.45:0/2729027707 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e8014640 con 0x7fe3fc0c7bb0 2024-08-17T02:25:25.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7f786f000640 1 -- start start 2024-08-17T02:25:25.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7fe401a00640 1 -- 172.21.15.45:0/2729027707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3fc16d730 con 0x7fe3fc0c7bb0 2024-08-17T02:25:25.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7fe401a00640 1 -- 172.21.15.45:0/2729027707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3fc16ce20 con 0x7fe3fc0c7bb0 2024-08-17T02:25:25.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.405+0000 7f00e1a00640 1 Processor -- start 2024-08-17T02:25:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7f7351800640 1 -- 172.21.15.45:0/3397319172 shutdown_connections 2024-08-17T02:25:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7f7351800640 1 -- 172.21.15.45:0/3397319172 wait complete. 2024-08-17T02:25:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.404+0000 7f72dbc00640 1 -- start start 2024-08-17T02:25:25.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.405+0000 7f00e1a00640 1 -- start start 2024-08-17T02:25:25.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.405+0000 7f01f2a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f01e400de60 0x7f01e40dfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.405+0000 7f01f2a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01e40e0000 0x7f01e40556a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.405+0000 7f01f2a00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e4054970 con 0x7f01e400da90 2024-08-17T02:25:25.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.405+0000 7f01f2a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e400e2e0 con 0x7f01e400de60 2024-08-17T02:25:25.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.405+0000 7f01f2a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e4055210 con 0x7f01e40e0000 2024-08-17T02:25:25.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.406+0000 7f01f0c00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f01e400de60 0x7f01e40dfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.406+0000 7f01f2000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01e40e0000 0x7f01e40556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.406+0000 7f01f2000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01e40e0000 0x7f01e40556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:58412/0 (socket says 172.21.15.45:58412) 2024-08-17T02:25:25.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.406+0000 7f01f2000640 1 -- 172.21.15.45:0/674955860 learned_addr learned my addr 172.21.15.45:0/674955860 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.406+0000 7f7351800640 1 Processor -- start 2024-08-17T02:25:25.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.406+0000 7f786f000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7860050fb0 0x7f78600ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f7351800640 1 -- start start 2024-08-17T02:25:25.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f786f000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78600dead0 0x7f78600df480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f786f000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78600deea0 0x7f78600df9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f786dc00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7860050fb0 0x7f78600ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f786f000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78600e1a40 con 0x7f78600dead0 2024-08-17T02:25:25.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f786f000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7860038f50 con 0x7f78600deea0 2024-08-17T02:25:25.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f01f0c00640 1 -- 172.21.15.45:0/674955860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01e40e0000 msgr2=0x7f01e40556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f01ebe00640 1 -- 172.21.15.45:0/674955860 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078090643 0 0) 0x7f01e4054970 con 0x7f01e400da90 2024-08-17T02:25:25.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f01f0c00640 1 --2- 172.21.15.45:0/674955860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01e40e0000 0x7f01e40556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f786e600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78600deea0 0x7f78600df9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f786f000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78600ced00 con 0x7f7860050fb0 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f786dc00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7860050fb0 0x7f78600ce7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:58428/0 (socket says 172.21.15.45:58428) 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f786dc00640 1 -- 172.21.15.45:0/593606151 learned_addr learned my addr 172.21.15.45:0/593606151 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f786d200640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78600dead0 0x7f78600df480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.407+0000 7f01f0c00640 1 -- 172.21.15.45:0/674955860 >> v1:172.21.15.169:6789/0 conn(0x7f01e400da90 legacy=0x7f01e40358c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f18a0c00640 1 -- 172.21.15.45:0/3990598911 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18a8005320 con 0x7f18a80e1bd0 2024-08-17T02:25:25.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f01f0c00640 1 -- 172.21.15.45:0/674955860 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e40e0460 con 0x7f01e400de60 2024-08-17T02:25:25.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f7351800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7344006270 0x7f7344033960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f7351800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73440066c0 0x7f73440e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f7351800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344034bb0 0x7f73440e1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.430 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f7351800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734402db20 con 0x7f7344034bb0 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f7351800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734402de00 con 0x7f73440066c0 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f7351800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734402e0e0 con 0x7f7344006270 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f734be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7344006270 0x7f7344033960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.406+0000 7fe401a00640 1 -- 172.21.15.45:0/2729027707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3fc0c4050 con 0x7fe3fc0c7bb0 2024-08-17T02:25:25.431 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7fe3f3400640 1 -- 172.21.15.45:0/2729027707 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe3e80149b0 con 0x7fe3fc0c7bb0 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f734b400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73440066c0 0x7f73440e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f7350e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344034bb0 0x7f73440e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f7350e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344034bb0 0x7f73440e1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57042/0 (socket says 172.21.15.45:57042) 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f7350e00640 1 -- 172.21.15.45:0/481774371 learned_addr learned my addr 172.21.15.45:0/481774371 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f786d200640 1 -- 172.21.15.45:0/593606151 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7860050fb0 msgr2=0x7f78600ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f786d200640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7860050fb0 0x7f78600ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f786d200640 1 -- 172.21.15.45:0/593606151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78600deea0 msgr2=0x7f78600df9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.408+0000 7f786d200640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f78600deea0 0x7f78600df9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.409+0000 7f786d200640 1 -- 172.21.15.45:0/593606151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c009450 con 0x7f78600dead0 2024-08-17T02:25:25.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.409+0000 7f734be00640 1 -- 172.21.15.45:0/481774371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73440066c0 msgr2=0x7f73440e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.409+0000 7f734be00640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73440066c0 0x7f73440e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.409+0000 7f734be00640 1 -- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344034bb0 msgr2=0x7f73440e1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.409+0000 7f734be00640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7344034bb0 0x7f73440e1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.409+0000 7f786d200640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78600dead0 0x7f78600df480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f785400d890 tx=0x7f7854008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.409+0000 7f734be00640 1 -- 172.21.15.45:0/481774371 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7338009390 con 0x7f7344006270 2024-08-17T02:25:25.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f18a3400640 1 -- 172.21.15.45:0/3990598911 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f189c01e460 con 0x7f18a80e1bd0 2024-08-17T02:25:25.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f72dbc00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc004a90 0x7f72cc006270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f01f0c00640 1 --2- 172.21.15.45:0/674955860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e400de60 0x7f01e40dfac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009850 tx=0x7f01d80090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34241a250bd1367a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f00e1a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00d4006150 0x7f00d40d8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f00e1a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00d40e1bd0 0x7f00d40e4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f00e1a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00d40e5c30 0x7f00d40e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f00e1a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40d72c0 con 0x7f00d40e1bd0 2024-08-17T02:25:25.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f00e1a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40d8b60 con 0x7f00d40e5c30 2024-08-17T02:25:25.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f00e1a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d40e1a20 con 0x7f00d4006150 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f00e1000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00d40e5c30 0x7f00d40e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f00e1000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00d40e5c30 0x7f00d40e4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38326/0 (socket says 172.21.15.45:38326) 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f00e1000640 1 -- 172.21.15.45:0/4013094263 learned_addr learned my addr 172.21.15.45:0/4013094263 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f00dbe00640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00d4006150 0x7f00d40d8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f734be00640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7344006270 0x7f7344033960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f734000c510 tx=0x7f7340007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f733f400640 1 -- 172.21.15.45:0/481774371 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7340005b70 con 0x7f7344006270 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f733f400640 1 -- 172.21.15.45:0/481774371 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7340005cd0 con 0x7f7344006270 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f733f400640 1 -- 172.21.15.45:0/481774371 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73400072e0 con 0x7f7344006270 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f7351800640 1 -- 172.21.15.45:0/481774371 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734402e3c0 con 0x7f7344006270 2024-08-17T02:25:25.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f7351800640 1 -- 172.21.15.45:0/481774371 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7344033ea0 con 0x7f7344006270 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f7864c00640 1 -- 172.21.15.45:0/593606151 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78540096a0 con 0x7f78600dead0 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f786f000640 1 -- 172.21.15.45:0/593606151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78600ee5a0 con 0x7f78600dead0 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f786f000640 1 -- 172.21.15.45:0/593606151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78600e1760 con 0x7f78600dead0 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f01ebe00640 1 -- 172.21.15.45:0/674955860 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d802ac40 con 0x7f01e400de60 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f01ebe00640 1 -- 172.21.15.45:0/674955860 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d802ada0 con 0x7f01e400de60 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f01ebe00640 1 -- 172.21.15.45:0/674955860 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8032670 con 0x7f01e400de60 2024-08-17T02:25:25.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f01f2a00640 1 -- 172.21.15.45:0/674955860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e400de60 msgr2=0x7f01e40dfac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f72dbc00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc0077e0 con 0x7f72cc034bb0 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f72dbc00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72cc006bf0 con 0x7f72cc03a4b0 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f72dbc00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc007c70 con 0x7f72cc004a90 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f72d9200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc004a90 0x7f72cc006270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f72d9200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc004a90 0x7f72cc006270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:58438/0 (socket says 172.21.15.45:58438) 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.410+0000 7f72d9200640 1 -- 172.21.15.45:0/2661246594 learned_addr learned my addr 172.21.15.45:0/2661246594 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f72d9200640 1 -- 172.21.15.45:0/2661246594 >> v1:172.21.15.169:6789/0 conn(0x7f72cc03a4b0 legacy=0x7f72cc0ddc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f72d9200640 1 -- 172.21.15.45:0/2661246594 >> v1:172.21.15.45:6789/0 conn(0x7f72cc034bb0 legacy=0x7f72cc039da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:25.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f72d9200640 1 -- 172.21.15.45:0/2661246594 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72cc006eb0 con 0x7f72cc004a90 2024-08-17T02:25:25.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f0185c00640 1 Processor -- start 2024-08-17T02:25:25.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.411+0000 7f18a3400640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1890065220 0x7f18900676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f18a3400640 1 -- 172.21.15.45:0/3990598911 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f189c0827d0 con 0x7f18a80e1bd0 2024-08-17T02:25:25.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f18a3400640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] conn(0x7f189006d3b0 0x7f189006f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f18a3400640 1 -- 172.21.15.45:0/3990598911 --> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f189006fe70 con 0x7f189006d3b0 2024-08-17T02:25:25.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f01f2a00640 1 --2- 172.21.15.45:0/674955860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e400de60 0x7f01e40dfac0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009850 tx=0x7f01d80090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f0185c00640 1 -- start start 2024-08-17T02:25:25.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f00e1000640 1 -- 172.21.15.45:0/4013094263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00d4006150 msgr2=0x7f00d40d8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f00e1000640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00d4006150 0x7f00d40d8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f00e1000640 1 -- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00d40e1bd0 msgr2=0x7f00d40e4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f00e1000640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00d40e1bd0 0x7f00d40e4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f01f2a00640 1 -- 172.21.15.45:0/674955860 shutdown_connections 2024-08-17T02:25:25.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f00e1000640 1 -- 172.21.15.45:0/4013094263 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc04c200 con 0x7f00d40e5c30 2024-08-17T02:25:25.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f00dbe00640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f00d4006150 0x7f00d40d8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:25.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f01f2a00640 1 --2- 172.21.15.45:0/674955860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01e40e0000 0x7f01e40556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f01f2a00640 1 --2- 172.21.15.45:0/674955860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e400de60 0x7f01e40dfac0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f18afe00640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1890065220 0x7f18900676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f00e1000640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00d40e5c30 0x7f00d40e4aa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00d000c960 tx=0x7f00d0001bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f01f2a00640 1 -- 172.21.15.45:0/674955860 >> 172.21.15.45:0/674955860 conn(0x7f01e4057870 msgr2=0x7f01e4009ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.413+0000 7f01f2a00640 1 -- 172.21.15.45:0/674955860 shutdown_connections 2024-08-17T02:25:25.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.413+0000 7f18b4c00640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] conn(0x7f189006d3b0 0x7f189006f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.413+0000 7f00cf400640 1 -- 172.21.15.45:0/4013094263 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d000a850 con 0x7f00d40e5c30 2024-08-17T02:25:25.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.413+0000 7f00cf400640 1 -- 172.21.15.45:0/4013094263 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d000a9b0 con 0x7f00d40e5c30 2024-08-17T02:25:25.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.413+0000 7f00cf400640 1 -- 172.21.15.45:0/4013094263 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d000ad50 con 0x7f00d40e5c30 2024-08-17T02:25:25.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.413+0000 7f00e1a00640 1 -- 172.21.15.45:0/4013094263 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c8009450 con 0x7f00d40e5c30 2024-08-17T02:25:25.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.413+0000 7f00e1a00640 1 -- 172.21.15.45:0/4013094263 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d40d8890 con 0x7f00d40e5c30 2024-08-17T02:25:25.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.413+0000 7f01f2a00640 1 -- 172.21.15.45:0/674955860 wait complete. 2024-08-17T02:25:25.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.413+0000 7fe3f3400640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe3dc065220 0x7fe3dc0676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f7864c00640 1 -- 172.21.15.45:0/593606151 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7854009800 con 0x7f78600dead0 2024-08-17T02:25:25.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f7864c00640 1 -- 172.21.15.45:0/593606151 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78540096a0 con 0x7f78600dead0 2024-08-17T02:25:25.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.414+0000 7f18b4c00640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] conn(0x7f189006d3b0 0x7f189006f7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.412+0000 7f786f000640 1 -- 172.21.15.45:0/593606151 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7860005770 con 0x7f78600dead0 2024-08-17T02:25:25.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.414+0000 7f7351800640 1 -- 172.21.15.45:0/481774371 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7344005770 con 0x7f7344006270 2024-08-17T02:25:25.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.414+0000 7f0185c00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f01800ca350 0x7f01800cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.414+0000 7f0185c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01800ae1b0 0x7f01800cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.414+0000 7f18afe00640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1890065220 0x7f18900676d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009130 tx=0x7f18a4032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.415+0000 7f72d9200640 1 --2- 172.21.15.45:0/2661246594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc004a90 0x7f72cc006270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009940 tx=0x7f72c80091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37133274be8c52c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.414+0000 7fe3f3400640 1 -- 172.21.15.45:0/2729027707 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe3e8081720 con 0x7fe3fc0c7bb0 2024-08-17T02:25:25.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.414+0000 7fe3fbe00640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe3dc065220 0x7fe3dc0676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.415+0000 7f0185c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01800cb730 con 0x7f01800ca720 2024-08-17T02:25:25.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.415+0000 7f0185c00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800cf9c0 con 0x7f01800ae1b0 2024-08-17T02:25:25.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.415+0000 7f0185c00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01800cb0e0 con 0x7f01800ca350 2024-08-17T02:25:25.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7f18a3400640 1 -- 172.21.15.45:0/3990598911 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f189c050910 con 0x7f18a80e1bd0 2024-08-17T02:25:25.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.414+0000 7f733f400640 1 -- 172.21.15.45:0/481774371 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f734001b3b0 con 0x7f7344006270 2024-08-17T02:25:25.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.415+0000 7f017fe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f01800ca350 0x7f01800cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7f017fe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f01800ca350 0x7f01800cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38342/0 (socket says 172.21.15.45:38342) 2024-08-17T02:25:25.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7f017fe00640 1 -- 172.21.15.45:0/1183206240 learned_addr learned my addr 172.21.15.45:0/1183206240 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7f733f400640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f732c0652a0 0x7f732c067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.415+0000 7f7864c00640 1 -- 172.21.15.45:0/593606151 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7854009c00 con 0x7f78600dead0 2024-08-17T02:25:25.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.415+0000 7f72d3400640 1 -- 172.21.15.45:0/2661246594 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c802adb0 con 0x7f72cc004a90 2024-08-17T02:25:25.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7f72d3400640 1 -- 172.21.15.45:0/2661246594 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c8032440 con 0x7f72cc004a90 2024-08-17T02:25:25.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7f72d3400640 1 -- 172.21.15.45:0/2661246594 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c8032820 con 0x7f72cc004a90 2024-08-17T02:25:25.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7f017f400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f01800ca720 0x7f01800cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33420/0 (socket says 172.21.15.45:33420) 2024-08-17T02:25:25.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7f0185200640 1 --2- 172.21.15.45:0/1183206240 >> v2:172.21.15.45:3300/0 conn(0x7f01800ae1b0 0x7f01800cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7f733f400640 1 -- 172.21.15.45:0/481774371 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7340081780 con 0x7f7344006270 2024-08-17T02:25:25.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.415+0000 7fe3f3400640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] conn(0x7fe3dc06d430 0x7fe3dc06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7fe3f3400640 1 -- 172.21.15.45:0/2729027707 --> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3dc06fef0 con 0x7fe3dc06d430 2024-08-17T02:25:25.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7fe3f3400640 1 -- 172.21.15.45:0/2729027707 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3e8083c80 con 0x7fe3fc0c7bb0 2024-08-17T02:25:25.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.416+0000 7fe3fb400640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] conn(0x7fe3dc06d430 0x7fe3dc06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f733f400640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] conn(0x7f732c06d4b0 0x7f732c06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.415+0000 7f00e1a00640 1 -- 172.21.15.45:0/4013094263 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00d4005320 con 0x7f00d40e5c30 2024-08-17T02:25:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f00cf400640 1 -- 172.21.15.45:0/4013094263 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f00d0012610 con 0x7f00d40e5c30 2024-08-17T02:25:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f017fe00640 1 -- 172.21.15.45:0/1183206240 >> v2:172.21.15.45:3300/0 conn(0x7f01800ae1b0 msgr2=0x7f01800cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f017fe00640 1 --2- 172.21.15.45:0/1183206240 >> v2:172.21.15.45:3300/0 conn(0x7f01800ae1b0 0x7f01800cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f017fe00640 1 -- 172.21.15.45:0/1183206240 >> v1:172.21.15.45:6789/0 conn(0x7f01800ca720 legacy=0x7f01800cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f017fe00640 1 -- 172.21.15.45:0/1183206240 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800cb3c0 con 0x7f01800ca350 2024-08-17T02:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f72dbc00640 1 -- 172.21.15.45:0/2661246594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc004a90 msgr2=0x7f72cc006270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f72dbc00640 1 --2- 172.21.15.45:0/2661246594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc004a90 0x7f72cc006270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f72c8009940 tx=0x7f72c80091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f734b400640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f732c0652a0 0x7f732c067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f733f400640 1 -- 172.21.15.45:0/481774371 --> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f732c06ff70 con 0x7f732c06d4b0 2024-08-17T02:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f733f400640 1 -- 172.21.15.45:0/481774371 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7340083c60 con 0x7f7344006270 2024-08-17T02:25:25.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f7350e00640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] conn(0x7f732c06d4b0 0x7f732c06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7fe3fb400640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] conn(0x7fe3dc06d430 0x7fe3dc06f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.417+0000 7f01f2a00640 1 Processor -- start 2024-08-17T02:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.418+0000 7f72dbc00640 1 -- 172.21.15.45:0/2661246594 shutdown_connections 2024-08-17T02:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.418+0000 7f72dbc00640 1 --2- 172.21.15.45:0/2661246594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc004a90 0x7f72cc006270 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.418+0000 7f72dbc00640 1 -- 172.21.15.45:0/2661246594 >> 172.21.15.45:0/2661246594 conn(0x7f72cc055aa0 msgr2=0x7f72cc051a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.418+0000 7f01f2a00640 1 -- start start 2024-08-17T02:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.418+0000 7f72dbc00640 1 -- 172.21.15.45:0/2661246594 shutdown_connections 2024-08-17T02:25:25.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.418+0000 7f7864c00640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7848065230 0x7f78480676e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.418+0000 7f18a3400640 1 -- 172.21.15.45:0/3990598911 <== osd.0 v2:172.21.15.45:6808/37438 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f189006fe70 con 0x7f189006d3b0 2024-08-17T02:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.418+0000 7f00cf400640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f00bc0652a0 0x7f00bc067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f734b400640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f732c0652a0 0x7f732c067750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7338035000 tx=0x7f7338036000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.418+0000 7f7864c00640 1 -- 172.21.15.45:0/593606151 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7854082e10 con 0x7f78600dead0 2024-08-17T02:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f7350e00640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] conn(0x7f732c06d4b0 0x7f732c06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f017fe00640 1 --2- 172.21.15.45:0/1183206240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800ca350 0x7f01800cf2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0180064630 tx=0x7f01700091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51a33f07a2726901 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f7864c00640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] conn(0x7f784806d370 0x7f784806f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f786dc00640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7848065230 0x7f78480676e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f7864c00640 1 -- 172.21.15.45:0/593606151 --> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f784806fe30 con 0x7f784806d370 2024-08-17T02:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f7864c00640 1 -- 172.21.15.45:0/593606151 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7854083140 con 0x7f78600dead0 2024-08-17T02:25:25.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7fe3f3400640 1 -- 172.21.15.45:0/2729027707 <== osd.1 v2:172.21.15.45:6816/37437 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe3dc06fef0 con 0x7fe3dc06d430 2024-08-17T02:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f01f2a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01e400da90 0x7f01e40e12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f01f2a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e400de60 0x7f01e40e1c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f01f2a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01e40e0000 0x7f01e404cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f01f2a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40e17f0 con 0x7f01e400da90 2024-08-17T02:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f01f2a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40e0e20 con 0x7f01e400de60 2024-08-17T02:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f01f2a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01e40e0810 con 0x7f01e40e0000 2024-08-17T02:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f017ea00640 1 -- 172.21.15.45:0/1183206240 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170032440 con 0x7f01800ca350 2024-08-17T02:25:25.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f017ea00640 1 -- 172.21.15.45:0/1183206240 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01700325a0 con 0x7f01800ca350 2024-08-17T02:25:25.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f72dbc00640 1 -- 172.21.15.45:0/2661246594 wait complete. 2024-08-17T02:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f017ea00640 1 -- 172.21.15.45:0/1183206240 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0170032440 con 0x7f01800ca350 2024-08-17T02:25:25.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.420+0000 7f786e600640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] conn(0x7f784806d370 0x7f784806f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.420+0000 7f01f1600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01e400da90 0x7f01e40e12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.420+0000 7f01f1600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01e400da90 0x7f01e40e12b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57070/0 (socket says 172.21.15.45:57070) 2024-08-17T02:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.420+0000 7f01f0c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e400de60 0x7f01e40e1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.420+0000 7f01f1600640 1 -- 172.21.15.45:0/241483928 learned_addr learned my addr 172.21.15.45:0/241483928 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f00cf400640 1 -- 172.21.15.45:0/4013094263 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00d00823d0 con 0x7f00d40e5c30 2024-08-17T02:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.420+0000 7f01f2000640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01e40e0000 0x7f01e404cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.420+0000 7f0185c00640 1 -- 172.21.15.45:0/1183206240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800ca350 msgr2=0x7f01800cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.420+0000 7f0185c00640 1 --2- 172.21.15.45:0/1183206240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800ca350 0x7f01800cf2d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0180064630 tx=0x7f01700091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.420+0000 7f733f400640 1 -- 172.21.15.45:0/481774371 <== osd.3 v2:172.21.15.45:6824/37447 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f732c06ff70 con 0x7f732c06d4b0 2024-08-17T02:25:25.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f786e600640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] conn(0x7f784806d370 0x7f784806f780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f01f0c00640 1 -- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01e40e0000 msgr2=0x7f01e404cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f01f0c00640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01e40e0000 0x7f01e404cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f01f0c00640 1 -- 172.21.15.45:0/241483928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01e400da90 msgr2=0x7f01e40e12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f0185c00640 1 -- 172.21.15.45:0/1183206240 shutdown_connections 2024-08-17T02:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f0185c00640 1 --2- 172.21.15.45:0/1183206240 >> v2:172.21.15.45:3300/0 conn(0x7f01800ae1b0 0x7f01800cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f0185c00640 1 --2- 172.21.15.45:0/1183206240 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800ca350 0x7f01800cf2d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.419+0000 7f00dbe00640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f00bc0652a0 0x7f00bc067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f0185c00640 1 -- 172.21.15.45:0/1183206240 >> 172.21.15.45:0/1183206240 conn(0x7f01800cfdb0 msgr2=0x7f01800d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f0185c00640 1 -- 172.21.15.45:0/1183206240 shutdown_connections 2024-08-17T02:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f01f0c00640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01e400da90 0x7f01e40e12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f01f0c00640 1 -- 172.21.15.45:0/241483928 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d8009390 con 0x7f01e400de60 2024-08-17T02:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f01f2000640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01e40e0000 0x7f01e404cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.421+0000 7f01f1600640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01e400da90 0x7f01e40e12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:25.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7fe3fbe00640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe3dc065220 0x7fe3dc0676d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec001ed0 tx=0x7fe3ec001080 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f00cf400640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] conn(0x7f00bc06d430 0x7f00bc06f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f00cf400640 1 -- 172.21.15.45:0/4013094263 --> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00bc06fef0 con 0x7f00bc06d430 2024-08-17T02:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f00cf400640 1 -- 172.21.15.45:0/4013094263 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00d00504f0 con 0x7f00d40e5c30 2024-08-17T02:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.423+0000 7f00db400640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] conn(0x7f00bc06d430 0x7f00bc06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.423+0000 7f00dbe00640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f00bc0652a0 0x7f00bc067750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00c8034000 tx=0x7f00c8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f7864c00640 1 -- 172.21.15.45:0/593606151 <== osd.4 v2:172.21.15.169:6824/37316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f784806fe30 con 0x7f784806d370 2024-08-17T02:25:25.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f786dc00640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7848065230 0x7f78480676e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f785c009420 tx=0x7f785c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f01f0c00640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e400de60 0x7f01e40e1c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01e40e4c50 tx=0x7f01d8032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f01e8c00640 1 -- 172.21.15.45:0/241483928 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8031780 con 0x7f01e400de60 2024-08-17T02:25:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f01e8c00640 1 -- 172.21.15.45:0/241483928 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d8031920 con 0x7f01e400de60 2024-08-17T02:25:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f01e8c00640 1 -- 172.21.15.45:0/241483928 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8031ce0 con 0x7f01e400de60 2024-08-17T02:25:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f01f2a00640 1 -- 172.21.15.45:0/241483928 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e40e2830 con 0x7f01e400de60 2024-08-17T02:25:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.423+0000 7f01f2a00640 1 -- 172.21.15.45:0/241483928 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e40e0ab0 con 0x7f01e400de60 2024-08-17T02:25:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f72dbc00640 1 Processor -- start 2024-08-17T02:25:25.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.423+0000 7f72dbc00640 1 -- start start 2024-08-17T02:25:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.422+0000 7f0185c00640 1 -- 172.21.15.45:0/1183206240 wait complete. 2024-08-17T02:25:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.424+0000 7f0185c00640 1 Processor -- start 2024-08-17T02:25:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.424+0000 7f72dbc00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72cc004a90 0x7f72cc0cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.424+0000 7f72dbc00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc034bb0 0x7f72cc0d7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.424+0000 7f72dbc00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc03a4b0 0x7f72cc0d76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.424+0000 7f72dbc00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc04c9b0 con 0x7f72cc034bb0 2024-08-17T02:25:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.424+0000 7f72dbc00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0cfe00 con 0x7f72cc004a90 2024-08-17T02:25:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.424+0000 7f72dbc00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72cc0d3db0 con 0x7f72cc03a4b0 2024-08-17T02:25:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.424+0000 7f01f2a00640 1 -- 172.21.15.45:0/241483928 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01e40e0670 con 0x7f01e400de60 2024-08-17T02:25:25.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.424+0000 7f0185c00640 1 -- start start 2024-08-17T02:25:25.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.424+0000 7f00db400640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] conn(0x7f00bc06d430 0x7f00bc06f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.425+0000 7f00cf400640 1 -- 172.21.15.45:0/4013094263 <== osd.2 v2:172.21.15.45:6800/37436 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f00bc06fef0 con 0x7f00bc06d430 2024-08-17T02:25:25.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.425+0000 7f72d9200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72cc004a90 0x7f72cc0cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.425+0000 7f72d3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc034bb0 0x7f72cc0d7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.426+0000 7f72d9c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc03a4b0 0x7f72cc0d76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.426+0000 7f72d9c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc03a4b0 0x7f72cc0d76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:58464/0 (socket says 172.21.15.45:58464) 2024-08-17T02:25:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.426+0000 7f72d9c00640 1 -- 172.21.15.45:0/1788829864 learned_addr learned my addr 172.21.15.45:0/1788829864 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.426+0000 7f72d9200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72cc004a90 0x7f72cc0cf8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38366/0 (socket says 172.21.15.45:38366) 2024-08-17T02:25:25.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f01e8c00640 1 -- 172.21.15.45:0/241483928 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f01d803e660 con 0x7f01e400de60 2024-08-17T02:25:25.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f72d9200640 1 -- 172.21.15.45:0/1788829864 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc03a4b0 msgr2=0x7f72cc0d76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f72d9200640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc03a4b0 0x7f72cc0d76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f72d9200640 1 -- 172.21.15.45:0/1788829864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc034bb0 msgr2=0x7f72cc0d7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f72d9200640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc034bb0 0x7f72cc0d7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f72d9200640 1 -- 172.21.15.45:0/1788829864 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c8009450 con 0x7f72cc004a90 2024-08-17T02:25:25.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f72d9c00640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f72cc03a4b0 0x7f72cc0d76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:25.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f72d3e00640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72cc034bb0 0x7f72cc0d7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f0185c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800ae1b0 0x7f01801700e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f0185c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800ca350 0x7f01801772a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f0185c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800ca720 0x7f01800c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f0185c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0180170620 con 0x7f01800ca350 2024-08-17T02:25:25.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.428+0000 7f72d9200640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72cc004a90 0x7f72cc0cf8c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f72c8031000 tx=0x7f72c8032000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.428+0000 7f01e8c00640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f01cc0652d0 0x7f01cc067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f0185c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01800c71d0 con 0x7f01800ca720 2024-08-17T02:25:25.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.427+0000 7f0185c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01800c9410 con 0x7f01800ae1b0 2024-08-17T02:25:25.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.428+0000 7f01e8c00640 1 -- 172.21.15.45:0/241483928 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f01d80a2610 con 0x7f01e400de60 2024-08-17T02:25:25.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f017fe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800ae1b0 0x7f01801700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f01e8c00640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] conn(0x7f01cc06d4e0 0x7f01cc06f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f01e8c00640 1 -- 172.21.15.45:0/241483928 --> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f01cc06ffa0 con 0x7f01cc06d4e0 2024-08-17T02:25:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f01e8c00640 1 -- 172.21.15.45:0/241483928 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01d80a4bb0 con 0x7f01e400de60 2024-08-17T02:25:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f017f400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800ca350 0x7f01801772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f017f400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800ca350 0x7f01801772a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57090/0 (socket says 172.21.15.45:57090) 2024-08-17T02:25:25.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f017f400640 1 -- 172.21.15.45:0/3623155314 learned_addr learned my addr 172.21.15.45:0/3623155314 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f01f1600640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f01cc0652d0 0x7f01cc067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f0185200640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800ca720 0x7f01800c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f01f2000640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] conn(0x7f01cc06d4e0 0x7f01cc06f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f72c7e00640 1 -- 172.21.15.45:0/1788829864 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c8031a60 con 0x7f72cc004a90 2024-08-17T02:25:25.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f72c7e00640 1 -- 172.21.15.45:0/1788829864 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c8031be0 con 0x7f72cc004a90 2024-08-17T02:25:25.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.429+0000 7f72c7e00640 1 -- 172.21.15.45:0/1788829864 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c803b400 con 0x7f72cc004a90 2024-08-17T02:25:25.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.430+0000 7f72dbc00640 1 -- 172.21.15.45:0/1788829864 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72cc04c080 con 0x7f72cc004a90 2024-08-17T02:25:25.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.430+0000 7f72dbc00640 1 -- 172.21.15.45:0/1788829864 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72cc04c640 con 0x7f72cc004a90 2024-08-17T02:25:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.430+0000 7f017f400640 1 -- 172.21.15.45:0/3623155314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800ae1b0 msgr2=0x7f01801700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.430+0000 7f017f400640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f01800ae1b0 0x7f01801700e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.430+0000 7f017f400640 1 -- 172.21.15.45:0/3623155314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800ca720 msgr2=0x7f01800c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.430+0000 7f017f400640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800ca720 0x7f01800c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.430+0000 7f017f400640 1 -- 172.21.15.45:0/3623155314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0170009450 con 0x7f01800ca350 2024-08-17T02:25:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.431+0000 7f0185200640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01800ca720 0x7f01800c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:25.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.431+0000 7f72dbc00640 1 -- 172.21.15.45:0/1788829864 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f72cc005770 con 0x7f72cc004a90 2024-08-17T02:25:25.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.432+0000 7f01f1600640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f01cc0652d0 0x7f01cc067780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01e41024a0 tx=0x7f01e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.431+0000 7f017f400640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800ca350 0x7f01801772a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f016c00c510 tx=0x7f016c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.432+0000 7f01f2000640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] conn(0x7f01cc06d4e0 0x7f01cc06f8f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.432+0000 7f0177400640 1 -- 172.21.15.45:0/3623155314 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c0072e0 con 0x7f01800ca350 2024-08-17T02:25:25.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.432+0000 7f0177400640 1 -- 172.21.15.45:0/3623155314 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016c007440 con 0x7f01800ca350 2024-08-17T02:25:25.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.432+0000 7f0177400640 1 -- 172.21.15.45:0/3623155314 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016c0047a0 con 0x7f01800ca350 2024-08-17T02:25:25.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.433+0000 7f0185c00640 1 -- 172.21.15.45:0/3623155314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01800c96f0 con 0x7f01800ca350 2024-08-17T02:25:25.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.433+0000 7f0185c00640 1 -- 172.21.15.45:0/3623155314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01800c6e60 con 0x7f01800ca350 2024-08-17T02:25:25.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.433+0000 7f01e8c00640 1 -- 172.21.15.45:0/241483928 <== osd.5 v2:172.21.15.169:6808/37297 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f01cc06ffa0 con 0x7f01cc06d4e0 2024-08-17T02:25:25.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.433+0000 7f72c7e00640 1 -- 172.21.15.45:0/1788829864 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f72c8039040 con 0x7f72cc004a90 2024-08-17T02:25:25.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.435+0000 7f72c7e00640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f72b40652a0 0x7f72b4067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.435+0000 7f0185c00640 1 -- 172.21.15.45:0/3623155314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0180071050 con 0x7f01800ca350 2024-08-17T02:25:25.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.436+0000 7f72c7e00640 1 -- 172.21.15.45:0/1788829864 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72c8041030 con 0x7f72cc004a90 2024-08-17T02:25:25.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.436+0000 7f72c7e00640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] conn(0x7f72b406d4b0 0x7f72b406f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.436+0000 7f72c7e00640 1 -- 172.21.15.45:0/1788829864 --> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f72b406ff70 con 0x7f72b406d4b0 2024-08-17T02:25:25.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.436+0000 7f72c7e00640 1 -- 172.21.15.45:0/1788829864 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72c80a31e0 con 0x7f72cc004a90 2024-08-17T02:25:25.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.437+0000 7f72d9c00640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] conn(0x7f72b406d4b0 0x7f72b406f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.437+0000 7f72d3e00640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f72b40652a0 0x7f72b4067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.438+0000 7f72d9c00640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] conn(0x7f72b406d4b0 0x7f72b406f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.438+0000 7f72d3e00640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f72b40652a0 0x7f72b4067750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0d7dc0 tx=0x7f72c0000f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.438+0000 7f0177400640 1 -- 172.21.15.45:0/3623155314 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f016c004bd0 con 0x7f01800ca350 2024-08-17T02:25:25.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.439+0000 7f0177400640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f01600652a0 0x7f0160067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.440+0000 7f0177400640 1 -- 172.21.15.45:0/3623155314 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f016c0822e0 con 0x7f01800ca350 2024-08-17T02:25:25.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.440+0000 7f0177400640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] conn(0x7f016006d3e0 0x7f016006f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.440+0000 7f0177400640 1 -- 172.21.15.45:0/3623155314 --> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f016006fea0 con 0x7f016006d3e0 2024-08-17T02:25:25.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.440+0000 7f0177400640 1 -- 172.21.15.45:0/3623155314 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f016c082610 con 0x7f01800ca350 2024-08-17T02:25:25.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.440+0000 7f72c7e00640 1 -- 172.21.15.45:0/1788829864 <== osd.6 v2:172.21.15.169:6800/37298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f72b406ff70 con 0x7f72b406d4b0 2024-08-17T02:25:25.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.440+0000 7f017fe00640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f01600652a0 0x7f0160067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.441+0000 7f0185200640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] conn(0x7f016006d3e0 0x7f016006f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.443+0000 7f017fe00640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f01600652a0 0x7f0160067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0170034000 tx=0x7f0170032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.443+0000 7f0185200640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] conn(0x7f016006d3e0 0x7f016006f7f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.444+0000 7f0177400640 1 -- 172.21.15.45:0/3623155314 <== osd.7 v2:172.21.15.169:6816/37299 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f016006fea0 con 0x7f016006d3e0 2024-08-17T02:25:25.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.449+0000 7fe401a00640 1 -- 172.21.15.45:0/2729027707 --> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3fc071050 con 0x7fe3dc06d430 2024-08-17T02:25:25.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.449+0000 7fe3f3400640 1 -- 172.21.15.45:0/2729027707 <== osd.1 v2:172.21.15.45:6816/37437 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe3fc071050 con 0x7fe3dc06d430 2024-08-17T02:25:25.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.450+0000 7fe401a00640 1 -- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] conn(0x7fe3dc06d430 msgr2=0x7fe3dc06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.450+0000 7fe401a00640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] conn(0x7fe3dc06d430 0x7fe3dc06f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.450+0000 7fe401a00640 1 -- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe3dc065220 msgr2=0x7fe3dc0676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.450+0000 7fe401a00640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe3dc065220 0x7fe3dc0676d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe3ec001ed0 tx=0x7fe3ec001080 comp rx=0 tx=0).stop 2024-08-17T02:25:25.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.450+0000 7fe401a00640 1 -- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3fc0c7bb0 msgr2=0x7fe3fc0c8020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.450+0000 7fe401a00640 1 --2- 172.21.15.45:0/2729027707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3fc0c7bb0 0x7fe3fc0c8020 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe3fc069ee0 tx=0x7fe3e8008040 comp rx=0 tx=0).stop 2024-08-17T02:25:25.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.450+0000 7fe401000640 1 -- 172.21.15.45:0/2729027707 reap_dead start 2024-08-17T02:25:25.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.451+0000 7fe401a00640 1 -- 172.21.15.45:0/2729027707 shutdown_connections 2024-08-17T02:25:25.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.451+0000 7fe401a00640 1 -- 172.21.15.45:0/2729027707 >> 172.21.15.45:0/2729027707 conn(0x7fe3fc098e30 msgr2=0x7fe3fc158160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.451+0000 7f18a0c00640 1 -- 172.21.15.45:0/3990598911 --> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18a80e2970 con 0x7f189006d3b0 2024-08-17T02:25:25.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.451+0000 7f7351800640 1 -- 172.21.15.45:0/481774371 --> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7344007460 con 0x7f732c06d4b0 2024-08-17T02:25:25.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.452+0000 7f18a3400640 1 -- 172.21.15.45:0/3990598911 <== osd.0 v2:172.21.15.45:6808/37438 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f18b0065f20 con 0x7f189006d3b0 2024-08-17T02:25:25.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.452+0000 7f18a0c00640 1 -- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] conn(0x7f189006d3b0 msgr2=0x7f189006f7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.452+0000 7f18a0c00640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] conn(0x7f189006d3b0 0x7f189006f7c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.452+0000 7f18a0c00640 1 -- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1890065220 msgr2=0x7f18900676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.452+0000 7fe401a00640 1 -- 172.21.15.45:0/2729027707 shutdown_connections 2024-08-17T02:25:25.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.452+0000 7f733f400640 1 -- 172.21.15.45:0/481774371 <== osd.3 v2:172.21.15.45:6824/37447 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7344007460 con 0x7f732c06d4b0 2024-08-17T02:25:25.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.452+0000 7f18a0c00640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1890065220 0x7f18900676d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009130 tx=0x7f18a4032000 comp rx=0 tx=0).stop 2024-08-17T02:25:25.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.452+0000 7f18a0c00640 1 -- 172.21.15.45:0/3990598911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18a80e1bd0 msgr2=0x7f18a80e1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.452+0000 7f18a0c00640 1 --2- 172.21.15.45:0/3990598911 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18a80e1bd0 0x7f18a80e1120 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f189c00d890 tx=0x7f189c008040 comp rx=0 tx=0).stop 2024-08-17T02:25:25.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.453+0000 7fe401a00640 1 -- 172.21.15.45:0/2729027707 wait complete. 2024-08-17T02:25:25.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.453+0000 7f18b4c00640 1 -- 172.21.15.45:0/3990598911 reap_dead start 2024-08-17T02:25:25.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.453+0000 7f18a0c00640 1 -- 172.21.15.45:0/3990598911 shutdown_connections 2024-08-17T02:25:25.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.453+0000 7f18a0c00640 1 -- 172.21.15.45:0/3990598911 >> 172.21.15.45:0/3990598911 conn(0x7f18a800f070 msgr2=0x7f18a8054740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.453+0000 7f7351800640 1 -- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] conn(0x7f732c06d4b0 msgr2=0x7f732c06f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.453+0000 7f7351800640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] conn(0x7f732c06d4b0 0x7f732c06f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.454+0000 7f18a0c00640 1 -- 172.21.15.45:0/3990598911 shutdown_connections 2024-08-17T02:25:25.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.454+0000 7f18a0c00640 1 -- 172.21.15.45:0/3990598911 wait complete. 2024-08-17T02:25:25.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.454+0000 7f7351800640 1 -- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f732c0652a0 msgr2=0x7f732c067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.454+0000 7f7351800640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f732c0652a0 0x7f732c067750 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7338035000 tx=0x7f7338036000 comp rx=0 tx=0).stop 2024-08-17T02:25:25.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.454+0000 7f7351800640 1 -- 172.21.15.45:0/481774371 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7344006270 msgr2=0x7f7344033960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.454+0000 7f7351800640 1 --2- 172.21.15.45:0/481774371 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7344006270 0x7f7344033960 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f734000c510 tx=0x7f7340007d90 comp rx=0 tx=0).stop 2024-08-17T02:25:25.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.454+0000 7f7350e00640 1 -- 172.21.15.45:0/481774371 reap_dead start 2024-08-17T02:25:25.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.454+0000 7f7351800640 1 -- 172.21.15.45:0/481774371 shutdown_connections 2024-08-17T02:25:25.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.454+0000 7f7351800640 1 -- 172.21.15.45:0/481774371 >> 172.21.15.45:0/481774371 conn(0x7f7344055aa0 msgr2=0x7f7344052b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.454+0000 7f7351800640 1 -- 172.21.15.45:0/481774371 shutdown_connections 2024-08-17T02:25:25.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.455+0000 7f7351800640 1 -- 172.21.15.45:0/481774371 wait complete. 2024-08-17T02:25:25.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.455+0000 7f786f000640 1 -- 172.21.15.45:0/593606151 --> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7860053b80 con 0x7f784806d370 2024-08-17T02:25:25.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.457+0000 7f7864c00640 1 -- 172.21.15.45:0/593606151 <== osd.4 v2:172.21.15.169:6824/37316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7860053b80 con 0x7f784806d370 2024-08-17T02:25:25.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.457+0000 7f786f000640 1 -- 172.21.15.45:0/593606151 >> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] conn(0x7f784806d370 msgr2=0x7f784806f780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.457+0000 7f786f000640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] conn(0x7f784806d370 0x7f784806f780 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.458+0000 7f00e1a00640 1 -- 172.21.15.45:0/4013094263 --> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f00d40e6950 con 0x7f00bc06d430 2024-08-17T02:25:25.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.459+0000 7f786f000640 1 -- 172.21.15.45:0/593606151 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7848065230 msgr2=0x7f78480676e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.459+0000 7f786f000640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7848065230 0x7f78480676e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f785c009420 tx=0x7f785c032000 comp rx=0 tx=0).stop 2024-08-17T02:25:25.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.459+0000 7f786f000640 1 -- 172.21.15.45:0/593606151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78600dead0 msgr2=0x7f78600df480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.459+0000 7f786f000640 1 --2- 172.21.15.45:0/593606151 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78600dead0 0x7f78600df480 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f785400d890 tx=0x7f7854008040 comp rx=0 tx=0).stop 2024-08-17T02:25:25.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.459+0000 7f786e600640 1 -- 172.21.15.45:0/593606151 reap_dead start 2024-08-17T02:25:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.460+0000 7f786f000640 1 -- 172.21.15.45:0/593606151 shutdown_connections 2024-08-17T02:25:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.460+0000 7f786f000640 1 -- 172.21.15.45:0/593606151 >> 172.21.15.45:0/593606151 conn(0x7f7860055ca0 msgr2=0x7f7860037a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.460+0000 7f00cf400640 1 -- 172.21.15.45:0/4013094263 <== osd.2 v2:172.21.15.45:6800/37436 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f00d40e6950 con 0x7f00bc06d430 2024-08-17T02:25:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.463+0000 7f786f000640 1 -- 172.21.15.45:0/593606151 shutdown_connections 2024-08-17T02:25:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.463+0000 7f786f000640 1 -- 172.21.15.45:0/593606151 wait complete. 2024-08-17T02:25:25.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.463+0000 7f00e1a00640 1 -- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] conn(0x7f00bc06d430 msgr2=0x7f00bc06f840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.463+0000 7f00e1a00640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] conn(0x7f00bc06d430 0x7f00bc06f840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.464+0000 7f00e1a00640 1 -- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f00bc0652a0 msgr2=0x7f00bc067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.464+0000 7f00e1a00640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f00bc0652a0 0x7f00bc067750 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00c8034000 tx=0x7f00c8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:25.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.464+0000 7f00e1a00640 1 -- 172.21.15.45:0/4013094263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00d40e5c30 msgr2=0x7f00d40e4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.464+0000 7f00e1a00640 1 --2- 172.21.15.45:0/4013094263 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f00d40e5c30 0x7f00d40e4aa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f00d000c960 tx=0x7f00d0001bf0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.464+0000 7f00e1000640 1 -- 172.21.15.45:0/4013094263 reap_dead start 2024-08-17T02:25:25.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.464+0000 7f00e1a00640 1 -- 172.21.15.45:0/4013094263 shutdown_connections 2024-08-17T02:25:25.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.464+0000 7f00e1a00640 1 -- 172.21.15.45:0/4013094263 >> 172.21.15.45:0/4013094263 conn(0x7f00d400f070 msgr2=0x7f00d4053cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.465+0000 7f00e1a00640 1 -- 172.21.15.45:0/4013094263 shutdown_connections 2024-08-17T02:25:25.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.465+0000 7f01f2a00640 1 -- 172.21.15.45:0/241483928 --> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f01e4037880 con 0x7f01cc06d4e0 2024-08-17T02:25:25.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.465+0000 7f00e1a00640 1 -- 172.21.15.45:0/4013094263 wait complete. 2024-08-17T02:25:25.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.466+0000 7f01e8c00640 1 -- 172.21.15.45:0/241483928 <== osd.5 v2:172.21.15.169:6808/37297 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f01e4037880 con 0x7f01cc06d4e0 2024-08-17T02:25:25.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.467+0000 7f01f2a00640 1 -- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] conn(0x7f01cc06d4e0 msgr2=0x7f01cc06f8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.467+0000 7f01f2a00640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] conn(0x7f01cc06d4e0 0x7f01cc06f8f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.467+0000 7f01f2a00640 1 -- 172.21.15.45:0/241483928 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f01cc0652d0 msgr2=0x7f01cc067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.467+0000 7f01f2a00640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f01cc0652d0 0x7f01cc067780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f01e41024a0 tx=0x7f01e0009040 comp rx=0 tx=0).stop 2024-08-17T02:25:25.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.467+0000 7f01f2a00640 1 -- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e400de60 msgr2=0x7f01e40e1c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.467+0000 7f01f2a00640 1 --2- 172.21.15.45:0/241483928 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f01e400de60 0x7f01e40e1c90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f01e40e4c50 tx=0x7f01d8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.467+0000 7f01f2000640 1 -- 172.21.15.45:0/241483928 reap_dead start 2024-08-17T02:25:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.468+0000 7f01f2a00640 1 -- 172.21.15.45:0/241483928 shutdown_connections 2024-08-17T02:25:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.468+0000 7f01f2a00640 1 -- 172.21.15.45:0/241483928 >> 172.21.15.45:0/241483928 conn(0x7f01e4057870 msgr2=0x7f01e40520d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.468+0000 7f01f2a00640 1 -- 172.21.15.45:0/241483928 shutdown_connections 2024-08-17T02:25:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.468+0000 7f01f2a00640 1 -- 172.21.15.45:0/241483928 wait complete. 2024-08-17T02:25:25.506 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2024-08-17T02:25:25.506 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-08-17T02:25:25.507 INFO:teuthology.orchestra.run.smithi045.stdout:55834574856 2024-08-17T02:25:25.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.479+0000 7f0185c00640 1 -- 172.21.15.45:0/3623155314 --> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0180069ce0 con 0x7f016006d3e0 2024-08-17T02:25:25.507 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-08-17T02:25:25.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.479+0000 7f72dbc00640 1 -- 172.21.15.45:0/1788829864 --> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f72cc007460 con 0x7f72b406d4b0 2024-08-17T02:25:25.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.479+0000 7f0177400640 1 -- 172.21.15.45:0/3623155314 <== osd.7 v2:172.21.15.169:6816/37299 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0180069ce0 con 0x7f016006d3e0 2024-08-17T02:25:25.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.480+0000 7f72c7e00640 1 -- 172.21.15.45:0/1788829864 <== osd.6 v2:172.21.15.169:6800/37298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f72cc007460 con 0x7f72b406d4b0 2024-08-17T02:25:25.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.480+0000 7f0185c00640 1 -- 172.21.15.45:0/3623155314 >> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] conn(0x7f016006d3e0 msgr2=0x7f016006f7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.480+0000 7f0185c00640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] conn(0x7f016006d3e0 0x7f016006f7f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f72dbc00640 1 -- 172.21.15.45:0/1788829864 >> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] conn(0x7f72b406d4b0 msgr2=0x7f72b406f8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.510 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2024-08-17T02:25:25.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f72dbc00640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] conn(0x7f72b406d4b0 0x7f72b406f8c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.511 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-08-17T02:25:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f0185c00640 1 -- 172.21.15.45:0/3623155314 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f01600652a0 msgr2=0x7f0160067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f0185c00640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f01600652a0 0x7f0160067750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0170034000 tx=0x7f0170032000 comp rx=0 tx=0).stop 2024-08-17T02:25:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f0185c00640 1 -- 172.21.15.45:0/3623155314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800ca350 msgr2=0x7f01801772a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f0185c00640 1 --2- 172.21.15.45:0/3623155314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01800ca350 0x7f01801772a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f016c00c510 tx=0x7f016c007ee0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f0185200640 1 -- 172.21.15.45:0/3623155314 reap_dead start 2024-08-17T02:25:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f72dbc00640 1 -- 172.21.15.45:0/1788829864 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f72b40652a0 msgr2=0x7f72b4067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f72dbc00640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f72b40652a0 0x7f72b4067750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72cc0d7dc0 tx=0x7f72c0000f90 comp rx=0 tx=0).stop 2024-08-17T02:25:25.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f0185c00640 1 -- 172.21.15.45:0/3623155314 shutdown_connections 2024-08-17T02:25:25.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f0185c00640 1 -- 172.21.15.45:0/3623155314 >> 172.21.15.45:0/3623155314 conn(0x7f01800cfdb0 msgr2=0x7f01800ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f72dbc00640 1 -- 172.21.15.45:0/1788829864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72cc004a90 msgr2=0x7f72cc0cf8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.482+0000 7f0185c00640 1 -- 172.21.15.45:0/3623155314 shutdown_connections 2024-08-17T02:25:25.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.482+0000 7f0185c00640 1 -- 172.21.15.45:0/3623155314 wait complete. 2024-08-17T02:25:25.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f72dbc00640 1 --2- 172.21.15.45:0/1788829864 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f72cc004a90 0x7f72cc0cf8c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f72c8031000 tx=0x7f72c8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:25.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f72d9c00640 1 -- 172.21.15.45:0/1788829864 reap_dead start 2024-08-17T02:25:25.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f72dbc00640 1 -- 172.21.15.45:0/1788829864 shutdown_connections 2024-08-17T02:25:25.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f72dbc00640 1 -- 172.21.15.45:0/1788829864 >> 172.21.15.45:0/1788829864 conn(0x7f72cc055aa0 msgr2=0x7f72cc053b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f72dbc00640 1 -- 172.21.15.45:0/1788829864 shutdown_connections 2024-08-17T02:25:25.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.481+0000 7f72dbc00640 1 -- 172.21.15.45:0/1788829864 wait complete. 2024-08-17T02:25:25.515 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2024-08-17T02:25:25.516 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-08-17T02:25:25.516 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2024-08-17T02:25:25.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-08-17T02:25:25.518 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2024-08-17T02:25:25.518 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-08-17T02:25:25.519 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2024-08-17T02:25:25.519 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-08-17T02:25:25.520 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2024-08-17T02:25:25.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-08-17T02:25:25.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.816+0000 7fa288c00640 1 Processor -- start 2024-08-17T02:25:25.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.816+0000 7fa288c00640 1 -- start start 2024-08-17T02:25:25.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.819+0000 7fa288c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa284159ca0 0x7fa2840ca360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.819+0000 7fa288c00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa2840ca8a0 0x7fa2840cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.819+0000 7fad9ac00640 1 Processor -- start 2024-08-17T02:25:25.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.819+0000 7fa288c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa2840ccad0 0x7fa2840cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.819+0000 7fad9ac00640 1 -- start start 2024-08-17T02:25:25.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.820+0000 7fa288c00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2840cd6e0 con 0x7fa2840ccad0 2024-08-17T02:25:25.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.820+0000 7fa282a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa2840ca8a0 0x7fa2840cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.820+0000 7fa282a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa2840ca8a0 0x7fa2840cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38392/0 (socket says 172.21.15.45:38392) 2024-08-17T02:25:25.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.820+0000 7fa282a00640 1 -- 172.21.15.45:0/2741070295 learned_addr learned my addr 172.21.15.45:0/2741070295 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.820+0000 7fa288c00640 1 -- 172.21.15.45:0/2741070295 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2840ccf70 con 0x7fa2840ca8a0 2024-08-17T02:25:25.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.821+0000 7fa283400640 1 --2- 172.21.15.45:0/2741070295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa284159ca0 0x7fa2840ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.821+0000 7fa288c00640 1 -- 172.21.15.45:0/2741070295 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840cadc0 con 0x7fa284159ca0 2024-08-17T02:25:25.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.821+0000 7fa283e00640 1 --2- 172.21.15.45:0/2741070295 >> v2:172.21.15.45:3300/0 conn(0x7fa2840ccad0 0x7fa2840cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.822+0000 7fad9ac00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fad940cc9d0 0x7fad940ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.823+0000 7fad99800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fad94158c80 0x7fad940cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33426/0 (socket says 172.21.15.45:33426) 2024-08-17T02:25:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.822+0000 7fa282a00640 1 -- 172.21.15.45:0/2741070295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa284159ca0 msgr2=0x7fa2840ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.823+0000 7fad99800640 1 -- 172.21.15.45:0/1847641338 learned_addr learned my addr 172.21.15.45:0/1847641338 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.823+0000 7fa282a00640 1 --2- 172.21.15.45:0/2741070295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa284159ca0 0x7fa2840ca360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.823+0000 7fa282a00640 1 -- 172.21.15.45:0/2741070295 >> v2:172.21.15.45:3300/0 conn(0x7fa2840ccad0 msgr2=0x7fa2840cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.823+0000 7fa282a00640 1 --2- 172.21.15.45:0/2741070295 >> v2:172.21.15.45:3300/0 conn(0x7fa2840ccad0 0x7fa2840cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.823+0000 7fa282a00640 1 -- 172.21.15.45:0/2741070295 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2840cb060 con 0x7fa2840ca8a0 2024-08-17T02:25:25.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.823+0000 7fad9ac00640 1 -- 172.21.15.45:0/1847641338 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad940cf9d0 con 0x7fad94158c80 2024-08-17T02:25:25.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.823+0000 7fa283e00640 1 --2- 172.21.15.45:0/2741070295 >> v2:172.21.15.45:3300/0 conn(0x7fa2840ccad0 0x7fa2840cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:25.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.823+0000 7fa283400640 1 --2- 172.21.15.45:0/2741070295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa284159ca0 0x7fa2840ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:25.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.823+0000 7fad9ac00640 1 -- 172.21.15.45:0/1847641338 --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad940ceb60 con 0x7fad940cd700 2024-08-17T02:25:25.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.823+0000 7fad9ac00640 1 -- 172.21.15.45:0/1847641338 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad940cedc0 con 0x7fad940cc9d0 2024-08-17T02:25:25.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.824+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501123643 0 0) 0x7fad940cf9d0 con 0x7fad94158c80 2024-08-17T02:25:25.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.824+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad7c0034e0 con 0x7fad94158c80 2024-08-17T02:25:25.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.825+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 290698170 0 0) 0x7fad7c0034e0 con 0x7fad94158c80 2024-08-17T02:25:25.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.825+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 >> v2:172.21.15.45:3300/0 conn(0x7fad940cc9d0 msgr2=0x7fad940ce620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-17T02:25:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.825+0000 7fa282a00640 1 --2- 172.21.15.45:0/2741070295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2840ca8a0 0x7fa2840cc590 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa284088cf0 tx=0x7fa2700091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c37295c221e954 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.825+0000 7fa282000640 1 -- 172.21.15.45:0/2741070295 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27002add0 con 0x7fa2840ca8a0 2024-08-17T02:25:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.825+0000 7fa282000640 1 -- 172.21.15.45:0/2741070295 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa270032440 con 0x7fa2840ca8a0 2024-08-17T02:25:25.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.825+0000 7fa282000640 1 -- 172.21.15.45:0/2741070295 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270032820 con 0x7fa2840ca8a0 2024-08-17T02:25:25.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad9a200640 1 --2- 172.21.15.45:0/1847641338 >> v2:172.21.15.45:3300/0 conn(0x7fad940cc9d0 0x7fad940ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad93e00640 1 --2- 172.21.15.45:0/1847641338 >> v2:172.21.15.45:3300/0 conn(0x7fad940cc9d0 0x7fad940ce620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 >> v1:172.21.15.169:6789/0 conn(0x7fad940cd700 legacy=0x7fad940acfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad940cf0a0 con 0x7fad94158c80 2024-08-17T02:25:25.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7fad8c0017f0 con 0x7fad94158c80 2024-08-17T02:25:25.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 >> v1:172.21.15.45:6789/0 conn(0x7fad94158c80 legacy=0x7fad940cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad93e00640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fad7c0039d0 0x7fad7c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad93e00640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad7c004780 0x7fad7c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad93e00640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad7c005250 0x7fad7c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940cedc0 con 0x7fad7c004780 2024-08-17T02:25:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c0149b0 con 0x7fad7c005250 2024-08-17T02:25:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad7c014b70 con 0x7fad7c0039d0 2024-08-17T02:25:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.826+0000 7fad9a200640 1 --2- 172.21.15.45:0/1847641338 >> v2:172.21.15.45:3300/0 conn(0x7fad940cc9d0 0x7fad940ce620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.827+0000 7fad9a200640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad7c005250 0x7fad7c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.827+0000 7fad99800640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fad7c0039d0 0x7fad7c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.827+0000 7fad98e00640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad7c004780 0x7fad7c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.827+0000 7fa288c00640 1 -- 172.21.15.45:0/2741070295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2840ca8a0 msgr2=0x7fa2840cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.827+0000 7fa288c00640 1 --2- 172.21.15.45:0/2741070295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2840ca8a0 0x7fa2840cc590 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa284088cf0 tx=0x7fa2700091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fad99800640 1 -- 172.21.15.45:0/1847641338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad7c005250 msgr2=0x7fad7c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fad99800640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad7c005250 0x7fad7c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fad99800640 1 -- 172.21.15.45:0/1847641338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad7c004780 msgr2=0x7fad7c004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fad99800640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad7c004780 0x7fad7c004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fad99800640 1 -- 172.21.15.45:0/1847641338 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad940cf0a0 con 0x7fad7c0039d0 2024-08-17T02:25:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fad9a200640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad7c005250 0x7fad7c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fad9a200640 1 -- 172.21.15.45:0/1847641338 reap_dead start 2024-08-17T02:25:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fa288c00640 1 -- 172.21.15.45:0/2741070295 shutdown_connections 2024-08-17T02:25:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fa288c00640 1 --2- 172.21.15.45:0/2741070295 >> v2:172.21.15.45:3300/0 conn(0x7fa2840ccad0 0x7fa2840cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fa288c00640 1 --2- 172.21.15.45:0/2741070295 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2840ca8a0 0x7fa2840cc590 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fa288c00640 1 --2- 172.21.15.45:0/2741070295 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa284159ca0 0x7fa2840ca360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.831 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fa288c00640 1 -- 172.21.15.45:0/2741070295 >> 172.21.15.45:0/2741070295 conn(0x7fa284098e00 msgr2=0x7fa28406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.828+0000 7fad98e00640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad7c004780 0x7fad7c004bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:25.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.830+0000 7f5f6a800640 1 Processor -- start 2024-08-17T02:25:25.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.830+0000 7f5f6a800640 1 -- start start 2024-08-17T02:25:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.830+0000 7f9566800640 1 Processor -- start 2024-08-17T02:25:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.830+0000 7fad99800640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fad7c0039d0 0x7fad7c003da0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00aa50 tx=0x7fad8c00a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15c5360835e451b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.831+0000 7f9566800640 1 -- start start 2024-08-17T02:25:25.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.829+0000 7fa288c00640 1 -- 172.21.15.45:0/2741070295 shutdown_connections 2024-08-17T02:25:25.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.829+0000 7fa288c00640 1 -- 172.21.15.45:0/2741070295 wait complete. 2024-08-17T02:25:25.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.831+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c02b610 con 0x7fad7c0039d0 2024-08-17T02:25:25.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.831+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c02b7b0 con 0x7fad7c0039d0 2024-08-17T02:25:25.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.831+0000 7fad93e00640 1 -- 172.21.15.45:0/1847641338 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c02bb70 con 0x7fad7c0039d0 2024-08-17T02:25:25.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.831+0000 7fa288c00640 1 Processor -- start 2024-08-17T02:25:25.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.831+0000 7fa288c00640 1 -- start start 2024-08-17T02:25:25.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.831+0000 7f798a800640 1 Processor -- start 2024-08-17T02:25:25.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.832+0000 7fad9ac00640 1 -- 172.21.15.45:0/1847641338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fad7c0039d0 msgr2=0x7fad7c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.832+0000 7fad9ac00640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fad7c0039d0 0x7fad7c003da0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00aa50 tx=0x7fad8c00a060 comp rx=0 tx=0).stop 2024-08-17T02:25:25.837 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.832+0000 7fad9ac00640 1 -- 172.21.15.45:0/1847641338 shutdown_connections 2024-08-17T02:25:25.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.832+0000 7f798a800640 1 -- start start 2024-08-17T02:25:25.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.832+0000 7fad9ac00640 1 --2- 172.21.15.45:0/1847641338 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fad7c0039d0 0x7fad7c003da0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.832+0000 7fad9ac00640 1 -- 172.21.15.45:0/1847641338 >> 172.21.15.45:0/1847641338 conn(0x7fad94098e30 msgr2=0x7fad9406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.838 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7fad9ac00640 1 -- 172.21.15.45:0/1847641338 shutdown_connections 2024-08-17T02:25:25.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7f5f6a800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5f64159060 0x7f5f640c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7f5f6a800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f640c6a30 0x7f5f640d08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7f5f6a800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f640cbf40 con 0x7f5f64159430 2024-08-17T02:25:25.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7f5f6a800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f640cb930 con 0x7f5f640c6a30 2024-08-17T02:25:25.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7f5f6a800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f640ced10 con 0x7f5f64159060 2024-08-17T02:25:25.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7fad9ac00640 1 -- 172.21.15.45:0/1847641338 wait complete. 2024-08-17T02:25:25.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7fa288c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2840ca8a0 0x7fa2840c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7fa288c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2840ccad0 0x7fa28416f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7f5f63400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5f64159060 0x7f5f640c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7f5f63e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5f64159430 0x7f5f640cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33438/0 (socket says 172.21.15.45:33438) 2024-08-17T02:25:25.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7f5f63e00640 1 -- 172.21.15.45:0/487694332 learned_addr learned my addr 172.21.15.45:0/487694332 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:25.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7f5f62a00640 1 --2- 172.21.15.45:0/487694332 >> v2:172.21.15.45:3300/0 conn(0x7f5f640c6a30 0x7f5f640d08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7f798a800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f79840c6a30 0x7f79840cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7f798a800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79840cbf40 con 0x7f7984159060 2024-08-17T02:25:25.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7f798a800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79840cb930 con 0x7f7984159430 2024-08-17T02:25:25.841 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7f798a800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79840ced10 con 0x7f79840c6a30 2024-08-17T02:25:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7fa288c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa284159ca0 0x7fa28416f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7f9566800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9560157b10 0x7f95600ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7f9566800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f956006d7f0 0x7f956006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7f9566800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956006e190 con 0x7f95600adf10 2024-08-17T02:25:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7f9566800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95600b0350 con 0x7f9560157b10 2024-08-17T02:25:25.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.833+0000 7f9566800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95600ae2e0 con 0x7f956006d7f0 2024-08-17T02:25:25.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.835+0000 7f5f62a00640 1 -- 172.21.15.45:0/487694332 >> v2:172.21.15.169:3300/0 conn(0x7f5f64159060 msgr2=0x7f5f640c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.835+0000 7f5f62a00640 1 --2- 172.21.15.45:0/487694332 >> v2:172.21.15.169:3300/0 conn(0x7f5f64159060 0x7f5f640c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.835+0000 7f5f62a00640 1 -- 172.21.15.45:0/487694332 >> v1:172.21.15.45:6789/0 conn(0x7f5f64159430 legacy=0x7f5f640cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.835+0000 7fa283400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2840ca8a0 0x7fa2840c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7fa282a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2840ccad0 0x7fa28416f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.835+0000 7f5f62a00640 1 -- 172.21.15.45:0/487694332 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f640cbbd0 con 0x7f5f640c6a30 2024-08-17T02:25:25.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7fa288c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28406a180 con 0x7fa2840ccad0 2024-08-17T02:25:25.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7fa288c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa284176a00 con 0x7fa2840ca8a0 2024-08-17T02:25:25.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7fa288c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2840c5740 con 0x7fa284159ca0 2024-08-17T02:25:25.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7fad9ac00640 1 Processor -- start 2024-08-17T02:25:25.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7fa282a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2840ccad0 0x7fa28416f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57134/0 (socket says 172.21.15.45:57134) 2024-08-17T02:25:25.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7fa282a00640 1 -- 172.21.15.45:0/265155223 learned_addr learned my addr 172.21.15.45:0/265155223 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7fa283e00640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa284159ca0 0x7fa28416f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7f7983400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7984159060 0x7f79840cabc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33444/0 (socket says 172.21.15.45:33444) 2024-08-17T02:25:25.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.834+0000 7f7983400640 1 -- 172.21.15.45:0/904544725 learned_addr learned my addr 172.21.15.45:0/904544725 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:25.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.835+0000 7f797aa00640 1 --2- 172.21.15.45:0/904544725 >> v2:172.21.15.169:3300/0 conn(0x7f79840c6a30 0x7f79840cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.835+0000 7f7982a00640 1 -- 172.21.15.45:0/904544725 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246321307 0 0) 0x7f79840cb930 con 0x7f7984159430 2024-08-17T02:25:25.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.835+0000 7f7982a00640 1 -- 172.21.15.45:0/904544725 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79680034e0 con 0x7f7984159430 2024-08-17T02:25:25.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.835+0000 7f797aa00640 1 -- 172.21.15.45:0/904544725 >> v1:172.21.15.169:6789/0 conn(0x7f7984159430 legacy=0x7f79840c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.835+0000 7f797aa00640 1 -- 172.21.15.45:0/904544725 >> v1:172.21.15.45:6789/0 conn(0x7f7984159060 legacy=0x7f79840cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7f797aa00640 1 -- 172.21.15.45:0/904544725 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840cbbd0 con 0x7f79840c6a30 2024-08-17T02:25:25.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7fad9ac00640 1 -- start start 2024-08-17T02:25:25.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7f955f400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95600adf10 0x7f9560155a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33454/0 (socket says 172.21.15.45:33454) 2024-08-17T02:25:25.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.836+0000 7f955ea00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9560157b10 0x7f95600ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.837+0000 7f955fe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f956006d7f0 0x7f956006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.837+0000 7f955ea00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9560157b10 0x7f95600ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57150/0 (socket says 172.21.15.45:57150) 2024-08-17T02:25:25.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.837+0000 7f955ea00640 1 -- 172.21.15.45:0/1911726197 learned_addr learned my addr 172.21.15.45:0/1911726197 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.837+0000 7f5f62a00640 1 --2- 172.21.15.45:0/487694332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f640c6a30 0x7f5f640d08f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5f64065ea0 tx=0x7f5f500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db47d0d722b751e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7f8307600640 1 Processor -- start 2024-08-17T02:25:25.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7fa282a00640 1 -- 172.21.15.45:0/265155223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa284159ca0 msgr2=0x7fa28416f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7fa282a00640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa284159ca0 0x7fa28416f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7fa282a00640 1 -- 172.21.15.45:0/265155223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2840ca8a0 msgr2=0x7fa2840c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7fa282a00640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2840ca8a0 0x7fa2840c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7fa282a00640 1 -- 172.21.15.45:0/265155223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa27c009a20 con 0x7fa2840ccad0 2024-08-17T02:25:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7f797aa00640 1 --2- 172.21.15.45:0/904544725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79840c6a30 0x7f79840cb2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7974009850 tx=0x7f79740090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb9f7a1f379aedc9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7f5f62000640 1 -- 172.21.15.45:0/487694332 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5002ad20 con 0x7f5f640c6a30 2024-08-17T02:25:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7f5f62000640 1 -- 172.21.15.45:0/487694332 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5002ae80 con 0x7f5f640c6a30 2024-08-17T02:25:25.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7f5f62000640 1 -- 172.21.15.45:0/487694332 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50032670 con 0x7f5f640c6a30 2024-08-17T02:25:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7f7982a00640 1 -- 172.21.15.45:0/904544725 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797402adb0 con 0x7f79840c6a30 2024-08-17T02:25:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7f7982a00640 1 -- 172.21.15.45:0/904544725 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974032440 con 0x7f79840c6a30 2024-08-17T02:25:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7f7982a00640 1 -- 172.21.15.45:0/904544725 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974032820 con 0x7f79840c6a30 2024-08-17T02:25:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7fad9ac00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad7c0039d0 0x7fad941557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7f798a800640 1 -- 172.21.15.45:0/904544725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79840c6a30 msgr2=0x7f79840cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7f798a800640 1 --2- 172.21.15.45:0/904544725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79840c6a30 0x7f79840cb2d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7974009850 tx=0x7f79740090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7fa282a00640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2840ccad0 0x7fa28416f1c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa270035040 tx=0x7fa270032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7fad9ac00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad940b3770 0x7fad940c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7fad9ac00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fad940b3ba0 0x7fad940c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.838+0000 7f8307600640 1 -- start start 2024-08-17T02:25:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad9ac00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94156240 con 0x7fad940b3770 2024-08-17T02:25:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7f5f6a800640 1 -- 172.21.15.45:0/487694332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f640c6a30 msgr2=0x7f5f640d08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7f5f6a800640 1 --2- 172.21.15.45:0/487694332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f640c6a30 0x7f5f640d08f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5f64065ea0 tx=0x7f5f500090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad9ac00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940c5740 con 0x7fad7c0039d0 2024-08-17T02:25:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad9ac00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad940b0a10 con 0x7fad940b3ba0 2024-08-17T02:25:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad98e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad940b3770 0x7fad940c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7f5f6a800640 1 -- 172.21.15.45:0/487694332 shutdown_connections 2024-08-17T02:25:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7f5f6a800640 1 --2- 172.21.15.45:0/487694332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f640c6a30 0x7f5f640d08f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7f5f6a800640 1 --2- 172.21.15.45:0/487694332 >> v2:172.21.15.169:3300/0 conn(0x7f5f64159060 0x7f5f640c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7f5f6a800640 1 -- 172.21.15.45:0/487694332 >> 172.21.15.45:0/487694332 conn(0x7f5f640cfde0 msgr2=0x7f5f640d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad98e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad940b3770 0x7fad940c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57162/0 (socket says 172.21.15.45:57162) 2024-08-17T02:25:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7f8307600640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f830015d830 0x7f830006e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7f8307600640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83000b1690 con 0x7f83000b0610 2024-08-17T02:25:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7f8307600640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83000ae4a0 con 0x7f830015e310 2024-08-17T02:25:25.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7f8307600640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83000b1b20 con 0x7f830015d830 2024-08-17T02:25:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad98e00640 1 -- 172.21.15.45:0/2811591951 learned_addr learned my addr 172.21.15.45:0/2811591951 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad99800640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad7c0039d0 0x7fad941557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad98e00640 1 -- 172.21.15.45:0/2811591951 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fad940b3ba0 msgr2=0x7fad940c4b20 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:25:25.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad98e00640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fad940b3ba0 0x7fad940c4b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad98e00640 1 -- 172.21.15.45:0/2811591951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad7c0039d0 msgr2=0x7fad941557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad98e00640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad7c0039d0 0x7fad941557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fad98e00640 1 -- 172.21.15.45:0/2811591951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad94155ce0 con 0x7fad940b3770 2024-08-17T02:25:25.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.840+0000 7fa27aa00640 1 -- 172.21.15.45:0/265155223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270000d10 con 0x7fa2840ccad0 2024-08-17T02:25:25.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7fa27aa00640 1 -- 172.21.15.45:0/265155223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa270031a60 con 0x7fa2840ccad0 2024-08-17T02:25:25.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7f5f6a800640 1 -- 172.21.15.45:0/487694332 shutdown_connections 2024-08-17T02:25:25.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7f798a800640 1 -- 172.21.15.45:0/904544725 shutdown_connections 2024-08-17T02:25:25.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7f798a800640 1 --2- 172.21.15.45:0/904544725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79840c6a30 0x7f79840cb2d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7f798a800640 1 -- 172.21.15.45:0/904544725 >> 172.21.15.45:0/904544725 conn(0x7f79840cfde0 msgr2=0x7f79840d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7fa27aa00640 1 -- 172.21.15.45:0/265155223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa270031e60 con 0x7fa2840ccad0 2024-08-17T02:25:25.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7fa288c00640 1 -- 172.21.15.45:0/265155223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa270009450 con 0x7fa2840ccad0 2024-08-17T02:25:25.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7fa288c00640 1 -- 172.21.15.45:0/265155223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2840c5d00 con 0x7fa2840ccad0 2024-08-17T02:25:25.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7f955fe00640 1 -- 172.21.15.45:0/1911726197 >> v2:172.21.15.45:3300/0 conn(0x7f9560157b10 msgr2=0x7f95600ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7f955fe00640 1 --2- 172.21.15.45:0/1911726197 >> v2:172.21.15.45:3300/0 conn(0x7f9560157b10 0x7f95600ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7f955fe00640 1 -- 172.21.15.45:0/1911726197 >> v1:172.21.15.45:6789/0 conn(0x7f95600adf10 legacy=0x7f9560155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.839+0000 7f955fe00640 1 -- 172.21.15.45:0/1911726197 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9560156670 con 0x7f956006d7f0 2024-08-17T02:25:25.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7f82f7e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f83000b0610 0x7f830015dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33460/0 (socket says 172.21.15.45:33460) 2024-08-17T02:25:25.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7f82f7e00640 1 -- 172.21.15.45:0/2179134112 learned_addr learned my addr 172.21.15.45:0/2179134112 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:25.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7f5f6a800640 1 -- 172.21.15.45:0/487694332 wait complete. 2024-08-17T02:25:25.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7fad98e00640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad940b3770 0x7fad940c45e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad8800f8e0 tx=0x7fad88007c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7f798a800640 1 -- 172.21.15.45:0/904544725 shutdown_connections 2024-08-17T02:25:25.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7f8304c00640 1 --2- 172.21.15.45:0/2179134112 >> v2:172.21.15.169:3300/0 conn(0x7f830015d830 0x7f830006e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7f798a800640 1 -- 172.21.15.45:0/904544725 wait complete. 2024-08-17T02:25:25.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.841+0000 7f454d200640 1 Processor -- start 2024-08-17T02:25:25.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.842+0000 7f955fe00640 1 --2- 172.21.15.45:0/1911726197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f956006d7f0 0x7f956006dc50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f956006aa40 tx=0x7f9558009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a710e1836e4a3312 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.861 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.842+0000 7f955e000640 1 -- 172.21.15.45:0/1911726197 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558007550 con 0x7f956006d7f0 2024-08-17T02:25:25.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.842+0000 7f955e000640 1 -- 172.21.15.45:0/1911726197 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955802d050 con 0x7f956006d7f0 2024-08-17T02:25:25.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.842+0000 7f955e000640 1 -- 172.21.15.45:0/1911726197 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558007920 con 0x7f956006d7f0 2024-08-17T02:25:25.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.842+0000 7f454d200640 1 -- start start 2024-08-17T02:25:25.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.843+0000 7f9566800640 1 -- 172.21.15.45:0/1911726197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f956006d7f0 msgr2=0x7f956006dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.862 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.843+0000 7f9566800640 1 --2- 172.21.15.45:0/1911726197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f956006d7f0 0x7f956006dc50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f956006aa40 tx=0x7f9558009780 comp rx=0 tx=0).stop 2024-08-17T02:25:25.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.843+0000 7f798a800640 1 Processor -- start 2024-08-17T02:25:25.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.843+0000 7f9566800640 1 -- 172.21.15.45:0/1911726197 shutdown_connections 2024-08-17T02:25:25.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.843+0000 7f9566800640 1 --2- 172.21.15.45:0/1911726197 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f956006d7f0 0x7f956006dc50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.843+0000 7f9566800640 1 --2- 172.21.15.45:0/1911726197 >> v2:172.21.15.45:3300/0 conn(0x7f9560157b10 0x7f95600ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.843+0000 7f9566800640 1 -- 172.21.15.45:0/1911726197 >> 172.21.15.45:0/1911726197 conn(0x7f95600cb9b0 msgr2=0x7f95600cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.863 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.843+0000 7f5f6a800640 1 Processor -- start 2024-08-17T02:25:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.844+0000 7f9566800640 1 -- 172.21.15.45:0/1911726197 shutdown_connections 2024-08-17T02:25:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.844+0000 7f5f6a800640 1 -- start start 2024-08-17T02:25:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.844+0000 7f798a800640 1 -- start start 2024-08-17T02:25:25.864 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.844+0000 7f454d200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f454815d830 0x7f454806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.844+0000 7f9566800640 1 -- 172.21.15.45:0/1911726197 wait complete. 2024-08-17T02:25:25.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.842+0000 7f8304c00640 1 -- 172.21.15.45:0/2179134112 >> v1:172.21.15.169:6789/0 conn(0x7f830015e310 legacy=0x7f8300166e50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-17T02:25:25.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.842+0000 7f8304c00640 1 -- 172.21.15.45:0/2179134112 >> v1:172.21.15.45:6789/0 conn(0x7f83000b0610 legacy=0x7f830015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.842+0000 7f8304c00640 1 -- 172.21.15.45:0/2179134112 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f830015b200 con 0x7f830015d830 2024-08-17T02:25:25.865 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.844+0000 7f454d200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45480b1690 con 0x7f45480b0610 2024-08-17T02:25:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.844+0000 7f454d200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45480ae4a0 con 0x7f454815e310 2024-08-17T02:25:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.844+0000 7f454d200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45480b1b20 con 0x7f454815d830 2024-08-17T02:25:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.844+0000 7fad90c00640 1 -- 172.21.15.45:0/2811591951 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88002260 con 0x7fad940b3770 2024-08-17T02:25:25.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.845+0000 7f8304c00640 1 --2- 172.21.15.45:0/2179134112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f830015d830 0x7f830006e1b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009e60 tx=0x7f82f0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9036ec88caecda13 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.845+0000 7f82ffe00640 1 -- 172.21.15.45:0/2179134112 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0007550 con 0x7f830015d830 2024-08-17T02:25:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.845+0000 7f82ffe00640 1 -- 172.21.15.45:0/2179134112 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f002d050 con 0x7f830015d830 2024-08-17T02:25:25.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.845+0000 7f82ffe00640 1 -- 172.21.15.45:0/2179134112 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f0007920 con 0x7f830015d830 2024-08-17T02:25:25.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.845+0000 7f4546800640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f454815e310 0x7f4548166e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:50522/0 (socket says 172.21.15.45:50522) 2024-08-17T02:25:25.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.845+0000 7f4546800640 1 -- 172.21.15.45:0/459949360 learned_addr learned my addr 172.21.15.45:0/459949360 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:25.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f4545e00640 1 --2- 172.21.15.45:0/459949360 >> v2:172.21.15.169:3300/0 conn(0x7f454815d830 0x7f454806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f798a800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79840c6a30 0x7f79840b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f798a800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7984159060 0x7f798409a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f798a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7984159430 0x7f798409adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f798a800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840c8540 con 0x7f7984159430 2024-08-17T02:25:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f798a800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798409d620 con 0x7f79840c6a30 2024-08-17T02:25:25.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f798a800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798409ca10 con 0x7f7984159060 2024-08-17T02:25:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f9566800640 1 Processor -- start 2024-08-17T02:25:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f9566800640 1 -- start start 2024-08-17T02:25:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f5f6a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f640c6a30 0x7f5f64157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f5f6a800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f64159060 0x7f5f6406c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f5f6a800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f64159430 0x7f5f6406cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f7983400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79840c6a30 0x7f79840b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f797aa00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7984159060 0x7f798409a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f4545e00640 1 -- 172.21.15.45:0/459949360 >> v1:172.21.15.169:6789/0 conn(0x7f454815e310 legacy=0x7f4548166e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f4545e00640 1 -- 172.21.15.45:0/459949360 >> v1:172.21.15.45:6789/0 conn(0x7f45480b0610 legacy=0x7f454815dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f5f6a800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f64069ff0 con 0x7f5f640c6a30 2024-08-17T02:25:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f5f6a800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6406a890 con 0x7f5f64159430 2024-08-17T02:25:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f5f6a800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f640b5340 con 0x7f5f64159060 2024-08-17T02:25:25.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.846+0000 7f797aa00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7984159060 0x7f798409a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:58504/0 (socket says 172.21.15.45:58504) 2024-08-17T02:25:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f7983400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79840c6a30 0x7f79840b47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38476/0 (socket says 172.21.15.45:38476) 2024-08-17T02:25:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f797aa00640 1 -- 172.21.15.45:0/2280164183 learned_addr learned my addr 172.21.15.45:0/2280164183 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.845+0000 7fad90c00640 1 -- 172.21.15.45:0/2811591951 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad880023c0 con 0x7fad940b3770 2024-08-17T02:25:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.845+0000 7fad90c00640 1 -- 172.21.15.45:0/2811591951 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88002530 con 0x7fad940b3770 2024-08-17T02:25:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.845+0000 7fad9ac00640 1 -- 172.21.15.45:0/2811591951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad940c5180 con 0x7fad940b3770 2024-08-17T02:25:25.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.845+0000 7fad9ac00640 1 -- 172.21.15.45:0/2811591951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad940b06a0 con 0x7fad940b3770 2024-08-17T02:25:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.845+0000 7fa288c00640 1 -- 172.21.15.45:0/265155223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2841767d0 con 0x7fa2840ccad0 2024-08-17T02:25:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f5f63e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f64159430 0x7f5f6406cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f5f63e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f64159430 0x7f5f6406cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38484/0 (socket says 172.21.15.45:38484) 2024-08-17T02:25:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f5f63e00640 1 -- 172.21.15.45:0/75675595 learned_addr learned my addr 172.21.15.45:0/75675595 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f5f63400640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f640c6a30 0x7f5f64157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f5f62a00640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f64159060 0x7f5f6406c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f7983e00640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7984159430 0x7f798409adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f9566800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f956006d7f0 0x7f95601422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f9566800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95600adf10 0x7f95600a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f9566800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9560157b10 0x7f9560068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f9566800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600a6a60 con 0x7f95600adf10 2024-08-17T02:25:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f9566800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95600a5e80 con 0x7f9560157b10 2024-08-17T02:25:25.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f9566800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95600a6130 con 0x7f956006d7f0 2024-08-17T02:25:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f5f63e00640 1 -- 172.21.15.45:0/75675595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f64159060 msgr2=0x7f5f6406c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7f4545e00640 1 -- 172.21.15.45:0/459949360 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454815b200 con 0x7f454815d830 2024-08-17T02:25:25.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.847+0000 7f5f63e00640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f64159060 0x7f5f6406c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7f955f400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f956006d7f0 0x7f95601422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7f955f400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f956006d7f0 0x7f95601422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:58518/0 (socket says 172.21.15.45:58518) 2024-08-17T02:25:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7f955f400640 1 -- 172.21.15.45:0/1500641673 learned_addr learned my addr 172.21.15.45:0/1500641673 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7f5f63e00640 1 -- 172.21.15.45:0/75675595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f640c6a30 msgr2=0x7f5f64157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7f955fe00640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9560157b10 0x7f9560068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7fad9ac00640 1 -- 172.21.15.45:0/2811591951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad940b0500 con 0x7fad940b3770 2024-08-17T02:25:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7f8307600640 1 -- 172.21.15.45:0/2179134112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f830015d830 msgr2=0x7f830006e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7f8307600640 1 --2- 172.21.15.45:0/2179134112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f830015d830 0x7f830006e1b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009e60 tx=0x7f82f0009780 comp rx=0 tx=0).stop 2024-08-17T02:25:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7f5f63e00640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f640c6a30 0x7f5f64157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7f5f63e00640 1 -- 172.21.15.45:0/75675595 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f50009390 con 0x7f5f64159430 2024-08-17T02:25:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f8307600640 1 -- 172.21.15.45:0/2179134112 shutdown_connections 2024-08-17T02:25:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f8307600640 1 --2- 172.21.15.45:0/2179134112 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f830015d830 0x7f830006e1b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f8307600640 1 -- 172.21.15.45:0/2179134112 >> 172.21.15.45:0/2179134112 conn(0x7f83000cb9b0 msgr2=0x7f83000cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f955f400640 1 -- 172.21.15.45:0/1500641673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9560157b10 msgr2=0x7f9560068960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f955f400640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9560157b10 0x7f9560068960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f955f400640 1 -- 172.21.15.45:0/1500641673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95600adf10 msgr2=0x7f95600a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f955f400640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95600adf10 0x7f95600a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f8307600640 1 -- 172.21.15.45:0/2179134112 shutdown_connections 2024-08-17T02:25:25.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f955f400640 1 -- 172.21.15.45:0/1500641673 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9558009a20 con 0x7f956006d7f0 2024-08-17T02:25:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f797aa00640 1 -- 172.21.15.45:0/2280164183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79840c6a30 msgr2=0x7f79840b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f797aa00640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79840c6a30 0x7f79840b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f797aa00640 1 -- 172.21.15.45:0/2280164183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7984159430 msgr2=0x7f798409adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f797aa00640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7984159430 0x7f798409adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f797aa00640 1 -- 172.21.15.45:0/2280164183 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7974009390 con 0x7f7984159060 2024-08-17T02:25:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f7983400640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79840c6a30 0x7f79840b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:25.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f8307600640 1 -- 172.21.15.45:0/2179134112 wait complete. 2024-08-17T02:25:25.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f5f63e00640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f64159430 0x7f5f6406cca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00cc70 tx=0x7f5f5c0019e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f797aa00640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7984159060 0x7f798409a870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7974009850 tx=0x7f7974032000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7f955f400640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f956006d7f0 0x7f95601422a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f955000c590 tx=0x7f9550007ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.848+0000 7fa27aa00640 1 -- 172.21.15.45:0/265155223 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa27003e660 con 0x7fa2840ccad0 2024-08-17T02:25:25.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7fa27aa00640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa264065220 0x7fa2640676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.849+0000 7fa27aa00640 1 -- 172.21.15.45:0/265155223 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa2700a2790 con 0x7fa2840ccad0 2024-08-17T02:25:25.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f4545e00640 1 --2- 172.21.15.45:0/459949360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f454815d830 0x7f454806e1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4540009e60 tx=0x7f4540009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1c63d3454a358d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f5f5aa00640 1 -- 172.21.15.45:0/75675595 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00ce30 con 0x7f5f64159430 2024-08-17T02:25:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f9556a00640 1 -- 172.21.15.45:0/1500641673 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550007300 con 0x7f956006d7f0 2024-08-17T02:25:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f9556a00640 1 -- 172.21.15.45:0/1500641673 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9550007460 con 0x7f956006d7f0 2024-08-17T02:25:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f9556a00640 1 -- 172.21.15.45:0/1500641673 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95500047a0 con 0x7f956006d7f0 2024-08-17T02:25:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f9566800640 1 -- 172.21.15.45:0/1500641673 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95600a6410 con 0x7f956006d7f0 2024-08-17T02:25:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f9566800640 1 -- 172.21.15.45:0/1500641673 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95600a94f0 con 0x7f956006d7f0 2024-08-17T02:25:25.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.851+0000 7f8307600640 1 Processor -- start 2024-08-17T02:25:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.851+0000 7f4544a00640 1 -- 172.21.15.45:0/459949360 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540007550 con 0x7f454815d830 2024-08-17T02:25:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.851+0000 7f4544a00640 1 -- 172.21.15.45:0/459949360 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454002d050 con 0x7f454815d830 2024-08-17T02:25:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.851+0000 7f5f5aa00640 1 -- 172.21.15.45:0/75675595 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c00a850 con 0x7f5f64159430 2024-08-17T02:25:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.851+0000 7f5f5aa00640 1 -- 172.21.15.45:0/75675595 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c00ac10 con 0x7f5f64159430 2024-08-17T02:25:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.851+0000 7f5f6a800640 1 -- 172.21.15.45:0/75675595 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6406a240 con 0x7f5f64159430 2024-08-17T02:25:25.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.852+0000 7fa283400640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa264065220 0x7fa2640676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.852+0000 7f8307600640 1 -- start start 2024-08-17T02:25:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f797b400640 1 -- 172.21.15.45:0/2280164183 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974000d10 con 0x7f7984159060 2024-08-17T02:25:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f797b400640 1 -- 172.21.15.45:0/2280164183 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974031e00 con 0x7f7984159060 2024-08-17T02:25:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f797b400640 1 -- 172.21.15.45:0/2280164183 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797403d650 con 0x7f7984159060 2024-08-17T02:25:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f798a800640 1 -- 172.21.15.45:0/2280164183 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798409ccf0 con 0x7f7984159060 2024-08-17T02:25:25.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.850+0000 7f798a800640 1 -- 172.21.15.45:0/2280164183 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f798409d2b0 con 0x7f7984159060 2024-08-17T02:25:25.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.852+0000 7f4544a00640 1 -- 172.21.15.45:0/459949360 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540007900 con 0x7f454815d830 2024-08-17T02:25:25.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.852+0000 7f454d200640 1 -- 172.21.15.45:0/459949360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f454815d830 msgr2=0x7f454806e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.852+0000 7f454d200640 1 --2- 172.21.15.45:0/459949360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f454815d830 0x7f454806e1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4540009e60 tx=0x7f4540009780 comp rx=0 tx=0).stop 2024-08-17T02:25:25.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.852+0000 7f5f6a800640 1 -- 172.21.15.45:0/75675595 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f64157e80 con 0x7f5f64159430 2024-08-17T02:25:25.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.852+0000 7f9566800640 1 -- 172.21.15.45:0/1500641673 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9560064db0 con 0x7f956006d7f0 2024-08-17T02:25:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.853+0000 7f454d200640 1 -- 172.21.15.45:0/459949360 shutdown_connections 2024-08-17T02:25:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.853+0000 7f454d200640 1 --2- 172.21.15.45:0/459949360 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f454815d830 0x7f454806e1b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.853+0000 7f454d200640 1 -- 172.21.15.45:0/459949360 >> 172.21.15.45:0/459949360 conn(0x7f45480cb9b0 msgr2=0x7f45480cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.853+0000 7f454d200640 1 -- 172.21.15.45:0/459949360 shutdown_connections 2024-08-17T02:25:25.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.853+0000 7f454d200640 1 -- 172.21.15.45:0/459949360 wait complete. 2024-08-17T02:25:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.853+0000 7f8307600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83000b0610 0x7f8300153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.853+0000 7f8307600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830015d830 0x7f8300159940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.854+0000 7f8307600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f830015e310 0x7f8300159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.854+0000 7f8307600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83000ad260 con 0x7f830015d830 2024-08-17T02:25:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.854+0000 7f8307600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8300154820 con 0x7f830015e310 2024-08-17T02:25:25.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.854+0000 7f8307600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8300154b00 con 0x7f83000b0610 2024-08-17T02:25:25.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.853+0000 7fa61b600640 1 Processor -- start 2024-08-17T02:25:25.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.853+0000 7fa61b600640 1 -- start start 2024-08-17T02:25:25.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.854+0000 7f8305600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f830015e310 0x7f8300159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.854+0000 7f8305600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f830015e310 0x7f8300159e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38504/0 (socket says 172.21.15.45:38504) 2024-08-17T02:25:25.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.854+0000 7f8305600640 1 -- 172.21.15.45:0/1153481460 learned_addr learned my addr 172.21.15.45:0/1153481460 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.854+0000 7f9556a00640 1 -- 172.21.15.45:0/1500641673 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9550004bb0 con 0x7f956006d7f0 2024-08-17T02:25:25.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.854+0000 7f82f7e00640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830015d830 0x7f8300159940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.854+0000 7f5f6a800640 1 -- 172.21.15.45:0/75675595 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6406a6c0 con 0x7f5f64159430 2024-08-17T02:25:25.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7f8304c00640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83000b0610 0x7f8300153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7fa283400640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa264065220 0x7fa2640676d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa28406b330 tx=0x7fa274008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7f798a800640 1 -- 172.21.15.45:0/2280164183 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795c005210 con 0x7f7984159060 2024-08-17T02:25:25.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7f5f5aa00640 1 -- 172.21.15.45:0/75675595 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5f5c0070f0 con 0x7f5f64159430 2024-08-17T02:25:25.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7f8305600640 1 -- 172.21.15.45:0/1153481460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83000b0610 msgr2=0x7f8300153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7f9556a00640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9540065220 0x7f95400676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7fa61b600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa61415d440 0x7fa6140cabc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7fa61b600640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa6140ac890 0x7fa6140cb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7fa61b600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa6140d0980 0x7fa6140c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7f9556a00640 1 -- 172.21.15.45:0/1500641673 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9550081780 con 0x7f956006d7f0 2024-08-17T02:25:25.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7f8305600640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83000b0610 0x7f8300153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7f8305600640 1 -- 172.21.15.45:0/1153481460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830015d830 msgr2=0x7f8300159940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7f8305600640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830015d830 0x7f8300159940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7f8305600640 1 -- 172.21.15.45:0/1153481460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0009a20 con 0x7f830015e310 2024-08-17T02:25:25.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7f8305600640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f830015e310 0x7f8300159e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82f800b490 tx=0x7f82f8006f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.855+0000 7f454d200640 1 Processor -- start 2024-08-17T02:25:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7f454d200640 1 -- start start 2024-08-17T02:25:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7fa613e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa6140ac890 0x7fa6140cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7fa619600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa6140d0980 0x7fa6140c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7fa613e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa6140ac890 0x7fa6140cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38516/0 (socket says 172.21.15.45:38516) 2024-08-17T02:25:25.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7fa613e00640 1 -- 172.21.15.45:0/2295626076 learned_addr learned my addr 172.21.15.45:0/2295626076 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7f5f5aa00640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5f440652a0 0x7f5f44067750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7fa618c00640 1 --2- 172.21.15.45:0/2295626076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa61415d440 0x7fa6140cabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7f5f5aa00640 1 -- 172.21.15.45:0/75675595 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5f5c0824e0 con 0x7f5f64159430 2024-08-17T02:25:25.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7f955ea00640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9540065220 0x7f95400676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7fa61b600640 1 -- 172.21.15.45:0/2295626076 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6140cb640 con 0x7fa6140d0980 2024-08-17T02:25:25.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7fad90c00640 1 -- 172.21.15.45:0/2811591951 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fad880019e0 con 0x7fad940b3770 2024-08-17T02:25:25.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7fa61b600640 1 -- 172.21.15.45:0/2295626076 --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6140c4d20 con 0x7fa6140ac890 2024-08-17T02:25:25.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.856+0000 7fa61b600640 1 -- 172.21.15.45:0/2295626076 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6140c5000 con 0x7fa61415d440 2024-08-17T02:25:25.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7fa613e00640 1 -- 172.21.15.45:0/2295626076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa61415d440 msgr2=0x7fa6140cabc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7fa613e00640 1 --2- 172.21.15.45:0/2295626076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa61415d440 0x7fa6140cabc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7fa613e00640 1 -- 172.21.15.45:0/2295626076 >> v2:172.21.15.45:3300/0 conn(0x7fa6140d0980 msgr2=0x7fa6140c5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:25.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7fa613e00640 1 --2- 172.21.15.45:0/2295626076 >> v2:172.21.15.45:3300/0 conn(0x7fa6140d0980 0x7fa6140c5dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7fa613e00640 1 -- 172.21.15.45:0/2295626076 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6140c52e0 con 0x7fa6140ac890 2024-08-17T02:25:25.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7f454d200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45480b0610 0x7f454816d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7f454d200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f454815d830 0x7f45480aaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7f454d200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f454815e310 0x7f45480aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7f454d200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45480a6eb0 con 0x7f454815e310 2024-08-17T02:25:25.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7f454d200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45480a87c0 con 0x7f454815d830 2024-08-17T02:25:25.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.857+0000 7f454d200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45480a6bd0 con 0x7f45480b0610 2024-08-17T02:25:25.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.858+0000 7f5f63400640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5f440652a0 0x7f5f44067750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.858+0000 7fad90c00640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fad74065220 0x7fad740676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.858+0000 7f4545400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f454815d830 0x7f45480aaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.858+0000 7f4545400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f454815d830 0x7f45480aaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38530/0 (socket says 172.21.15.45:38530) 2024-08-17T02:25:25.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.858+0000 7f4545400640 1 -- 172.21.15.45:0/1766450044 learned_addr learned my addr 172.21.15.45:0/1766450044 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.858+0000 7f4545e00640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45480b0610 0x7f454816d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7fa613e00640 1 --2- 172.21.15.45:0/2295626076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6140ac890 0x7fa6140cb100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa614063830 tx=0x7fa6040091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=958009ffbc2348e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7f4546800640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f454815e310 0x7f45480aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7f4545400640 1 -- 172.21.15.45:0/1766450044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45480b0610 msgr2=0x7f454816d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7f4545400640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45480b0610 0x7f454816d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7f4545400640 1 -- 172.21.15.45:0/1766450044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f454815e310 msgr2=0x7f45480aafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7fad99800640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fad74065220 0x7fad740676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7f5f63400640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5f440652a0 0x7f5f44067750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009360 tx=0x7f5f54008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7f4545400640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f454815e310 0x7f45480aafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7f4545400640 1 -- 172.21.15.45:0/1766450044 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4540009a20 con 0x7f454815d830 2024-08-17T02:25:25.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7f955ea00640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9540065220 0x7f95400676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f95600b1af0 tx=0x7f954c0091d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7f4546800640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f454815e310 0x7f45480aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:25.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.859+0000 7f4545400640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f454815d830 0x7f45480aaa60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f453000c4e0 tx=0x7f4530007e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.860+0000 7fad99800640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fad74065220 0x7fad740676d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad8c033000 tx=0x7fad8c031000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.861+0000 7f9556a00640 1 -- 172.21.15.45:0/1500641673 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9550053330 con 0x7f956006d7f0 2024-08-17T02:25:25.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.861+0000 7fa613400640 1 -- 172.21.15.45:0/2295626076 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60402ae60 con 0x7fa6140ac890 2024-08-17T02:25:25.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7fa613400640 1 -- 172.21.15.45:0/2295626076 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa604032440 con 0x7fa6140ac890 2024-08-17T02:25:25.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7f82fcc00640 1 -- 172.21.15.45:0/1153481460 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f800f510 con 0x7f830015e310 2024-08-17T02:25:25.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7f8307600640 1 -- 172.21.15.45:0/1153481460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8300154de0 con 0x7f830015e310 2024-08-17T02:25:25.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7f8307600640 1 -- 172.21.15.45:0/1153481460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83001553a0 con 0x7f830015e310 2024-08-17T02:25:25.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7fa27aa00640 1 -- 172.21.15.45:0/265155223 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa2841767d0 con 0x7fa2840ccad0 2024-08-17T02:25:25.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7f453d600640 1 -- 172.21.15.45:0/1766450044 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530011590 con 0x7f454815d830 2024-08-17T02:25:25.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7f453d600640 1 -- 172.21.15.45:0/1766450044 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4530011710 con 0x7f454815d830 2024-08-17T02:25:25.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7f453d600640 1 -- 172.21.15.45:0/1766450044 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4530011ad0 con 0x7f454815d830 2024-08-17T02:25:25.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7f454d200640 1 -- 172.21.15.45:0/1766450044 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45480a8170 con 0x7f454815d830 2024-08-17T02:25:25.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7f454d200640 1 -- 172.21.15.45:0/1766450044 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454816d550 con 0x7f454815d830 2024-08-17T02:25:25.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7fa613400640 1 -- 172.21.15.45:0/2295626076 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6040327e0 con 0x7fa6140ac890 2024-08-17T02:25:25.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.861+0000 7fad90c00640 1 -- 172.21.15.45:0/2811591951 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fad88054ee0 con 0x7fad940b3770 2024-08-17T02:25:25.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.863+0000 7f82fcc00640 1 -- 172.21.15.45:0/1153481460 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f800f690 con 0x7f830015e310 2024-08-17T02:25:25.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.863+0000 7f82fcc00640 1 -- 172.21.15.45:0/1153481460 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f800fa50 con 0x7f830015e310 2024-08-17T02:25:25.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.864+0000 7f8307600640 1 -- 172.21.15.45:0/1153481460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d8005210 con 0x7f830015e310 2024-08-17T02:25:25.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.863+0000 7fa61b600640 1 -- 172.21.15.45:0/2295626076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6140ac890 msgr2=0x7fa6140cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.863+0000 7fa61b600640 1 --2- 172.21.15.45:0/2295626076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6140ac890 0x7fa6140cb100 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa614063830 tx=0x7fa6040091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.862+0000 7f5f5aa00640 1 -- 172.21.15.45:0/75675595 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5f5c050600 con 0x7f5f64159430 2024-08-17T02:25:25.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.865+0000 7fa61b600640 1 -- 172.21.15.45:0/2295626076 shutdown_connections 2024-08-17T02:25:25.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.865+0000 7fa61b600640 1 --2- 172.21.15.45:0/2295626076 >> v2:172.21.15.45:3300/0 conn(0x7fa6140d0980 0x7fa6140c5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.865+0000 7fa61b600640 1 --2- 172.21.15.45:0/2295626076 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6140ac890 0x7fa6140cb100 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.865+0000 7fa61b600640 1 --2- 172.21.15.45:0/2295626076 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa61415d440 0x7fa6140cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.865+0000 7fa61b600640 1 -- 172.21.15.45:0/2295626076 >> 172.21.15.45:0/2295626076 conn(0x7fa6140cfde0 msgr2=0x7fa6140d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:25.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.865+0000 7f797b400640 1 -- 172.21.15.45:0/2280164183 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7974039040 con 0x7f7984159060 2024-08-17T02:25:25.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.866+0000 7f453d600640 1 -- 172.21.15.45:0/1766450044 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f453001b3b0 con 0x7f454815d830 2024-08-17T02:25:25.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.866+0000 7f797b400640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f79600652d0 0x7f7960067780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.865+0000 7fa61b600640 1 -- 172.21.15.45:0/2295626076 shutdown_connections 2024-08-17T02:25:25.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.866+0000 7fa61b600640 1 -- 172.21.15.45:0/2295626076 wait complete. 2024-08-17T02:25:25.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.867+0000 7f454d200640 1 -- 172.21.15.45:0/1766450044 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4548064db0 con 0x7f454815d830 2024-08-17T02:25:25.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.867+0000 7f453d600640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4524065220 0x7f45240676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.867+0000 7f453d600640 1 -- 172.21.15.45:0/1766450044 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45300817a0 con 0x7f454815d830 2024-08-17T02:25:25.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.867+0000 7f797b400640 1 -- 172.21.15.45:0/2280164183 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f79740a2ba0 con 0x7f7984159060 2024-08-17T02:25:25.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.868+0000 7f7983400640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f79600652d0 0x7f7960067780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.868+0000 7f797b400640 1 -- 172.21.15.45:0/2280164183 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7974070650 con 0x7f7984159060 2024-08-17T02:25:25.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.869+0000 7f4545e00640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4524065220 0x7f45240676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.869+0000 7fa61b600640 1 Processor -- start 2024-08-17T02:25:25.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.868+0000 7f82fcc00640 1 -- 172.21.15.45:0/1153481460 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f82f801a400 con 0x7f830015e310 2024-08-17T02:25:25.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.869+0000 7f7983400640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f79600652d0 0x7f7960067780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f796c007fd0 tx=0x7f796c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.869+0000 7fa61b600640 1 -- start start 2024-08-17T02:25:25.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.870+0000 7f4545e00640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4524065220 0x7f45240676d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4540034000 tx=0x7f4540037000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.871+0000 7fa61b600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6140ac890 0x7fa6140c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.871+0000 7fa61b600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6140d0980 0x7fa6140c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.871+0000 7fa61b600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61415d440 0x7fa614171330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.871+0000 7fad90c00640 1 -- 172.21.15.45:0/2811591951 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fad88050b20 con 0x7fad940b3770 2024-08-17T02:25:25.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.871+0000 7f82fcc00640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82dc0651d0 0x7f82dc067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.871+0000 7f82fcc00640 1 -- 172.21.15.45:0/1153481460 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f82f8081da0 con 0x7f830015e310 2024-08-17T02:25:25.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.871+0000 7fa613e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6140d0980 0x7fa6140c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.871+0000 7fa613e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6140d0980 0x7fa6140c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38532/0 (socket says 172.21.15.45:38532) 2024-08-17T02:25:25.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.871+0000 7fa618c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6140ac890 0x7fa6140c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.871+0000 7fa618c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6140ac890 0x7fa6140c91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:58554/0 (socket says 172.21.15.45:58554) 2024-08-17T02:25:25.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.872+0000 7fa618c00640 1 -- 172.21.15.45:0/3282394117 learned_addr learned my addr 172.21.15.45:0/3282394117 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:25.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.872+0000 7fa619600640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61415d440 0x7fa614171330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.872+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61415f1a0 con 0x7fa61415d440 2024-08-17T02:25:25.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.872+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61415ffa0 con 0x7fa6140d0980 2024-08-17T02:25:25.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.872+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61415f390 con 0x7fa6140ac890 2024-08-17T02:25:25.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.872+0000 7f8304c00640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82dc0651d0 0x7f82dc067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.872+0000 7fa618c00640 1 -- 172.21.15.45:0/3282394117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6140d0980 msgr2=0x7fa6140c9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.872+0000 7fa618c00640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6140d0980 0x7fa6140c9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.872+0000 7fa618c00640 1 -- 172.21.15.45:0/3282394117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61415d440 msgr2=0x7fa614171330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.872+0000 7fa618c00640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61415d440 0x7fa614171330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.872+0000 7fa618c00640 1 -- 172.21.15.45:0/3282394117 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa604009450 con 0x7fa6140ac890 2024-08-17T02:25:25.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.873+0000 7f453d600640 1 -- 172.21.15.45:0/1766450044 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f453004f9b0 con 0x7f454815d830 2024-08-17T02:25:25.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.873+0000 7fa618c00640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6140ac890 0x7fa6140c91f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa60000d8c0 tx=0x7fa600008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.873+0000 7fa60be00640 1 -- 172.21.15.45:0/3282394117 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000de50 con 0x7fa6140ac890 2024-08-17T02:25:25.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.873+0000 7fa60be00640 1 -- 172.21.15.45:0/3282394117 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60000b8d0 con 0x7fa6140ac890 2024-08-17T02:25:25.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.873+0000 7fa60be00640 1 -- 172.21.15.45:0/3282394117 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60000bc90 con 0x7fa6140ac890 2024-08-17T02:25:25.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.873+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa61415f670 con 0x7fa6140ac890 2024-08-17T02:25:25.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.874+0000 7f8304c00640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82dc0651d0 0x7f82dc067680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f82f0034000 tx=0x7f82f0037000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:25.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.874+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa61415fc30 con 0x7fa6140ac890 2024-08-17T02:25:25.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.875+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa614063d20 con 0x7fa6140ac890 2024-08-17T02:25:25.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.878+0000 7fa60be00640 1 -- 172.21.15.45:0/3282394117 <== mon.2 v2:172.21.15.169:3301/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa600014640 con 0x7fa6140ac890 2024-08-17T02:25:25.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.879+0000 7f82fcc00640 1 -- 172.21.15.45:0/1153481460 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f82f804fef0 con 0x7f830015e310 2024-08-17T02:25:25.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.879+0000 7fa60be00640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa5f4065150 0x7fa5f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:25.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.880+0000 7fa60be00640 1 -- 172.21.15.45:0/3282394117 <== mon.2 v2:172.21.15.169:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa600083500 con 0x7fa6140ac890 2024-08-17T02:25:25.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.881+0000 7fa60be00640 1 -- 172.21.15.45:0/3282394117 <== mon.2 v2:172.21.15.169:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa600051650 con 0x7fa6140ac890 2024-08-17T02:25:25.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.882+0000 7fa613e00640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa5f4065150 0x7fa5f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:25.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:25.885+0000 7fa613e00640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa5f4065150 0x7fa5f4067600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa604034000 tx=0x7fa604032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.281+0000 7f5f6a800640 1 -- 172.21.15.45:0/75675595 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5f64063d20 con 0x7f5f64159430 2024-08-17T02:25:26.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.282+0000 7f5f5aa00640 1 -- 172.21.15.45:0/75675595 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f5c053c20 con 0x7f5f64159430 2024-08-17T02:25:26.286 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2024-08-17T02:25:26.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.286+0000 7f5f6a800640 1 -- 172.21.15.45:0/75675595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5f440652a0 msgr2=0x7f5f44067750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.285+0000 7f9566800640 1 -- 172.21.15.45:0/1500641673 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f956006e190 con 0x7f956006d7f0 2024-08-17T02:25:26.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.286+0000 7f5f6a800640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5f440652a0 0x7f5f44067750 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f54009360 tx=0x7f5f54008040 comp rx=0 tx=0).stop 2024-08-17T02:25:26.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.286+0000 7f5f6a800640 1 -- 172.21.15.45:0/75675595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f64159430 msgr2=0x7f5f6406cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.286+0000 7f5f6a800640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f64159430 0x7f5f6406cca0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c00cc70 tx=0x7f5f5c0019e0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.286+0000 7f5f6a800640 1 -- 172.21.15.45:0/75675595 shutdown_connections 2024-08-17T02:25:26.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.286+0000 7f9556a00640 1 -- 172.21.15.45:0/1500641673 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f956006e190 con 0x7f956006d7f0 2024-08-17T02:25:26.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.286+0000 7f5f6a800640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5f64159430 0x7f5f6406cca0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.286+0000 7f5f6a800640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5f440652a0 0x7f5f44067750 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.289 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2024-08-17T02:25:26.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.286+0000 7f5f6a800640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5f64159060 0x7f5f6406c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.286+0000 7f5f6a800640 1 --2- 172.21.15.45:0/75675595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f640c6a30 0x7f5f64157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.286+0000 7f5f6a800640 1 -- 172.21.15.45:0/75675595 >> 172.21.15.45:0/75675595 conn(0x7f5f640cfde0 msgr2=0x7f5f64067f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.287+0000 7f5f6a800640 1 -- 172.21.15.45:0/75675595 shutdown_connections 2024-08-17T02:25:26.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.287+0000 7f5f6a800640 1 -- 172.21.15.45:0/75675595 wait complete. 2024-08-17T02:25:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.290+0000 7f9566800640 1 -- 172.21.15.45:0/1500641673 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9540065220 msgr2=0x7f95400676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.290+0000 7f9566800640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9540065220 0x7f95400676d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f95600b1af0 tx=0x7f954c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.290+0000 7f9566800640 1 -- 172.21.15.45:0/1500641673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f956006d7f0 msgr2=0x7f95601422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.290+0000 7f9566800640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f956006d7f0 0x7f95601422a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f955000c590 tx=0x7f9550007ee0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.291+0000 7f9566800640 1 -- 172.21.15.45:0/1500641673 shutdown_connections 2024-08-17T02:25:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.291+0000 7f9566800640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9560157b10 0x7f9560068960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.291+0000 7f9566800640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95600adf10 0x7f95600a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.291+0000 7f9566800640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9540065220 0x7f95400676d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.291+0000 7f9566800640 1 --2- 172.21.15.45:0/1500641673 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f956006d7f0 0x7f95601422a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.291+0000 7f9566800640 1 -- 172.21.15.45:0/1500641673 >> 172.21.15.45:0/1500641673 conn(0x7f95600cb9b0 msgr2=0x7f9560154140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.291+0000 7fa288c00640 1 -- 172.21.15.45:0/265155223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa284176bb0 con 0x7fa2840ccad0 2024-08-17T02:25:26.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.291+0000 7f9566800640 1 -- 172.21.15.45:0/1500641673 shutdown_connections 2024-08-17T02:25:26.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.291+0000 7f9566800640 1 -- 172.21.15.45:0/1500641673 wait complete. 2024-08-17T02:25:26.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.291+0000 7f798a800640 1 -- 172.21.15.45:0/2280164183 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f795c005790 con 0x7f7984159060 2024-08-17T02:25:26.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.292+0000 7f797b400640 1 -- 172.21.15.45:0/2280164183 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7974042020 con 0x7f7984159060 2024-08-17T02:25:26.296 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2024-08-17T02:25:26.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.292+0000 7fa27aa00640 1 -- 172.21.15.45:0/265155223 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa284176bb0 con 0x7fa2840ccad0 2024-08-17T02:25:26.296 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2024-08-17T02:25:26.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7f7973e00640 1 -- 172.21.15.45:0/2280164183 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f79600652d0 msgr2=0x7f7960067780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7fa288c00640 1 -- 172.21.15.45:0/265155223 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa264065220 msgr2=0x7fa2640676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7f7973e00640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f79600652d0 0x7f7960067780 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f796c007fd0 tx=0x7f796c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:26.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7f7973e00640 1 -- 172.21.15.45:0/2280164183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7984159060 msgr2=0x7f798409a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7fa288c00640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa264065220 0x7fa2640676d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa28406b330 tx=0x7fa274008040 comp rx=0 tx=0).stop 2024-08-17T02:25:26.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7fa288c00640 1 -- 172.21.15.45:0/265155223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2840ccad0 msgr2=0x7fa28416f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7f7973e00640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7984159060 0x7f798409a870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7974009850 tx=0x7f7974032000 comp rx=0 tx=0).stop 2024-08-17T02:25:26.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7fa288c00640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2840ccad0 0x7fa28416f1c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa270035040 tx=0x7fa270032000 comp rx=0 tx=0).stop 2024-08-17T02:25:26.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7fa288c00640 1 -- 172.21.15.45:0/265155223 shutdown_connections 2024-08-17T02:25:26.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7fa288c00640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa264065220 0x7fa2640676d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.297+0000 7f7973e00640 1 -- 172.21.15.45:0/2280164183 shutdown_connections 2024-08-17T02:25:26.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.297+0000 7f7973e00640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7984159430 0x7f798409adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.297+0000 7f7973e00640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f79600652d0 0x7f7960067780 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f796c007fd0 tx=0x7f796c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:26.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.297+0000 7f7973e00640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7984159060 0x7f798409a870 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.297+0000 7f7973e00640 1 --2- 172.21.15.45:0/2280164183 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79840c6a30 0x7f79840b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.297+0000 7f7973e00640 1 -- 172.21.15.45:0/2280164183 >> 172.21.15.45:0/2280164183 conn(0x7f79840cfde0 msgr2=0x7f79840cabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7fa288c00640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa284159ca0 0x7fa28416f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7fa288c00640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa2840ccad0 0x7fa28416f1c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.297+0000 7f7973e00640 1 -- 172.21.15.45:0/2280164183 shutdown_connections 2024-08-17T02:25:26.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7fa288c00640 1 --2- 172.21.15.45:0/265155223 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa2840ca8a0 0x7fa2840c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7fa288c00640 1 -- 172.21.15.45:0/265155223 >> 172.21.15.45:0/265155223 conn(0x7fa284098e00 msgr2=0x7fa2840b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.296+0000 7fa288c00640 1 -- 172.21.15.45:0/265155223 shutdown_connections 2024-08-17T02:25:26.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.297+0000 7fa288c00640 1 -- 172.21.15.45:0/265155223 wait complete. 2024-08-17T02:25:26.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.298+0000 7f7973e00640 1 -- 172.21.15.45:0/2280164183 wait complete. 2024-08-17T02:25:26.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.300+0000 7f454d200640 1 -- 172.21.15.45:0/1766450044 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f45480a8900 con 0x7f454815d830 2024-08-17T02:25:26.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.301+0000 7f453d600640 1 -- 172.21.15.45:0/1766450044 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4530017070 con 0x7f454815d830 2024-08-17T02:25:26.303 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2024-08-17T02:25:26.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.302+0000 7fad9ac00640 1 -- 172.21.15.45:0/2811591951 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fad940b0500 con 0x7fad940b3770 2024-08-17T02:25:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.303+0000 7fad90c00640 1 -- 172.21.15.45:0/2811591951 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad940b0500 con 0x7fad940b3770 2024-08-17T02:25:26.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.303+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa614069350 con 0x7fa6140ac890 2024-08-17T02:25:26.305 INFO:teuthology.orchestra.run.smithi045.stdout:55834574856 2024-08-17T02:25:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.304+0000 7f8307600640 1 -- 172.21.15.45:0/1153481460 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f82d80054c0 con 0x7f830015e310 2024-08-17T02:25:26.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.304+0000 7fa60be00640 1 -- 172.21.15.45:0/3282394117 <== mon.2 v2:172.21.15.169:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa600054c70 con 0x7fa6140ac890 2024-08-17T02:25:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.304+0000 7f454d200640 1 -- 172.21.15.45:0/1766450044 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4524065220 msgr2=0x7f45240676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.305+0000 7f454d200640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4524065220 0x7f45240676d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4540034000 tx=0x7f4540037000 comp rx=0 tx=0).stop 2024-08-17T02:25:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.305+0000 7f454d200640 1 -- 172.21.15.45:0/1766450044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f454815d830 msgr2=0x7f45480aaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.305+0000 7f454d200640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f454815d830 0x7f45480aaa60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f453000c4e0 tx=0x7f4530007e50 comp rx=0 tx=0).stop 2024-08-17T02:25:26.306 INFO:teuthology.orchestra.run.smithi045.stdout:55834574854 2024-08-17T02:25:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.305+0000 7f454d200640 1 -- 172.21.15.45:0/1766450044 shutdown_connections 2024-08-17T02:25:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.305+0000 7f454d200640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f454815e310 0x7f45480aafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.305+0000 7f454d200640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f454815d830 0x7f45480aaa60 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f453000c4e0 tx=0x7f4530007e50 comp rx=0 tx=0).stop 2024-08-17T02:25:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.305+0000 7f454d200640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4524065220 0x7f45240676d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.305+0000 7f454d200640 1 --2- 172.21.15.45:0/1766450044 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45480b0610 0x7f454816d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.305+0000 7f454d200640 1 -- 172.21.15.45:0/1766450044 >> 172.21.15.45:0/1766450044 conn(0x7f45480cb9b0 msgr2=0x7f454815ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.305+0000 7f82fcc00640 1 -- 172.21.15.45:0/1153481460 <== mon.1 v2:172.21.15.169:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f82f8053510 con 0x7f830015e310 2024-08-17T02:25:26.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.305+0000 7f454d200640 1 -- 172.21.15.45:0/1766450044 shutdown_connections 2024-08-17T02:25:26.308 INFO:teuthology.orchestra.run.smithi045.stdout:55834574855 2024-08-17T02:25:26.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.306+0000 7f454d200640 1 -- 172.21.15.45:0/1766450044 wait complete. 2024-08-17T02:25:26.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.308+0000 7fad9ac00640 1 -- 172.21.15.45:0/2811591951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fad74065220 msgr2=0x7fad740676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.308+0000 7fad9ac00640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fad74065220 0x7fad740676d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fad8c033000 tx=0x7fad8c031000 comp rx=0 tx=0).stop 2024-08-17T02:25:26.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.308+0000 7fad9ac00640 1 -- 172.21.15.45:0/2811591951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad940b3770 msgr2=0x7fad940c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.308+0000 7fad9ac00640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad940b3770 0x7fad940c45e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fad8800f8e0 tx=0x7fad88007c40 comp rx=0 tx=0).stop 2024-08-17T02:25:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.308+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa5f4065150 msgr2=0x7fa5f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.308+0000 7fa61b600640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa5f4065150 0x7fa5f4067600 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa604034000 tx=0x7fa604032000 comp rx=0 tx=0).stop 2024-08-17T02:25:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.308+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6140ac890 msgr2=0x7fa6140c91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.308+0000 7fa61b600640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6140ac890 0x7fa6140c91f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa60000d8c0 tx=0x7fa600008040 comp rx=0 tx=0).stop 2024-08-17T02:25:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 shutdown_connections 2024-08-17T02:25:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fa61b600640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa61415d440 0x7fa614171330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fa61b600640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa6140d0980 0x7fa6140c9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fa61b600640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa5f4065150 0x7fa5f4067600 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fa61b600640 1 --2- 172.21.15.45:0/3282394117 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa6140ac890 0x7fa6140c91f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 >> 172.21.15.45:0/3282394117 conn(0x7fa6140cfde0 msgr2=0x7fa614068730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fad9ac00640 1 -- 172.21.15.45:0/2811591951 shutdown_connections 2024-08-17T02:25:26.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fad9ac00640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fad74065220 0x7fad740676d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fad9ac00640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fad940b3ba0 0x7fad940c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fad9ac00640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad940b3770 0x7fad940c45e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fad9ac00640 1 --2- 172.21.15.45:0/2811591951 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fad7c0039d0 0x7fad941557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fad9ac00640 1 -- 172.21.15.45:0/2811591951 >> 172.21.15.45:0/2811591951 conn(0x7fad94098e30 msgr2=0x7fad94068060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 shutdown_connections 2024-08-17T02:25:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7f8307600640 1 -- 172.21.15.45:0/1153481460 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82dc0651d0 msgr2=0x7f82dc067680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.309+0000 7f8307600640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82dc0651d0 0x7f82dc067680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f82f0034000 tx=0x7f82f0037000 comp rx=0 tx=0).stop 2024-08-17T02:25:26.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.310+0000 7fa61b600640 1 -- 172.21.15.45:0/3282394117 wait complete. 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.310+0000 7f8307600640 1 -- 172.21.15.45:0/1153481460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f830015e310 msgr2=0x7f8300159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.310+0000 7fad9ac00640 1 -- 172.21.15.45:0/2811591951 shutdown_connections 2024-08-17T02:25:26.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.310+0000 7fad9ac00640 1 -- 172.21.15.45:0/2811591951 wait complete. 2024-08-17T02:25:26.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.310+0000 7f8307600640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f830015e310 0x7f8300159e80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f82f800b490 tx=0x7f82f8006f70 comp rx=0 tx=0).stop 2024-08-17T02:25:26.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.310+0000 7f8307600640 1 -- 172.21.15.45:0/1153481460 shutdown_connections 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.310+0000 7f8307600640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f830015e310 0x7f8300159e80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.310+0000 7f8307600640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f830015d830 0x7f8300159940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.310+0000 7f8307600640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82dc0651d0 0x7f82dc067680 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.310+0000 7f8307600640 1 --2- 172.21.15.45:0/1153481460 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f83000b0610 0x7f8300153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.310+0000 7f8307600640 1 -- 172.21.15.45:0/1153481460 >> 172.21.15.45:0/1153481460 conn(0x7f83000cb9b0 msgr2=0x7f830006cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.311+0000 7f8307600640 1 -- 172.21.15.45:0/1153481460 shutdown_connections 2024-08-17T02:25:26.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.311+0000 7f8307600640 1 -- 172.21.15.45:0/1153481460 wait complete. 2024-08-17T02:25:26.320 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-08-17T02:25:26.320 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:26.326 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-08-17T02:25:26.326 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:26.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-08-17T02:25:26.328 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:26.329 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-08-17T02:25:26.329 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:26.332 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-08-17T02:25:26.332 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:26.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-08-17T02:25:26.336 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:26.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-08-17T02:25:26.340 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:26.340 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-08-17T02:25:26.340 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:26.341 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:25:26.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:26.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.530+0000 7ff96e800640 1 Processor -- start 2024-08-17T02:25:26.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.530+0000 7ff96e800640 1 -- start start 2024-08-17T02:25:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.531+0000 7ff96e800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff968158ad0 0x7ff9680ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.531+0000 7ff96e800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff968158ea0 0x7ff9680ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.531+0000 7ff96e800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff968067d60 con 0x7ff9680af410 2024-08-17T02:25:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.531+0000 7ff96e800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff968068600 con 0x7ff968158ea0 2024-08-17T02:25:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.531+0000 7ff96e800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680aff70 con 0x7ff968158ad0 2024-08-17T02:25:26.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.531+0000 7ff96ca00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff968158ea0 0x7ff9680ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.531+0000 7ff96de00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff9680af410 0x7ff9680af860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33480/0 (socket says 172.21.15.45:33480) 2024-08-17T02:25:26.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.531+0000 7ff96de00640 1 -- 172.21.15.45:0/1370769532 learned_addr learned my addr 172.21.15.45:0/1370769532 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:26.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.532+0000 7ff96d400640 1 --2- 172.21.15.45:0/1370769532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff968158ad0 0x7ff9680ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.532+0000 7ff967e00640 1 -- 172.21.15.45:0/1370769532 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094248054 0 0) 0x7ff968067d60 con 0x7ff9680af410 2024-08-17T02:25:26.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.532+0000 7ff96ca00640 1 -- 172.21.15.45:0/1370769532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff968158ad0 msgr2=0x7ff9680ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:26.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.532+0000 7ff96ca00640 1 --2- 172.21.15.45:0/1370769532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff968158ad0 0x7ff9680ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.532+0000 7ff96ca00640 1 -- 172.21.15.45:0/1370769532 >> v1:172.21.15.45:6789/0 conn(0x7ff9680af410 legacy=0x7ff9680af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.532+0000 7ff96ca00640 1 -- 172.21.15.45:0/1370769532 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9680b01d0 con 0x7ff968158ea0 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.533+0000 7ff96ca00640 1 --2- 172.21.15.45:0/1370769532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff968158ea0 0x7ff9680ac5b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff954009850 tx=0x7ff9540090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304b106bdf1ab80e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.533+0000 7ff967e00640 1 -- 172.21.15.45:0/1370769532 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95402ac80 con 0x7ff968158ea0 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.533+0000 7ff967e00640 1 -- 172.21.15.45:0/1370769532 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff95402ade0 con 0x7ff968158ea0 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.533+0000 7ff967e00640 1 -- 172.21.15.45:0/1370769532 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954032670 con 0x7ff968158ea0 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.533+0000 7ff96e800640 1 -- 172.21.15.45:0/1370769532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff968158ea0 msgr2=0x7ff9680ac5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.533+0000 7ff96e800640 1 --2- 172.21.15.45:0/1370769532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff968158ea0 0x7ff9680ac5b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff954009850 tx=0x7ff9540090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.534+0000 7ff96e800640 1 -- 172.21.15.45:0/1370769532 shutdown_connections 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.534+0000 7ff96e800640 1 --2- 172.21.15.45:0/1370769532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff968158ea0 0x7ff9680ac5b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.534+0000 7ff96e800640 1 --2- 172.21.15.45:0/1370769532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff968158ad0 0x7ff9680ac070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.534+0000 7ff96e800640 1 -- 172.21.15.45:0/1370769532 >> 172.21.15.45:0/1370769532 conn(0x7ff968096a70 msgr2=0x7ff968096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.534+0000 7ff96e800640 1 -- 172.21.15.45:0/1370769532 shutdown_connections 2024-08-17T02:25:26.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.534+0000 7ff96e800640 1 -- 172.21.15.45:0/1370769532 wait complete. 2024-08-17T02:25:26.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.535+0000 7ff96e800640 1 Processor -- start 2024-08-17T02:25:26.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.536+0000 7ff96e800640 1 -- start start 2024-08-17T02:25:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.536+0000 7ff96e800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9680af410 0x7ff9680cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.536+0000 7ff96e800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff968158ad0 0x7ff9680c9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.536+0000 7ff96e800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff968158ea0 0x7ff968145b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.536+0000 7ff96e800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680ccf60 con 0x7ff968158ea0 2024-08-17T02:25:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.536+0000 7ff96e800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680cc9a0 con 0x7ff9680af410 2024-08-17T02:25:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.536+0000 7ff96e800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9680ccc80 con 0x7ff968158ad0 2024-08-17T02:25:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.537+0000 7ff96de00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff968158ea0 0x7ff968145b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.537+0000 7ff96de00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff968158ea0 0x7ff968145b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57248/0 (socket says 172.21.15.45:57248) 2024-08-17T02:25:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.537+0000 7ff96de00640 1 -- 172.21.15.45:0/2322604532 learned_addr learned my addr 172.21.15.45:0/2322604532 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.537+0000 7ff96ca00640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff968158ad0 0x7ff9680c9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.537+0000 7ff96d400640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9680af410 0x7ff9680cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.537+0000 7ff96de00640 1 -- 172.21.15.45:0/2322604532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff968158ad0 msgr2=0x7ff9680c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.537+0000 7ff96de00640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff968158ad0 0x7ff9680c9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.537+0000 7ff96de00640 1 -- 172.21.15.45:0/2322604532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9680af410 msgr2=0x7ff9680cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.537+0000 7ff96de00640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9680af410 0x7ff9680cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.537+0000 7ff96de00640 1 -- 172.21.15.45:0/2322604532 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff954009390 con 0x7ff968158ea0 2024-08-17T02:25:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.538+0000 7ff96de00640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff968158ea0 0x7ff968145b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff96000cc10 tx=0x7ff960001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.538+0000 7ff964c00640 1 -- 172.21.15.45:0/2322604532 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96000ce30 con 0x7ff968158ea0 2024-08-17T02:25:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.538+0000 7ff964c00640 1 -- 172.21.15.45:0/2322604532 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff96000a7f0 con 0x7ff968158ea0 2024-08-17T02:25:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.538+0000 7ff96e800640 1 -- 172.21.15.45:0/2322604532 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9680c6cd0 con 0x7ff968158ea0 2024-08-17T02:25:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.538+0000 7ff964c00640 1 -- 172.21.15.45:0/2322604532 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff96000abf0 con 0x7ff968158ea0 2024-08-17T02:25:26.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.538+0000 7ff96e800640 1 -- 172.21.15.45:0/2322604532 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9680c9aa0 con 0x7ff968158ea0 2024-08-17T02:25:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.539+0000 7ff96e800640 1 -- 172.21.15.45:0/2322604532 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9680c6b30 con 0x7ff968158ea0 2024-08-17T02:25:26.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.540+0000 7ff964c00640 1 -- 172.21.15.45:0/2322604532 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff96000ad50 con 0x7ff968158ea0 2024-08-17T02:25:26.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.541+0000 7ff964c00640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff948065150 0x7ff948067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.541+0000 7ff964c00640 1 -- 172.21.15.45:0/2322604532 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff960082580 con 0x7ff968158ea0 2024-08-17T02:25:26.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.541+0000 7ff96d400640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff948065150 0x7ff948067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.542+0000 7ff96d400640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff948065150 0x7ff948067600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00bd40 tx=0x7ff95c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.545+0000 7ff964c00640 1 -- 172.21.15.45:0/2322604532 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9680c6b30 con 0x7ff968158ea0 2024-08-17T02:25:26.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.725+0000 7ff96e800640 1 -- 172.21.15.45:0/2322604532 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9680c6b30 con 0x7ff948065150 2024-08-17T02:25:26.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.732+0000 7ff964c00640 1 -- 172.21.15.45:0/2322604532 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264536 (secure 0 0 0) 0x7ff9680c6b30 con 0x7ff948065150 2024-08-17T02:25:26.737 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:26.738 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:25:26.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.736+0000 7ff96e800640 1 -- 172.21.15.45:0/2322604532 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff948065150 msgr2=0x7ff948067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.736+0000 7ff96e800640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff948065150 0x7ff948067600 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00bd40 tx=0x7ff95c008040 comp rx=0 tx=0).stop 2024-08-17T02:25:26.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.736+0000 7ff96e800640 1 -- 172.21.15.45:0/2322604532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff968158ea0 msgr2=0x7ff968145b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.736+0000 7ff96e800640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff968158ea0 0x7ff968145b20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff96000cc10 tx=0x7ff960001970 comp rx=0 tx=0).stop 2024-08-17T02:25:26.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.736+0000 7ff96e800640 1 -- 172.21.15.45:0/2322604532 shutdown_connections 2024-08-17T02:25:26.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.736+0000 7ff96e800640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff968158ea0 0x7ff968145b20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.736+0000 7ff96e800640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff948065150 0x7ff948067600 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.736+0000 7ff96e800640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff968158ad0 0x7ff9680c9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.736+0000 7ff96e800640 1 --2- 172.21.15.45:0/2322604532 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9680af410 0x7ff9680cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.736+0000 7ff96e800640 1 -- 172.21.15.45:0/2322604532 >> 172.21.15.45:0/2322604532 conn(0x7ff968096a70 msgr2=0x7ff9680ab060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.737+0000 7ff96e800640 1 -- 172.21.15.45:0/2322604532 shutdown_connections 2024-08-17T02:25:26.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.737+0000 7ff96e800640 1 -- 172.21.15.45:0/2322604532 wait complete. 2024-08-17T02:25:26.753 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-17T02:25:25.659664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398328,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576392,"statfs":{"total":773094113280,"available":770638225408,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002251"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694749+0000","last_change":"2024-08-17T02:25:14.688635+0000","last_active":"2024-08-17T02:25:14.694749+0000","last_peered":"2024-08-17T02:25:14.694749+0000","last_clean":"2024-08-17T02:25:14.694749+0000","last_became_active":"2024-08-17T02:25:14.688409+0000","last_became_peered":"2024-08-17T02:25:14.688409+0000","last_unstale":"2024-08-17T02:25:14.694749+0000","last_undegraded":"2024-08-17T02:25:14.694749+0000","last_fullsized":"2024-08-17T02:25:14.694749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:32.913252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686216+0000","last_change":"2024-08-17T02:25:14.685522+0000","last_active":"2024-08-17T02:25:14.686216+0000","last_peered":"2024-08-17T02:25:14.686216+0000","last_clean":"2024-08-17T02:25:14.686216+0000","last_became_active":"2024-08-17T02:25:14.685146+0000","last_became_peered":"2024-08-17T02:25:14.685146+0000","last_unstale":"2024-08-17T02:25:14.686216+0000","last_undegraded":"2024-08-17T02:25:14.686216+0000","last_fullsized":"2024-08-17T02:25:14.686216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.669173+0000","last_change":"2024-08-17T02:25:14.668249+0000","last_active":"2024-08-17T02:25:14.669173+0000","last_peered":"2024-08-17T02:25:14.669173+0000","last_clean":"2024-08-17T02:25:14.669173+0000","last_became_active":"2024-08-17T02:25:14.667916+0000","last_became_peered":"2024-08-17T02:25:14.667916+0000","last_unstale":"2024-08-17T02:25:14.669173+0000","last_undegraded":"2024-08-17T02:25:14.669173+0000","last_fullsized":"2024-08-17T02:25:14.669173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678079+0000","last_change":"2024-08-17T02:25:14.667371+0000","last_active":"2024-08-17T02:25:14.678079+0000","last_peered":"2024-08-17T02:25:14.678079+0000","last_clean":"2024-08-17T02:25:14.678079+0000","last_became_active":"2024-08-17T02:25:14.666507+0000","last_became_peered":"2024-08-17T02:25:14.666507+0000","last_unstale":"2024-08-17T02:25:14.678079+0000","last_undegraded":"2024-08-17T02:25:14.678079+0000","last_fullsized":"2024-08-17T02:25:14.678079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:32.913252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.680072+0000","last_change":"2024-08-17T02:25:14.673429+0000","last_active":"2024-08-17T02:25:14.680072+0000","last_peered":"2024-08-17T02:25:14.680072+0000","last_clean":"2024-08-17T02:25:14.680072+0000","last_became_active":"2024-08-17T02:25:14.673116+0000","last_became_peered":"2024-08-17T02:25:14.673116+0000","last_unstale":"2024-08-17T02:25:14.680072+0000","last_undegraded":"2024-08-17T02:25:14.680072+0000","last_fullsized":"2024-08-17T02:25:14.680072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678094+0000","last_change":"2024-08-17T02:25:14.665820+0000","last_active":"2024-08-17T02:25:14.678094+0000","last_peered":"2024-08-17T02:25:14.678094+0000","last_clean":"2024-08-17T02:25:14.678094+0000","last_became_active":"2024-08-17T02:25:14.665533+0000","last_became_peered":"2024-08-17T02:25:14.665533+0000","last_unstale":"2024-08-17T02:25:14.678094+0000","last_undegraded":"2024-08-17T02:25:14.678094+0000","last_fullsized":"2024-08-17T02:25:14.678094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:07.562236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693398+0000","last_change":"2024-08-17T02:25:14.685204+0000","last_active":"2024-08-17T02:25:14.693398+0000","last_peered":"2024-08-17T02:25:14.693398+0000","last_clean":"2024-08-17T02:25:14.693398+0000","last_became_active":"2024-08-17T02:25:14.684913+0000","last_became_peered":"2024-08-17T02:25:14.684913+0000","last_unstale":"2024-08-17T02:25:14.693398+0000","last_undegraded":"2024-08-17T02:25:14.693398+0000","last_fullsized":"2024-08-17T02:25:14.693398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:27:44.886508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679252+0000","last_change":"2024-08-17T02:25:14.671977+0000","last_active":"2024-08-17T02:25:14.679252+0000","last_peered":"2024-08-17T02:25:14.679252+0000","last_clean":"2024-08-17T02:25:14.679252+0000","last_became_active":"2024-08-17T02:25:14.671715+0000","last_became_peered":"2024-08-17T02:25:14.671715+0000","last_unstale":"2024-08-17T02:25:14.679252+0000","last_undegraded":"2024-08-17T02:25:14.679252+0000","last_fullsized":"2024-08-17T02:25:14.679252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690194+0000","last_change":"2024-08-17T02:25:14.682177+0000","last_active":"2024-08-17T02:25:14.690194+0000","last_peered":"2024-08-17T02:25:14.690194+0000","last_clean":"2024-08-17T02:25:14.690194+0000","last_became_active":"2024-08-17T02:25:14.681923+0000","last_became_peered":"2024-08-17T02:25:14.681923+0000","last_unstale":"2024-08-17T02:25:14.690194+0000","last_undegraded":"2024-08-17T02:25:14.690194+0000","last_fullsized":"2024-08-17T02:25:14.690194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:07.562236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689537+0000","last_change":"2024-08-17T02:25:14.684528+0000","last_active":"2024-08-17T02:25:14.689537+0000","last_peered":"2024-08-17T02:25:14.689537+0000","last_clean":"2024-08-17T02:25:14.689537+0000","last_became_active":"2024-08-17T02:25:14.684273+0000","last_became_peered":"2024-08-17T02:25:14.684273+0000","last_unstale":"2024-08-17T02:25:14.689537+0000","last_undegraded":"2024-08-17T02:25:14.689537+0000","last_fullsized":"2024-08-17T02:25:14.689537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693057+0000","last_change":"2024-08-17T02:25:14.687803+0000","last_active":"2024-08-17T02:25:14.693057+0000","last_peered":"2024-08-17T02:25:14.693057+0000","last_clean":"2024-08-17T02:25:14.693057+0000","last_became_active":"2024-08-17T02:25:14.687474+0000","last_became_peered":"2024-08-17T02:25:14.687474+0000","last_unstale":"2024-08-17T02:25:14.693057+0000","last_undegraded":"2024-08-17T02:25:14.693057+0000","last_fullsized":"2024-08-17T02:25:14.693057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694472+0000","last_change":"2024-08-17T02:25:14.688106+0000","last_active":"2024-08-17T02:25:14.694472+0000","last_peered":"2024-08-17T02:25:14.694472+0000","last_clean":"2024-08-17T02:25:14.694472+0000","last_became_active":"2024-08-17T02:25:14.687884+0000","last_became_peered":"2024-08-17T02:25:14.687884+0000","last_unstale":"2024-08-17T02:25:14.694472+0000","last_undegraded":"2024-08-17T02:25:14.694472+0000","last_fullsized":"2024-08-17T02:25:14.694472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:07.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678556+0000","last_change":"2024-08-17T02:25:14.675832+0000","last_active":"2024-08-17T02:25:14.678556+0000","last_peered":"2024-08-17T02:25:14.678556+0000","last_clean":"2024-08-17T02:25:14.678556+0000","last_became_active":"2024-08-17T02:25:14.674356+0000","last_became_peered":"2024-08-17T02:25:14.674356+0000","last_unstale":"2024-08-17T02:25:14.678556+0000","last_undegraded":"2024-08-17T02:25:14.678556+0000","last_fullsized":"2024-08-17T02:25:14.678556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686167+0000","last_change":"2024-08-17T02:25:14.682873+0000","last_active":"2024-08-17T02:25:14.686167+0000","last_peered":"2024-08-17T02:25:14.686167+0000","last_clean":"2024-08-17T02:25:14.686167+0000","last_became_active":"2024-08-17T02:25:14.678077+0000","last_became_peered":"2024-08-17T02:25:14.678077+0000","last_unstale":"2024-08-17T02:25:14.686167+0000","last_undegraded":"2024-08-17T02:25:14.686167+0000","last_fullsized":"2024-08-17T02:25:14.686167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:34.226633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678037+0000","last_change":"2024-08-17T02:25:14.675577+0000","last_active":"2024-08-17T02:25:14.678037+0000","last_peered":"2024-08-17T02:25:14.678037+0000","last_clean":"2024-08-17T02:25:14.678037+0000","last_became_active":"2024-08-17T02:25:14.675346+0000","last_became_peered":"2024-08-17T02:25:14.675346+0000","last_unstale":"2024-08-17T02:25:14.678037+0000","last_undegraded":"2024-08-17T02:25:14.678037+0000","last_fullsized":"2024-08-17T02:25:14.678037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678546+0000","last_change":"2024-08-17T02:25:14.664639+0000","last_active":"2024-08-17T02:25:14.678546+0000","last_peered":"2024-08-17T02:25:14.678546+0000","last_clean":"2024-08-17T02:25:14.678546+0000","last_became_active":"2024-08-17T02:25:14.664238+0000","last_became_peered":"2024-08-17T02:25:14.664238+0000","last_unstale":"2024-08-17T02:25:14.678546+0000","last_undegraded":"2024-08-17T02:25:14.678546+0000","last_fullsized":"2024-08-17T02:25:14.678546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681035+0000","last_change":"2024-08-17T02:25:14.673971+0000","last_active":"2024-08-17T02:25:14.681035+0000","last_peered":"2024-08-17T02:25:14.681035+0000","last_clean":"2024-08-17T02:25:14.681035+0000","last_became_active":"2024-08-17T02:25:14.673681+0000","last_became_peered":"2024-08-17T02:25:14.673681+0000","last_unstale":"2024-08-17T02:25:14.681035+0000","last_undegraded":"2024-08-17T02:25:14.681035+0000","last_fullsized":"2024-08-17T02:25:14.681035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681015+0000","last_change":"2024-08-17T02:25:14.679222+0000","last_active":"2024-08-17T02:25:14.681015+0000","last_peered":"2024-08-17T02:25:14.681015+0000","last_clean":"2024-08-17T02:25:14.681015+0000","last_became_active":"2024-08-17T02:25:14.678854+0000","last_became_peered":"2024-08-17T02:25:14.678854+0000","last_unstale":"2024-08-17T02:25:14.681015+0000","last_undegraded":"2024-08-17T02:25:14.681015+0000","last_fullsized":"2024-08-17T02:25:14.681015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:49.762929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690292+0000","last_change":"2024-08-17T02:25:14.675322+0000","last_active":"2024-08-17T02:25:14.690292+0000","last_peered":"2024-08-17T02:25:14.690292+0000","last_clean":"2024-08-17T02:25:14.690292+0000","last_became_active":"2024-08-17T02:25:14.675062+0000","last_became_peered":"2024-08-17T02:25:14.675062+0000","last_unstale":"2024-08-17T02:25:14.690292+0000","last_undegraded":"2024-08-17T02:25:14.690292+0000","last_fullsized":"2024-08-17T02:25:14.690292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693140+0000","last_change":"2024-08-17T02:25:14.688691+0000","last_active":"2024-08-17T02:25:14.693140+0000","last_peered":"2024-08-17T02:25:14.693140+0000","last_clean":"2024-08-17T02:25:14.693140+0000","last_became_active":"2024-08-17T02:25:14.688426+0000","last_became_peered":"2024-08-17T02:25:14.688426+0000","last_unstale":"2024-08-17T02:25:14.693140+0000","last_undegraded":"2024-08-17T02:25:14.693140+0000","last_fullsized":"2024-08-17T02:25:14.693140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684959+0000","last_change":"2024-08-17T02:25:14.677713+0000","last_active":"2024-08-17T02:25:14.684959+0000","last_peered":"2024-08-17T02:25:14.684959+0000","last_clean":"2024-08-17T02:25:14.684959+0000","last_became_active":"2024-08-17T02:25:14.676684+0000","last_became_peered":"2024-08-17T02:25:14.676684+0000","last_unstale":"2024-08-17T02:25:14.684959+0000","last_undegraded":"2024-08-17T02:25:14.684959+0000","last_fullsized":"2024-08-17T02:25:14.684959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683534+0000","last_change":"2024-08-17T02:25:14.677693+0000","last_active":"2024-08-17T02:25:14.683534+0000","last_peered":"2024-08-17T02:25:14.683534+0000","last_clean":"2024-08-17T02:25:14.683534+0000","last_became_active":"2024-08-17T02:25:14.675085+0000","last_became_peered":"2024-08-17T02:25:14.675085+0000","last_unstale":"2024-08-17T02:25:14.683534+0000","last_undegraded":"2024-08-17T02:25:14.683534+0000","last_fullsized":"2024-08-17T02:25:14.683534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686732+0000","last_change":"2024-08-17T02:25:14.680570+0000","last_active":"2024-08-17T02:25:14.686732+0000","last_peered":"2024-08-17T02:25:14.686732+0000","last_clean":"2024-08-17T02:25:14.686732+0000","last_became_active":"2024-08-17T02:25:14.680331+0000","last_became_peered":"2024-08-17T02:25:14.680331+0000","last_unstale":"2024-08-17T02:25:14.686732+0000","last_undegraded":"2024-08-17T02:25:14.686732+0000","last_fullsized":"2024-08-17T02:25:14.686732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678558+0000","last_change":"2024-08-17T02:25:14.669965+0000","last_active":"2024-08-17T02:25:14.678558+0000","last_peered":"2024-08-17T02:25:14.678558+0000","last_clean":"2024-08-17T02:25:14.678558+0000","last_became_active":"2024-08-17T02:25:14.669710+0000","last_became_peered":"2024-08-17T02:25:14.669710+0000","last_unstale":"2024-08-17T02:25:14.678558+0000","last_undegraded":"2024-08-17T02:25:14.678558+0000","last_fullsized":"2024-08-17T02:25:14.678558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686777+0000","last_change":"2024-08-17T02:25:14.680996+0000","last_active":"2024-08-17T02:25:14.686777+0000","last_peered":"2024-08-17T02:25:14.686777+0000","last_clean":"2024-08-17T02:25:14.686777+0000","last_became_active":"2024-08-17T02:25:14.680672+0000","last_became_peered":"2024-08-17T02:25:14.680672+0000","last_unstale":"2024-08-17T02:25:14.686777+0000","last_undegraded":"2024-08-17T02:25:14.686777+0000","last_fullsized":"2024-08-17T02:25:14.686777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686709+0000","last_change":"2024-08-17T02:25:14.682018+0000","last_active":"2024-08-17T02:25:14.686709+0000","last_peered":"2024-08-17T02:25:14.686709+0000","last_clean":"2024-08-17T02:25:14.686709+0000","last_became_active":"2024-08-17T02:25:14.681624+0000","last_became_peered":"2024-08-17T02:25:14.681624+0000","last_unstale":"2024-08-17T02:25:14.686709+0000","last_undegraded":"2024-08-17T02:25:14.686709+0000","last_fullsized":"2024-08-17T02:25:14.686709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.674157+0000","last_change":"2024-08-17T02:25:14.673348+0000","last_active":"2024-08-17T02:25:14.674157+0000","last_peered":"2024-08-17T02:25:14.674157+0000","last_clean":"2024-08-17T02:25:14.674157+0000","last_became_active":"2024-08-17T02:25:14.672984+0000","last_became_peered":"2024-08-17T02:25:14.672984+0000","last_unstale":"2024-08-17T02:25:14.674157+0000","last_undegraded":"2024-08-17T02:25:14.674157+0000","last_fullsized":"2024-08-17T02:25:14.674157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686798+0000","last_change":"2024-08-17T02:25:14.681879+0000","last_active":"2024-08-17T02:25:14.686798+0000","last_peered":"2024-08-17T02:25:14.686798+0000","last_clean":"2024-08-17T02:25:14.686798+0000","last_became_active":"2024-08-17T02:25:14.681545+0000","last_became_peered":"2024-08-17T02:25:14.681545+0000","last_unstale":"2024-08-17T02:25:14.686798+0000","last_undegraded":"2024-08-17T02:25:14.686798+0000","last_fullsized":"2024-08-17T02:25:14.686798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:59.372660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684978+0000","last_change":"2024-08-17T02:25:14.680092+0000","last_active":"2024-08-17T02:25:14.684978+0000","last_peered":"2024-08-17T02:25:14.684978+0000","last_clean":"2024-08-17T02:25:14.684978+0000","last_became_active":"2024-08-17T02:25:14.677406+0000","last_became_peered":"2024-08-17T02:25:14.677406+0000","last_unstale":"2024-08-17T02:25:14.684978+0000","last_undegraded":"2024-08-17T02:25:14.684978+0000","last_fullsized":"2024-08-17T02:25:14.684978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:12.662553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678115+0000","last_change":"2024-08-17T02:25:14.668666+0000","last_active":"2024-08-17T02:25:14.678115+0000","last_peered":"2024-08-17T02:25:14.678115+0000","last_clean":"2024-08-17T02:25:14.678115+0000","last_became_active":"2024-08-17T02:25:14.668347+0000","last_became_peered":"2024-08-17T02:25:14.668347+0000","last_unstale":"2024-08-17T02:25:14.678115+0000","last_undegraded":"2024-08-17T02:25:14.678115+0000","last_fullsized":"2024-08-17T02:25:14.678115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:27:44.886508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670824+0000","last_change":"2024-08-17T02:25:14.668138+0000","last_active":"2024-08-17T02:25:14.670824+0000","last_peered":"2024-08-17T02:25:14.670824+0000","last_clean":"2024-08-17T02:25:14.670824+0000","last_became_active":"2024-08-17T02:25:14.667760+0000","last_became_peered":"2024-08-17T02:25:14.667760+0000","last_unstale":"2024-08-17T02:25:14.670824+0000","last_undegraded":"2024-08-17T02:25:14.670824+0000","last_fullsized":"2024-08-17T02:25:14.670824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:07.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683761+0000","last_change":"2024-08-17T02:25:14.674636+0000","last_active":"2024-08-17T02:25:14.683761+0000","last_peered":"2024-08-17T02:25:14.683761+0000","last_clean":"2024-08-17T02:25:14.683761+0000","last_became_active":"2024-08-17T02:25:14.674133+0000","last_became_peered":"2024-08-17T02:25:14.674133+0000","last_unstale":"2024-08-17T02:25:14.683761+0000","last_undegraded":"2024-08-17T02:25:14.683761+0000","last_fullsized":"2024-08-17T02:25:14.683761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689013+0000","last_change":"2024-08-17T02:25:14.677807+0000","last_active":"2024-08-17T02:25:14.689013+0000","last_peered":"2024-08-17T02:25:14.689013+0000","last_clean":"2024-08-17T02:25:14.689013+0000","last_became_active":"2024-08-17T02:25:14.677600+0000","last_became_peered":"2024-08-17T02:25:14.677600+0000","last_unstale":"2024-08-17T02:25:14.689013+0000","last_undegraded":"2024-08-17T02:25:14.689013+0000","last_fullsized":"2024-08-17T02:25:14.689013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:20.793789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700661+0000","last_change":"2024-08-17T02:25:13.676038+0000","last_active":"2024-08-17T02:25:14.700661+0000","last_peered":"2024-08-17T02:25:14.700661+0000","last_clean":"2024-08-17T02:25:14.700661+0000","last_became_active":"2024-08-17T02:25:13.675729+0000","last_became_peered":"2024-08-17T02:25:13.675729+0000","last_unstale":"2024-08-17T02:25:14.700661+0000","last_undegraded":"2024-08-17T02:25:14.700661+0000","last_fullsized":"2024-08-17T02:25:14.700661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684995+0000","last_change":"2024-08-17T02:25:14.680735+0000","last_active":"2024-08-17T02:25:14.684995+0000","last_peered":"2024-08-17T02:25:14.684995+0000","last_clean":"2024-08-17T02:25:14.684995+0000","last_became_active":"2024-08-17T02:25:14.679254+0000","last_became_peered":"2024-08-17T02:25:14.679254+0000","last_unstale":"2024-08-17T02:25:14.684995+0000","last_undegraded":"2024-08-17T02:25:14.684995+0000","last_fullsized":"2024-08-17T02:25:14.684995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700214+0000","last_change":"2024-08-17T02:25:13.685739+0000","last_active":"2024-08-17T02:25:14.700214+0000","last_peered":"2024-08-17T02:25:14.700214+0000","last_clean":"2024-08-17T02:25:14.700214+0000","last_became_active":"2024-08-17T02:25:13.685479+0000","last_became_peered":"2024-08-17T02:25:13.685479+0000","last_unstale":"2024-08-17T02:25:14.700214+0000","last_undegraded":"2024-08-17T02:25:14.700214+0000","last_fullsized":"2024-08-17T02:25:14.700214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660450+0000","last_change":"2024-08-17T02:25:13.674789+0000","last_active":"2024-08-17T02:25:14.660450+0000","last_peered":"2024-08-17T02:25:14.660450+0000","last_clean":"2024-08-17T02:25:14.660450+0000","last_became_active":"2024-08-17T02:25:13.674512+0000","last_became_peered":"2024-08-17T02:25:13.674512+0000","last_unstale":"2024-08-17T02:25:14.660450+0000","last_undegraded":"2024-08-17T02:25:14.660450+0000","last_fullsized":"2024-08-17T02:25:14.660450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671875+0000","last_change":"2024-08-17T02:25:14.663923+0000","last_active":"2024-08-17T02:25:14.671875+0000","last_peered":"2024-08-17T02:25:14.671875+0000","last_clean":"2024-08-17T02:25:14.671875+0000","last_became_active":"2024-08-17T02:25:14.663671+0000","last_became_peered":"2024-08-17T02:25:14.663671+0000","last_unstale":"2024-08-17T02:25:14.671875+0000","last_undegraded":"2024-08-17T02:25:14.671875+0000","last_fullsized":"2024-08-17T02:25:14.671875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.659542+0000","last_change":"2024-08-17T02:25:13.679503+0000","last_active":"2024-08-17T02:25:14.659542+0000","last_peered":"2024-08-17T02:25:14.659542+0000","last_clean":"2024-08-17T02:25:14.659542+0000","last_became_active":"2024-08-17T02:25:13.679226+0000","last_became_peered":"2024-08-17T02:25:13.679226+0000","last_unstale":"2024-08-17T02:25:14.659542+0000","last_undegraded":"2024-08-17T02:25:14.659542+0000","last_fullsized":"2024-08-17T02:25:14.659542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678019+0000","last_change":"2024-08-17T02:25:14.675096+0000","last_active":"2024-08-17T02:25:14.678019+0000","last_peered":"2024-08-17T02:25:14.678019+0000","last_clean":"2024-08-17T02:25:14.678019+0000","last_became_active":"2024-08-17T02:25:14.672309+0000","last_became_peered":"2024-08-17T02:25:14.672309+0000","last_unstale":"2024-08-17T02:25:14.678019+0000","last_undegraded":"2024-08-17T02:25:14.678019+0000","last_fullsized":"2024-08-17T02:25:14.678019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.676600+0000","last_change":"2024-08-17T02:25:13.676652+0000","last_active":"2024-08-17T02:25:14.676600+0000","last_peered":"2024-08-17T02:25:14.676600+0000","last_clean":"2024-08-17T02:25:14.676600+0000","last_became_active":"2024-08-17T02:25:13.676364+0000","last_became_peered":"2024-08-17T02:25:13.676364+0000","last_unstale":"2024-08-17T02:25:14.676600+0000","last_undegraded":"2024-08-17T02:25:14.676600+0000","last_fullsized":"2024-08-17T02:25:14.676600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.682522+0000","last_change":"2024-08-17T02:25:14.672988+0000","last_active":"2024-08-17T02:25:14.682522+0000","last_peered":"2024-08-17T02:25:14.682522+0000","last_clean":"2024-08-17T02:25:14.682522+0000","last_became_active":"2024-08-17T02:25:14.672662+0000","last_became_peered":"2024-08-17T02:25:14.672662+0000","last_unstale":"2024-08-17T02:25:14.682522+0000","last_undegraded":"2024-08-17T02:25:14.682522+0000","last_fullsized":"2024-08-17T02:25:14.682522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658744+0000","last_change":"2024-08-17T02:25:13.676993+0000","last_active":"2024-08-17T02:25:14.658744+0000","last_peered":"2024-08-17T02:25:14.658744+0000","last_clean":"2024-08-17T02:25:14.658744+0000","last_became_active":"2024-08-17T02:25:13.674529+0000","last_became_peered":"2024-08-17T02:25:13.674529+0000","last_unstale":"2024-08-17T02:25:14.658744+0000","last_undegraded":"2024-08-17T02:25:14.658744+0000","last_fullsized":"2024-08-17T02:25:14.658744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681456+0000","last_change":"2024-08-17T02:25:14.677046+0000","last_active":"2024-08-17T02:25:14.681456+0000","last_peered":"2024-08-17T02:25:14.681456+0000","last_clean":"2024-08-17T02:25:14.681456+0000","last_became_active":"2024-08-17T02:25:14.676726+0000","last_became_peered":"2024-08-17T02:25:14.676726+0000","last_unstale":"2024-08-17T02:25:14.681456+0000","last_undegraded":"2024-08-17T02:25:14.681456+0000","last_fullsized":"2024-08-17T02:25:14.681456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700073+0000","last_change":"2024-08-17T02:25:13.685185+0000","last_active":"2024-08-17T02:25:14.700073+0000","last_peered":"2024-08-17T02:25:14.700073+0000","last_clean":"2024-08-17T02:25:14.700073+0000","last_became_active":"2024-08-17T02:25:13.684855+0000","last_became_peered":"2024-08-17T02:25:13.684855+0000","last_unstale":"2024-08-17T02:25:14.700073+0000","last_undegraded":"2024-08-17T02:25:14.700073+0000","last_fullsized":"2024-08-17T02:25:14.700073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689679+0000","last_change":"2024-08-17T02:25:14.684052+0000","last_active":"2024-08-17T02:25:14.689679+0000","last_peered":"2024-08-17T02:25:14.689679+0000","last_clean":"2024-08-17T02:25:14.689679+0000","last_became_active":"2024-08-17T02:25:14.682595+0000","last_became_peered":"2024-08-17T02:25:14.682595+0000","last_unstale":"2024-08-17T02:25:14.689679+0000","last_undegraded":"2024-08-17T02:25:14.689679+0000","last_fullsized":"2024-08-17T02:25:14.689679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:49.693684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.702862+0000","last_change":"2024-08-17T02:25:13.679399+0000","last_active":"2024-08-17T02:25:14.702862+0000","last_peered":"2024-08-17T02:25:14.702862+0000","last_clean":"2024-08-17T02:25:14.702862+0000","last_became_active":"2024-08-17T02:25:13.679142+0000","last_became_peered":"2024-08-17T02:25:13.679142+0000","last_unstale":"2024-08-17T02:25:14.702862+0000","last_undegraded":"2024-08-17T02:25:14.702862+0000","last_fullsized":"2024-08-17T02:25:14.702862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690311+0000","last_change":"2024-08-17T02:25:14.682175+0000","last_active":"2024-08-17T02:25:14.690311+0000","last_peered":"2024-08-17T02:25:14.690311+0000","last_clean":"2024-08-17T02:25:14.690311+0000","last_became_active":"2024-08-17T02:25:14.681498+0000","last_became_peered":"2024-08-17T02:25:14.681498+0000","last_unstale":"2024-08-17T02:25:14.690311+0000","last_undegraded":"2024-08-17T02:25:14.690311+0000","last_fullsized":"2024-08-17T02:25:14.690311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699519+0000","last_change":"2024-08-17T02:25:13.681889+0000","last_active":"2024-08-17T02:25:14.699519+0000","last_peered":"2024-08-17T02:25:14.699519+0000","last_clean":"2024-08-17T02:25:14.699519+0000","last_became_active":"2024-08-17T02:25:13.681485+0000","last_became_peered":"2024-08-17T02:25:13.681485+0000","last_unstale":"2024-08-17T02:25:14.699519+0000","last_undegraded":"2024-08-17T02:25:14.699519+0000","last_fullsized":"2024-08-17T02:25:14.699519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683304+0000","last_change":"2024-08-17T02:25:14.678042+0000","last_active":"2024-08-17T02:25:14.683304+0000","last_peered":"2024-08-17T02:25:14.683304+0000","last_clean":"2024-08-17T02:25:14.683304+0000","last_became_active":"2024-08-17T02:25:14.677441+0000","last_became_peered":"2024-08-17T02:25:14.677441+0000","last_unstale":"2024-08-17T02:25:14.683304+0000","last_undegraded":"2024-08-17T02:25:14.683304+0000","last_fullsized":"2024-08-17T02:25:14.683304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658041+0000","last_change":"2024-08-17T02:25:13.672280+0000","last_active":"2024-08-17T02:25:14.658041+0000","last_peered":"2024-08-17T02:25:14.658041+0000","last_clean":"2024-08-17T02:25:14.658041+0000","last_became_active":"2024-08-17T02:25:13.672021+0000","last_became_peered":"2024-08-17T02:25:13.672021+0000","last_unstale":"2024-08-17T02:25:14.658041+0000","last_undegraded":"2024-08-17T02:25:14.658041+0000","last_fullsized":"2024-08-17T02:25:14.658041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694737+0000","last_change":"2024-08-17T02:25:14.690951+0000","last_active":"2024-08-17T02:25:14.694737+0000","last_peered":"2024-08-17T02:25:14.694737+0000","last_clean":"2024-08-17T02:25:14.694737+0000","last_became_active":"2024-08-17T02:25:14.690640+0000","last_became_peered":"2024-08-17T02:25:14.690640+0000","last_unstale":"2024-08-17T02:25:14.694737+0000","last_undegraded":"2024-08-17T02:25:14.694737+0000","last_fullsized":"2024-08-17T02:25:14.694737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:38.177445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.666609+0000","last_change":"2024-08-17T02:25:13.678799+0000","last_active":"2024-08-17T02:25:14.666609+0000","last_peered":"2024-08-17T02:25:14.666609+0000","last_clean":"2024-08-17T02:25:14.666609+0000","last_became_active":"2024-08-17T02:25:13.678338+0000","last_became_peered":"2024-08-17T02:25:13.678338+0000","last_unstale":"2024-08-17T02:25:14.666609+0000","last_undegraded":"2024-08-17T02:25:14.666609+0000","last_fullsized":"2024-08-17T02:25:14.666609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684933+0000","last_change":"2024-08-17T02:25:14.677309+0000","last_active":"2024-08-17T02:25:14.684933+0000","last_peered":"2024-08-17T02:25:14.684933+0000","last_clean":"2024-08-17T02:25:14.684933+0000","last_became_active":"2024-08-17T02:25:14.673828+0000","last_became_peered":"2024-08-17T02:25:14.673828+0000","last_unstale":"2024-08-17T02:25:14.684933+0000","last_undegraded":"2024-08-17T02:25:14.684933+0000","last_fullsized":"2024-08-17T02:25:14.684933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.701579+0000","last_change":"2024-08-17T02:25:13.679207+0000","last_active":"2024-08-17T02:25:14.701579+0000","last_peered":"2024-08-17T02:25:14.701579+0000","last_clean":"2024-08-17T02:25:14.701579+0000","last_became_active":"2024-08-17T02:25:13.678895+0000","last_became_peered":"2024-08-17T02:25:13.678895+0000","last_unstale":"2024-08-17T02:25:14.701579+0000","last_undegraded":"2024-08-17T02:25:14.701579+0000","last_fullsized":"2024-08-17T02:25:14.701579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693362+0000","last_change":"2024-08-17T02:25:14.684764+0000","last_active":"2024-08-17T02:25:14.693362+0000","last_peered":"2024-08-17T02:25:14.693362+0000","last_clean":"2024-08-17T02:25:14.693362+0000","last_became_active":"2024-08-17T02:25:14.682919+0000","last_became_peered":"2024-08-17T02:25:14.682919+0000","last_unstale":"2024-08-17T02:25:14.693362+0000","last_undegraded":"2024-08-17T02:25:14.693362+0000","last_fullsized":"2024-08-17T02:25:14.693362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:22.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699314+0000","last_change":"2024-08-17T02:25:13.680283+0000","last_active":"2024-08-17T02:25:14.699314+0000","last_peered":"2024-08-17T02:25:14.699314+0000","last_clean":"2024-08-17T02:25:14.699314+0000","last_became_active":"2024-08-17T02:25:13.679891+0000","last_became_peered":"2024-08-17T02:25:13.679891+0000","last_unstale":"2024-08-17T02:25:14.699314+0000","last_undegraded":"2024-08-17T02:25:14.699314+0000","last_fullsized":"2024-08-17T02:25:14.699314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694975+0000","last_change":"2024-08-17T02:25:14.691471+0000","last_active":"2024-08-17T02:25:14.694975+0000","last_peered":"2024-08-17T02:25:14.694975+0000","last_clean":"2024-08-17T02:25:14.694975+0000","last_became_active":"2024-08-17T02:25:14.691171+0000","last_became_peered":"2024-08-17T02:25:14.691171+0000","last_unstale":"2024-08-17T02:25:14.694975+0000","last_undegraded":"2024-08-17T02:25:14.694975+0000","last_fullsized":"2024-08-17T02:25:14.694975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:19.535692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700333+0000","last_change":"2024-08-17T02:25:13.677536+0000","last_active":"2024-08-17T02:25:14.700333+0000","last_peered":"2024-08-17T02:25:14.700333+0000","last_clean":"2024-08-17T02:25:14.700333+0000","last_became_active":"2024-08-17T02:25:13.675183+0000","last_became_peered":"2024-08-17T02:25:13.675183+0000","last_unstale":"2024-08-17T02:25:14.700333+0000","last_undegraded":"2024-08-17T02:25:14.700333+0000","last_fullsized":"2024-08-17T02:25:14.700333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.695063+0000","last_change":"2024-08-17T02:25:14.692018+0000","last_active":"2024-08-17T02:25:14.695063+0000","last_peered":"2024-08-17T02:25:14.695063+0000","last_clean":"2024-08-17T02:25:14.695063+0000","last_became_active":"2024-08-17T02:25:14.691753+0000","last_became_peered":"2024-08-17T02:25:14.691753+0000","last_unstale":"2024-08-17T02:25:14.695063+0000","last_undegraded":"2024-08-17T02:25:14.695063+0000","last_fullsized":"2024-08-17T02:25:14.695063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:57.832736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699649+0000","last_change":"2024-08-17T02:25:13.684009+0000","last_active":"2024-08-17T02:25:14.699649+0000","last_peered":"2024-08-17T02:25:14.699649+0000","last_clean":"2024-08-17T02:25:14.699649+0000","last_became_active":"2024-08-17T02:25:13.683242+0000","last_became_peered":"2024-08-17T02:25:13.683242+0000","last_unstale":"2024-08-17T02:25:14.699649+0000","last_undegraded":"2024-08-17T02:25:14.699649+0000","last_fullsized":"2024-08-17T02:25:14.699649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:48.757464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678098+0000","last_change":"2024-08-17T02:25:14.667634+0000","last_active":"2024-08-17T02:25:14.678098+0000","last_peered":"2024-08-17T02:25:14.678098+0000","last_clean":"2024-08-17T02:25:14.678098+0000","last_became_active":"2024-08-17T02:25:14.667363+0000","last_became_peered":"2024-08-17T02:25:14.667363+0000","last_unstale":"2024-08-17T02:25:14.678098+0000","last_undegraded":"2024-08-17T02:25:14.678098+0000","last_fullsized":"2024-08-17T02:25:14.678098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:59.372660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660728+0000","last_change":"2024-08-17T02:25:13.668855+0000","last_active":"2024-08-17T02:25:14.660728+0000","last_peered":"2024-08-17T02:25:14.660728+0000","last_clean":"2024-08-17T02:25:14.660728+0000","last_became_active":"2024-08-17T02:25:13.668568+0000","last_became_peered":"2024-08-17T02:25:13.668568+0000","last_unstale":"2024-08-17T02:25:14.660728+0000","last_undegraded":"2024-08-17T02:25:14.660728+0000","last_fullsized":"2024-08-17T02:25:14.660728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694943+0000","last_change":"2024-08-17T02:25:14.691327+0000","last_active":"2024-08-17T02:25:14.694943+0000","last_peered":"2024-08-17T02:25:14.694943+0000","last_clean":"2024-08-17T02:25:14.694943+0000","last_became_active":"2024-08-17T02:25:14.690760+0000","last_became_peered":"2024-08-17T02:25:14.690760+0000","last_unstale":"2024-08-17T02:25:14.694943+0000","last_undegraded":"2024-08-17T02:25:14.694943+0000","last_fullsized":"2024-08-17T02:25:14.694943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.664056+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:25:14.664056+0000","last_peered":"2024-08-17T02:25:14.664056+0000","last_clean":"2024-08-17T02:25:14.664056+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:25:14.664056+0000","last_undegraded":"2024-08-17T02:25:14.664056+0000","last_fullsized":"2024-08-17T02:25:14.664056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.657956+0000","last_change":"2024-08-17T02:25:13.671609+0000","last_active":"2024-08-17T02:25:14.657956+0000","last_peered":"2024-08-17T02:25:14.657956+0000","last_clean":"2024-08-17T02:25:14.657956+0000","last_became_active":"2024-08-17T02:25:13.665871+0000","last_became_peered":"2024-08-17T02:25:13.665871+0000","last_unstale":"2024-08-17T02:25:14.657956+0000","last_undegraded":"2024-08-17T02:25:14.657956+0000","last_fullsized":"2024-08-17T02:25:14.657956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679635+0000","last_change":"2024-08-17T02:25:14.671245+0000","last_active":"2024-08-17T02:25:14.679635+0000","last_peered":"2024-08-17T02:25:14.679635+0000","last_clean":"2024-08-17T02:25:14.679635+0000","last_became_active":"2024-08-17T02:25:14.670965+0000","last_became_peered":"2024-08-17T02:25:14.670965+0000","last_unstale":"2024-08-17T02:25:14.679635+0000","last_undegraded":"2024-08-17T02:25:14.679635+0000","last_fullsized":"2024-08-17T02:25:14.679635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.663915+0000","last_change":"2024-08-17T02:25:13.687566+0000","last_active":"2024-08-17T02:25:14.663915+0000","last_peered":"2024-08-17T02:25:14.663915+0000","last_clean":"2024-08-17T02:25:14.663915+0000","last_became_active":"2024-08-17T02:25:13.687289+0000","last_became_peered":"2024-08-17T02:25:13.687289+0000","last_unstale":"2024-08-17T02:25:14.663915+0000","last_undegraded":"2024-08-17T02:25:14.663915+0000","last_fullsized":"2024-08-17T02:25:14.663915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684731+0000","last_change":"2024-08-17T02:25:14.678546+0000","last_active":"2024-08-17T02:25:14.684731+0000","last_peered":"2024-08-17T02:25:14.684731+0000","last_clean":"2024-08-17T02:25:14.684731+0000","last_became_active":"2024-08-17T02:25:14.677779+0000","last_became_peered":"2024-08-17T02:25:14.677779+0000","last_unstale":"2024-08-17T02:25:14.684731+0000","last_undegraded":"2024-08-17T02:25:14.684731+0000","last_fullsized":"2024-08-17T02:25:14.684731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660654+0000","last_change":"2024-08-17T02:25:13.668305+0000","last_active":"2024-08-17T02:25:14.660654+0000","last_peered":"2024-08-17T02:25:14.660654+0000","last_clean":"2024-08-17T02:25:14.660654+0000","last_became_active":"2024-08-17T02:25:13.667891+0000","last_became_peered":"2024-08-17T02:25:13.667891+0000","last_unstale":"2024-08-17T02:25:14.660654+0000","last_undegraded":"2024-08-17T02:25:14.660654+0000","last_fullsized":"2024-08-17T02:25:14.660654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.672921+0000","last_change":"2024-08-17T02:25:14.671227+0000","last_active":"2024-08-17T02:25:14.672921+0000","last_peered":"2024-08-17T02:25:14.672921+0000","last_clean":"2024-08-17T02:25:14.672921+0000","last_became_active":"2024-08-17T02:25:14.670957+0000","last_became_peered":"2024-08-17T02:25:14.670957+0000","last_unstale":"2024-08-17T02:25:14.672921+0000","last_undegraded":"2024-08-17T02:25:14.672921+0000","last_fullsized":"2024-08-17T02:25:14.672921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658042+0000","last_change":"2024-08-17T02:25:13.682523+0000","last_active":"2024-08-17T02:25:14.658042+0000","last_peered":"2024-08-17T02:25:14.658042+0000","last_clean":"2024-08-17T02:25:14.658042+0000","last_became_active":"2024-08-17T02:25:13.681263+0000","last_became_peered":"2024-08-17T02:25:13.681263+0000","last_unstale":"2024-08-17T02:25:14.658042+0000","last_undegraded":"2024-08-17T02:25:14.658042+0000","last_fullsized":"2024-08-17T02:25:14.658042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689867+0000","last_change":"2024-08-17T02:25:14.684673+0000","last_active":"2024-08-17T02:25:14.689867+0000","last_peered":"2024-08-17T02:25:14.689867+0000","last_clean":"2024-08-17T02:25:14.689867+0000","last_became_active":"2024-08-17T02:25:14.684108+0000","last_became_peered":"2024-08-17T02:25:14.684108+0000","last_unstale":"2024-08-17T02:25:14.689867+0000","last_undegraded":"2024-08-17T02:25:14.689867+0000","last_fullsized":"2024-08-17T02:25:14.689867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:49.762929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671095+0000","last_change":"2024-08-17T02:25:13.683299+0000","last_active":"2024-08-17T02:25:14.671095+0000","last_peered":"2024-08-17T02:25:14.671095+0000","last_clean":"2024-08-17T02:25:14.671095+0000","last_became_active":"2024-08-17T02:25:13.682446+0000","last_became_peered":"2024-08-17T02:25:13.682446+0000","last_unstale":"2024-08-17T02:25:14.671095+0000","last_undegraded":"2024-08-17T02:25:14.671095+0000","last_fullsized":"2024-08-17T02:25:14.671095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:48.688219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683680+0000","last_change":"2024-08-17T02:25:14.670920+0000","last_active":"2024-08-17T02:25:14.683680+0000","last_peered":"2024-08-17T02:25:14.683680+0000","last_clean":"2024-08-17T02:25:14.683680+0000","last_became_active":"2024-08-17T02:25:14.670641+0000","last_became_peered":"2024-08-17T02:25:14.670641+0000","last_unstale":"2024-08-17T02:25:14.683680+0000","last_undegraded":"2024-08-17T02:25:14.683680+0000","last_fullsized":"2024-08-17T02:25:14.683680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.666369+0000","last_change":"2024-08-17T02:25:13.686375+0000","last_active":"2024-08-17T02:25:14.666369+0000","last_peered":"2024-08-17T02:25:14.666369+0000","last_clean":"2024-08-17T02:25:14.666369+0000","last_became_active":"2024-08-17T02:25:13.686118+0000","last_became_peered":"2024-08-17T02:25:13.686118+0000","last_unstale":"2024-08-17T02:25:14.666369+0000","last_undegraded":"2024-08-17T02:25:14.666369+0000","last_fullsized":"2024-08-17T02:25:14.666369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:48.688219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.673713+0000","last_change":"2024-08-17T02:25:14.672615+0000","last_active":"2024-08-17T02:25:14.673713+0000","last_peered":"2024-08-17T02:25:14.673713+0000","last_clean":"2024-08-17T02:25:14.673713+0000","last_became_active":"2024-08-17T02:25:14.672282+0000","last_became_peered":"2024-08-17T02:25:14.672282+0000","last_unstale":"2024-08-17T02:25:14.673713+0000","last_undegraded":"2024-08-17T02:25:14.673713+0000","last_fullsized":"2024-08-17T02:25:14.673713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:15.670485+0000","last_change":"2024-08-17T02:25:13.683744+0000","last_active":"2024-08-17T02:25:15.670485+0000","last_peered":"2024-08-17T02:25:15.670485+0000","last_clean":"2024-08-17T02:25:15.670485+0000","last_became_active":"2024-08-17T02:25:13.683299+0000","last_became_peered":"2024-08-17T02:25:13.683299+0000","last_unstale":"2024-08-17T02:25:15.670485+0000","last_undegraded":"2024-08-17T02:25:15.670485+0000","last_fullsized":"2024-08-17T02:25:15.670485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:06.729225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686757+0000","last_change":"2024-08-17T02:25:14.680936+0000","last_active":"2024-08-17T02:25:14.686757+0000","last_peered":"2024-08-17T02:25:14.686757+0000","last_clean":"2024-08-17T02:25:14.686757+0000","last_became_active":"2024-08-17T02:25:14.680661+0000","last_became_peered":"2024-08-17T02:25:14.680661+0000","last_unstale":"2024-08-17T02:25:14.686757+0000","last_undegraded":"2024-08-17T02:25:14.686757+0000","last_fullsized":"2024-08-17T02:25:14.686757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.701405+0000","last_change":"2024-08-17T02:25:13.677363+0000","last_active":"2024-08-17T02:25:14.701405+0000","last_peered":"2024-08-17T02:25:14.701405+0000","last_clean":"2024-08-17T02:25:14.701405+0000","last_became_active":"2024-08-17T02:25:13.677094+0000","last_became_peered":"2024-08-17T02:25:13.677094+0000","last_unstale":"2024-08-17T02:25:14.701405+0000","last_undegraded":"2024-08-17T02:25:14.701405+0000","last_fullsized":"2024-08-17T02:25:14.701405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686590+0000","last_change":"2024-08-17T02:25:14.683885+0000","last_active":"2024-08-17T02:25:14.686590+0000","last_peered":"2024-08-17T02:25:14.686590+0000","last_clean":"2024-08-17T02:25:14.686590+0000","last_became_active":"2024-08-17T02:25:14.679041+0000","last_became_peered":"2024-08-17T02:25:14.679041+0000","last_unstale":"2024-08-17T02:25:14.686590+0000","last_undegraded":"2024-08-17T02:25:14.686590+0000","last_fullsized":"2024-08-17T02:25:14.686590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.661849+0000","last_change":"2024-08-17T02:25:13.685837+0000","last_active":"2024-08-17T02:25:14.661849+0000","last_peered":"2024-08-17T02:25:14.661849+0000","last_clean":"2024-08-17T02:25:14.661849+0000","last_became_active":"2024-08-17T02:25:13.685565+0000","last_became_peered":"2024-08-17T02:25:13.685565+0000","last_unstale":"2024-08-17T02:25:14.661849+0000","last_undegraded":"2024-08-17T02:25:14.661849+0000","last_fullsized":"2024-08-17T02:25:14.661849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:33.349779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.672818+0000","last_change":"2024-08-17T02:25:14.668966+0000","last_active":"2024-08-17T02:25:14.672818+0000","last_peered":"2024-08-17T02:25:14.672818+0000","last_clean":"2024-08-17T02:25:14.672818+0000","last_became_active":"2024-08-17T02:25:14.668718+0000","last_became_peered":"2024-08-17T02:25:14.668718+0000","last_unstale":"2024-08-17T02:25:14.672818+0000","last_undegraded":"2024-08-17T02:25:14.672818+0000","last_fullsized":"2024-08-17T02:25:14.672818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:34.355244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670142+0000","last_change":"2024-08-17T02:25:13.687912+0000","last_active":"2024-08-17T02:25:14.670142+0000","last_peered":"2024-08-17T02:25:14.670142+0000","last_clean":"2024-08-17T02:25:14.670142+0000","last_became_active":"2024-08-17T02:25:13.687603+0000","last_became_peered":"2024-08-17T02:25:13.687603+0000","last_unstale":"2024-08-17T02:25:14.670142+0000","last_undegraded":"2024-08-17T02:25:14.670142+0000","last_fullsized":"2024-08-17T02:25:14.670142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:33.349779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679271+0000","last_change":"2024-08-17T02:25:14.674759+0000","last_active":"2024-08-17T02:25:14.679271+0000","last_peered":"2024-08-17T02:25:14.679271+0000","last_clean":"2024-08-17T02:25:14.679271+0000","last_became_active":"2024-08-17T02:25:14.674396+0000","last_became_peered":"2024-08-17T02:25:14.674396+0000","last_unstale":"2024-08-17T02:25:14.679271+0000","last_undegraded":"2024-08-17T02:25:14.679271+0000","last_fullsized":"2024-08-17T02:25:14.679271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671878+0000","last_change":"2024-08-17T02:25:13.678511+0000","last_active":"2024-08-17T02:25:14.671878+0000","last_peered":"2024-08-17T02:25:14.671878+0000","last_clean":"2024-08-17T02:25:14.671878+0000","last_became_active":"2024-08-17T02:25:13.678154+0000","last_became_peered":"2024-08-17T02:25:13.678154+0000","last_unstale":"2024-08-17T02:25:14.671878+0000","last_undegraded":"2024-08-17T02:25:14.671878+0000","last_fullsized":"2024-08-17T02:25:14.671878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670650+0000","last_change":"2024-08-17T02:25:14.664508+0000","last_active":"2024-08-17T02:25:14.670650+0000","last_peered":"2024-08-17T02:25:14.670650+0000","last_clean":"2024-08-17T02:25:14.670650+0000","last_became_active":"2024-08-17T02:25:14.664227+0000","last_became_peered":"2024-08-17T02:25:14.664227+0000","last_unstale":"2024-08-17T02:25:14.670650+0000","last_undegraded":"2024-08-17T02:25:14.670650+0000","last_fullsized":"2024-08-17T02:25:14.670650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700270+0000","last_change":"2024-08-17T02:25:13.688660+0000","last_active":"2024-08-17T02:25:14.700270+0000","last_peered":"2024-08-17T02:25:14.700270+0000","last_clean":"2024-08-17T02:25:14.700270+0000","last_became_active":"2024-08-17T02:25:13.688164+0000","last_became_peered":"2024-08-17T02:25:13.688164+0000","last_unstale":"2024-08-17T02:25:14.700270+0000","last_undegraded":"2024-08-17T02:25:14.700270+0000","last_fullsized":"2024-08-17T02:25:14.700270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:48.757464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.685034+0000","last_change":"2024-08-17T02:25:14.673503+0000","last_active":"2024-08-17T02:25:14.685034+0000","last_peered":"2024-08-17T02:25:14.685034+0000","last_clean":"2024-08-17T02:25:14.685034+0000","last_became_active":"2024-08-17T02:25:14.673240+0000","last_became_peered":"2024-08-17T02:25:14.673240+0000","last_unstale":"2024-08-17T02:25:14.685034+0000","last_undegraded":"2024-08-17T02:25:14.685034+0000","last_fullsized":"2024-08-17T02:25:14.685034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683703+0000","last_change":"2024-08-17T02:25:14.676439+0000","last_active":"2024-08-17T02:25:14.683703+0000","last_peered":"2024-08-17T02:25:14.683703+0000","last_clean":"2024-08-17T02:25:14.683703+0000","last_became_active":"2024-08-17T02:25:14.676156+0000","last_became_peered":"2024-08-17T02:25:14.676156+0000","last_unstale":"2024-08-17T02:25:14.683703+0000","last_undegraded":"2024-08-17T02:25:14.683703+0000","last_fullsized":"2024-08-17T02:25:14.683703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:19.535692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700344+0000","last_change":"2024-08-17T02:25:13.686099+0000","last_active":"2024-08-17T02:25:14.700344+0000","last_peered":"2024-08-17T02:25:14.700344+0000","last_clean":"2024-08-17T02:25:14.700344+0000","last_became_active":"2024-08-17T02:25:13.685723+0000","last_became_peered":"2024-08-17T02:25:13.685723+0000","last_unstale":"2024-08-17T02:25:14.700344+0000","last_undegraded":"2024-08-17T02:25:14.700344+0000","last_fullsized":"2024-08-17T02:25:14.700344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:06.729225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684455+0000","last_change":"2024-08-17T02:25:14.678735+0000","last_active":"2024-08-17T02:25:14.684455+0000","last_peered":"2024-08-17T02:25:14.684455+0000","last_clean":"2024-08-17T02:25:14.684455+0000","last_became_active":"2024-08-17T02:25:14.676285+0000","last_became_peered":"2024-08-17T02:25:14.676285+0000","last_unstale":"2024-08-17T02:25:14.684455+0000","last_undegraded":"2024-08-17T02:25:14.684455+0000","last_fullsized":"2024-08-17T02:25:14.684455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:22.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700787+0000","last_change":"2024-08-17T02:25:13.686181+0000","last_active":"2024-08-17T02:25:14.700787+0000","last_peered":"2024-08-17T02:25:14.700787+0000","last_clean":"2024-08-17T02:25:14.700787+0000","last_became_active":"2024-08-17T02:25:13.685840+0000","last_became_peered":"2024-08-17T02:25:13.685840+0000","last_unstale":"2024-08-17T02:25:14.700787+0000","last_undegraded":"2024-08-17T02:25:14.700787+0000","last_fullsized":"2024-08-17T02:25:14.700787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681432+0000","last_change":"2024-08-17T02:25:14.677008+0000","last_active":"2024-08-17T02:25:14.681432+0000","last_peered":"2024-08-17T02:25:14.681432+0000","last_clean":"2024-08-17T02:25:14.681432+0000","last_became_active":"2024-08-17T02:25:14.675860+0000","last_became_peered":"2024-08-17T02:25:14.675860+0000","last_unstale":"2024-08-17T02:25:14.681432+0000","last_undegraded":"2024-08-17T02:25:14.681432+0000","last_fullsized":"2024-08-17T02:25:14.681432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699765+0000","last_change":"2024-08-17T02:25:13.680804+0000","last_active":"2024-08-17T02:25:14.699765+0000","last_peered":"2024-08-17T02:25:14.699765+0000","last_clean":"2024-08-17T02:25:14.699765+0000","last_became_active":"2024-08-17T02:25:13.679930+0000","last_became_peered":"2024-08-17T02:25:13.679930+0000","last_unstale":"2024-08-17T02:25:14.699765+0000","last_undegraded":"2024-08-17T02:25:14.699765+0000","last_fullsized":"2024-08-17T02:25:14.699765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.685317+0000","last_change":"2024-08-17T02:25:14.678511+0000","last_active":"2024-08-17T02:25:14.685317+0000","last_peered":"2024-08-17T02:25:14.685317+0000","last_clean":"2024-08-17T02:25:14.685317+0000","last_became_active":"2024-08-17T02:25:14.677265+0000","last_became_peered":"2024-08-17T02:25:14.677265+0000","last_unstale":"2024-08-17T02:25:14.685317+0000","last_undegraded":"2024-08-17T02:25:14.685317+0000","last_fullsized":"2024-08-17T02:25:14.685317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700062+0000","last_change":"2024-08-17T02:25:13.688293+0000","last_active":"2024-08-17T02:25:14.700062+0000","last_peered":"2024-08-17T02:25:14.700062+0000","last_clean":"2024-08-17T02:25:14.700062+0000","last_became_active":"2024-08-17T02:25:13.688046+0000","last_became_peered":"2024-08-17T02:25:13.688046+0000","last_unstale":"2024-08-17T02:25:14.700062+0000","last_undegraded":"2024-08-17T02:25:14.700062+0000","last_fullsized":"2024-08-17T02:25:14.700062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5339999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301728,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070112,"statfs":{"total":96636764160,"available":96327794688,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301716,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070124,"statfs":{"total":96636764160,"available":96327806976,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.931}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4790000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.302}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1709999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.512}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:26.757 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:25:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.944+0000 7f0986400640 1 Processor -- start 2024-08-17T02:25:26.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.944+0000 7f0986400640 1 -- start start 2024-08-17T02:25:26.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.945+0000 7f0986400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f098015a260 0x7f09800b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.945+0000 7f0986400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09800abbf0 0x7f09800adff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.945+0000 7f0986400640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09800adb60 con 0x7f0980096a70 2024-08-17T02:25:26.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.945+0000 7f0986400640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09800975a0 con 0x7f09800abbf0 2024-08-17T02:25:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.945+0000 7f0986400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098015a630 con 0x7f098015a260 2024-08-17T02:25:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.946+0000 7f097fe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09800abbf0 0x7f09800adff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.946+0000 7f097ea00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0980096a70 0x7f09800ab4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33490/0 (socket says 172.21.15.45:33490) 2024-08-17T02:25:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.946+0000 7f097ea00640 1 -- 172.21.15.45:0/2257671537 learned_addr learned my addr 172.21.15.45:0/2257671537 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:26.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.946+0000 7f097f400640 1 --2- 172.21.15.45:0/2257671537 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f098015a260 0x7f09800b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.946+0000 7f097fe00640 1 -- 172.21.15.45:0/2257671537 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f098015a260 msgr2=0x7f09800b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.946+0000 7f097e000640 1 -- 172.21.15.45:0/2257671537 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3857411645 0 0) 0x7f09800adb60 con 0x7f0980096a70 2024-08-17T02:25:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.946+0000 7f097fe00640 1 --2- 172.21.15.45:0/2257671537 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f098015a260 0x7f09800b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.946+0000 7f097fe00640 1 -- 172.21.15.45:0/2257671537 >> v1:172.21.15.45:6789/0 conn(0x7f0980096a70 legacy=0x7f09800ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.946+0000 7f097fe00640 1 -- 172.21.15.45:0/2257671537 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09800b2dc0 con 0x7f09800abbf0 2024-08-17T02:25:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.946+0000 7f097f400640 1 --2- 172.21.15.45:0/2257671537 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f098015a260 0x7f09800b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:26.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.947+0000 7f097fe00640 1 --2- 172.21.15.45:0/2257671537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09800abbf0 0x7f09800adff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0978009e60 tx=0x7f0978009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a53ef8bafe0845 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.947+0000 7f097e000640 1 -- 172.21.15.45:0/2257671537 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978007550 con 0x7f09800abbf0 2024-08-17T02:25:26.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.947+0000 7f097e000640 1 -- 172.21.15.45:0/2257671537 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097802d050 con 0x7f09800abbf0 2024-08-17T02:25:26.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.947+0000 7f097e000640 1 -- 172.21.15.45:0/2257671537 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780078e0 con 0x7f09800abbf0 2024-08-17T02:25:26.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.948+0000 7f0986400640 1 -- 172.21.15.45:0/2257671537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09800abbf0 msgr2=0x7f09800adff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.948+0000 7f0986400640 1 --2- 172.21.15.45:0/2257671537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09800abbf0 0x7f09800adff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0978009e60 tx=0x7f0978009780 comp rx=0 tx=0).stop 2024-08-17T02:25:26.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.948+0000 7f0986400640 1 -- 172.21.15.45:0/2257671537 shutdown_connections 2024-08-17T02:25:26.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.948+0000 7f0986400640 1 --2- 172.21.15.45:0/2257671537 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09800abbf0 0x7f09800adff0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.948+0000 7f0986400640 1 --2- 172.21.15.45:0/2257671537 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f098015a260 0x7f09800b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.948+0000 7f0986400640 1 -- 172.21.15.45:0/2257671537 >> 172.21.15.45:0/2257671537 conn(0x7f09800b3040 msgr2=0x7f09800b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:26.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.948+0000 7f0986400640 1 -- 172.21.15.45:0/2257671537 shutdown_connections 2024-08-17T02:25:26.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.948+0000 7f0986400640 1 -- 172.21.15.45:0/2257671537 wait complete. 2024-08-17T02:25:26.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.949+0000 7f0986400640 1 Processor -- start 2024-08-17T02:25:26.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.950+0000 7f0986400640 1 -- start start 2024-08-17T02:25:26.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.950+0000 7f0986400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0980096a70 0x7f098014d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.950+0000 7f0986400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09800abbf0 0x7f0980158e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.950+0000 7f0986400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098015a260 0x7f098014c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.950+0000 7f0986400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0980151720 con 0x7f098015a260 2024-08-17T02:25:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.950+0000 7f0986400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098014e590 con 0x7f0980096a70 2024-08-17T02:25:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.950+0000 7f0986400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09801519e0 con 0x7f09800abbf0 2024-08-17T02:25:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098015a260 0x7f098014c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098015a260 0x7f098014c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57260/0 (socket says 172.21.15.45:57260) 2024-08-17T02:25:26.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097fe00640 1 -- 172.21.15.45:0/1319049396 learned_addr learned my addr 172.21.15.45:0/1319049396 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:26.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097f400640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0980096a70 0x7f098014d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097ea00640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09800abbf0 0x7f0980158e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097fe00640 1 -- 172.21.15.45:0/1319049396 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09800abbf0 msgr2=0x7f0980158e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097fe00640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09800abbf0 0x7f0980158e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097fe00640 1 -- 172.21.15.45:0/1319049396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0980096a70 msgr2=0x7f098014d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097fe00640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0980096a70 0x7f098014d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097fe00640 1 -- 172.21.15.45:0/1319049396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0978009a20 con 0x7f098015a260 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097f400640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0980096a70 0x7f098014d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.951+0000 7f097ea00640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09800abbf0 0x7f0980158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.952+0000 7f097fe00640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098015a260 0x7f098014c410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0978009e60 tx=0x7f0978037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.952+0000 7f0976a00640 1 -- 172.21.15.45:0/1319049396 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978031960 con 0x7f098015a260 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.952+0000 7f0976a00640 1 -- 172.21.15.45:0/1319049396 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978040070 con 0x7f098015a260 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.952+0000 7f0986400640 1 -- 172.21.15.45:0/1319049396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098014dcf0 con 0x7f098015a260 2024-08-17T02:25:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.952+0000 7f0976a00640 1 -- 172.21.15.45:0/1319049396 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978031d30 con 0x7f098015a260 2024-08-17T02:25:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.952+0000 7f0986400640 1 -- 172.21.15.45:0/1319049396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098014e2b0 con 0x7f098015a260 2024-08-17T02:25:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.953+0000 7f0986400640 1 -- 172.21.15.45:0/1319049396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098014dac0 con 0x7f098015a260 2024-08-17T02:25:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.954+0000 7f0976a00640 1 -- 172.21.15.45:0/1319049396 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0978042030 con 0x7f098015a260 2024-08-17T02:25:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.955+0000 7f0976a00640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0960065150 0x7f0960067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.955+0000 7f0976a00640 1 -- 172.21.15.45:0/1319049396 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f09780a3e50 con 0x7f098015a260 2024-08-17T02:25:26.955 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.955+0000 7f097f400640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0960065150 0x7f0960067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:26.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.955+0000 7f097f400640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0960065150 0x7f0960067600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0970006fd0 tx=0x7f0970008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:26.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:26.958+0000 7f0976a00640 1 -- 172.21.15.45:0/1319049396 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0978071ef0 con 0x7f098015a260 2024-08-17T02:25:27.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.136+0000 7f0986400640 1 -- 172.21.15.45:0/1319049396 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0980151b70 con 0x7f0960065150 2024-08-17T02:25:27.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.143+0000 7f0976a00640 1 -- 172.21.15.45:0/1319049396 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264536 (secure 0 0 0) 0x7f0980151b70 con 0x7f0960065150 2024-08-17T02:25:27.147 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:27.148 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:25:27.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 -- 172.21.15.45:0/1319049396 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0960065150 msgr2=0x7f0960067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0960065150 0x7f0960067600 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0970006fd0 tx=0x7f0970008040 comp rx=0 tx=0).stop 2024-08-17T02:25:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 -- 172.21.15.45:0/1319049396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098015a260 msgr2=0x7f098014c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098015a260 0x7f098014c410 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0978009e60 tx=0x7f0978037000 comp rx=0 tx=0).stop 2024-08-17T02:25:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 -- 172.21.15.45:0/1319049396 shutdown_connections 2024-08-17T02:25:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f098015a260 0x7f098014c410 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0960065150 0x7f0960067600 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09800abbf0 0x7f0980158e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 --2- 172.21.15.45:0/1319049396 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0980096a70 0x7f098014d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 -- 172.21.15.45:0/1319049396 >> 172.21.15.45:0/1319049396 conn(0x7f09800b3040 msgr2=0x7f09800aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 -- 172.21.15.45:0/1319049396 shutdown_connections 2024-08-17T02:25:27.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.147+0000 7f0986400640 1 -- 172.21.15.45:0/1319049396 wait complete. 2024-08-17T02:25:27.163 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-08-17T02:25:25.659664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2398328,"kb_used_data":2824,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752576392,"statfs":{"total":773094113280,"available":770638225408,"internally_reserved":0,"allocated":2891776,"data_stored":1750644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002251"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694749+0000","last_change":"2024-08-17T02:25:14.688635+0000","last_active":"2024-08-17T02:25:14.694749+0000","last_peered":"2024-08-17T02:25:14.694749+0000","last_clean":"2024-08-17T02:25:14.694749+0000","last_became_active":"2024-08-17T02:25:14.688409+0000","last_became_peered":"2024-08-17T02:25:14.688409+0000","last_unstale":"2024-08-17T02:25:14.694749+0000","last_undegraded":"2024-08-17T02:25:14.694749+0000","last_fullsized":"2024-08-17T02:25:14.694749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:32.913252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686216+0000","last_change":"2024-08-17T02:25:14.685522+0000","last_active":"2024-08-17T02:25:14.686216+0000","last_peered":"2024-08-17T02:25:14.686216+0000","last_clean":"2024-08-17T02:25:14.686216+0000","last_became_active":"2024-08-17T02:25:14.685146+0000","last_became_peered":"2024-08-17T02:25:14.685146+0000","last_unstale":"2024-08-17T02:25:14.686216+0000","last_undegraded":"2024-08-17T02:25:14.686216+0000","last_fullsized":"2024-08-17T02:25:14.686216+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.669173+0000","last_change":"2024-08-17T02:25:14.668249+0000","last_active":"2024-08-17T02:25:14.669173+0000","last_peered":"2024-08-17T02:25:14.669173+0000","last_clean":"2024-08-17T02:25:14.669173+0000","last_became_active":"2024-08-17T02:25:14.667916+0000","last_became_peered":"2024-08-17T02:25:14.667916+0000","last_unstale":"2024-08-17T02:25:14.669173+0000","last_undegraded":"2024-08-17T02:25:14.669173+0000","last_fullsized":"2024-08-17T02:25:14.669173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:37.608005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678079+0000","last_change":"2024-08-17T02:25:14.667371+0000","last_active":"2024-08-17T02:25:14.678079+0000","last_peered":"2024-08-17T02:25:14.678079+0000","last_clean":"2024-08-17T02:25:14.678079+0000","last_became_active":"2024-08-17T02:25:14.666507+0000","last_became_peered":"2024-08-17T02:25:14.666507+0000","last_unstale":"2024-08-17T02:25:14.678079+0000","last_undegraded":"2024-08-17T02:25:14.678079+0000","last_fullsized":"2024-08-17T02:25:14.678079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:05:32.913252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.680072+0000","last_change":"2024-08-17T02:25:14.673429+0000","last_active":"2024-08-17T02:25:14.680072+0000","last_peered":"2024-08-17T02:25:14.680072+0000","last_clean":"2024-08-17T02:25:14.680072+0000","last_became_active":"2024-08-17T02:25:14.673116+0000","last_became_peered":"2024-08-17T02:25:14.673116+0000","last_unstale":"2024-08-17T02:25:14.680072+0000","last_undegraded":"2024-08-17T02:25:14.680072+0000","last_fullsized":"2024-08-17T02:25:14.680072+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678094+0000","last_change":"2024-08-17T02:25:14.665820+0000","last_active":"2024-08-17T02:25:14.678094+0000","last_peered":"2024-08-17T02:25:14.678094+0000","last_clean":"2024-08-17T02:25:14.678094+0000","last_became_active":"2024-08-17T02:25:14.665533+0000","last_became_peered":"2024-08-17T02:25:14.665533+0000","last_unstale":"2024-08-17T02:25:14.678094+0000","last_undegraded":"2024-08-17T02:25:14.678094+0000","last_fullsized":"2024-08-17T02:25:14.678094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:07.562236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693398+0000","last_change":"2024-08-17T02:25:14.685204+0000","last_active":"2024-08-17T02:25:14.693398+0000","last_peered":"2024-08-17T02:25:14.693398+0000","last_clean":"2024-08-17T02:25:14.693398+0000","last_became_active":"2024-08-17T02:25:14.684913+0000","last_became_peered":"2024-08-17T02:25:14.684913+0000","last_unstale":"2024-08-17T02:25:14.693398+0000","last_undegraded":"2024-08-17T02:25:14.693398+0000","last_fullsized":"2024-08-17T02:25:14.693398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:27:44.886508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679252+0000","last_change":"2024-08-17T02:25:14.671977+0000","last_active":"2024-08-17T02:25:14.679252+0000","last_peered":"2024-08-17T02:25:14.679252+0000","last_clean":"2024-08-17T02:25:14.679252+0000","last_became_active":"2024-08-17T02:25:14.671715+0000","last_became_peered":"2024-08-17T02:25:14.671715+0000","last_unstale":"2024-08-17T02:25:14.679252+0000","last_undegraded":"2024-08-17T02:25:14.679252+0000","last_fullsized":"2024-08-17T02:25:14.679252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690194+0000","last_change":"2024-08-17T02:25:14.682177+0000","last_active":"2024-08-17T02:25:14.690194+0000","last_peered":"2024-08-17T02:25:14.690194+0000","last_clean":"2024-08-17T02:25:14.690194+0000","last_became_active":"2024-08-17T02:25:14.681923+0000","last_became_peered":"2024-08-17T02:25:14.681923+0000","last_unstale":"2024-08-17T02:25:14.690194+0000","last_undegraded":"2024-08-17T02:25:14.690194+0000","last_fullsized":"2024-08-17T02:25:14.690194+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:45:07.562236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689537+0000","last_change":"2024-08-17T02:25:14.684528+0000","last_active":"2024-08-17T02:25:14.689537+0000","last_peered":"2024-08-17T02:25:14.689537+0000","last_clean":"2024-08-17T02:25:14.689537+0000","last_became_active":"2024-08-17T02:25:14.684273+0000","last_became_peered":"2024-08-17T02:25:14.684273+0000","last_unstale":"2024-08-17T02:25:14.689537+0000","last_undegraded":"2024-08-17T02:25:14.689537+0000","last_fullsized":"2024-08-17T02:25:14.689537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693057+0000","last_change":"2024-08-17T02:25:14.687803+0000","last_active":"2024-08-17T02:25:14.693057+0000","last_peered":"2024-08-17T02:25:14.693057+0000","last_clean":"2024-08-17T02:25:14.693057+0000","last_became_active":"2024-08-17T02:25:14.687474+0000","last_became_peered":"2024-08-17T02:25:14.687474+0000","last_unstale":"2024-08-17T02:25:14.693057+0000","last_undegraded":"2024-08-17T02:25:14.693057+0000","last_fullsized":"2024-08-17T02:25:14.693057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694472+0000","last_change":"2024-08-17T02:25:14.688106+0000","last_active":"2024-08-17T02:25:14.694472+0000","last_peered":"2024-08-17T02:25:14.694472+0000","last_clean":"2024-08-17T02:25:14.694472+0000","last_became_active":"2024-08-17T02:25:14.687884+0000","last_became_peered":"2024-08-17T02:25:14.687884+0000","last_unstale":"2024-08-17T02:25:14.694472+0000","last_undegraded":"2024-08-17T02:25:14.694472+0000","last_fullsized":"2024-08-17T02:25:14.694472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:07.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678556+0000","last_change":"2024-08-17T02:25:14.675832+0000","last_active":"2024-08-17T02:25:14.678556+0000","last_peered":"2024-08-17T02:25:14.678556+0000","last_clean":"2024-08-17T02:25:14.678556+0000","last_became_active":"2024-08-17T02:25:14.674356+0000","last_became_peered":"2024-08-17T02:25:14.674356+0000","last_unstale":"2024-08-17T02:25:14.678556+0000","last_undegraded":"2024-08-17T02:25:14.678556+0000","last_fullsized":"2024-08-17T02:25:14.678556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686167+0000","last_change":"2024-08-17T02:25:14.682873+0000","last_active":"2024-08-17T02:25:14.686167+0000","last_peered":"2024-08-17T02:25:14.686167+0000","last_clean":"2024-08-17T02:25:14.686167+0000","last_became_active":"2024-08-17T02:25:14.678077+0000","last_became_peered":"2024-08-17T02:25:14.678077+0000","last_unstale":"2024-08-17T02:25:14.686167+0000","last_undegraded":"2024-08-17T02:25:14.686167+0000","last_fullsized":"2024-08-17T02:25:14.686167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:16:34.226633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678037+0000","last_change":"2024-08-17T02:25:14.675577+0000","last_active":"2024-08-17T02:25:14.678037+0000","last_peered":"2024-08-17T02:25:14.678037+0000","last_clean":"2024-08-17T02:25:14.678037+0000","last_became_active":"2024-08-17T02:25:14.675346+0000","last_became_peered":"2024-08-17T02:25:14.675346+0000","last_unstale":"2024-08-17T02:25:14.678037+0000","last_undegraded":"2024-08-17T02:25:14.678037+0000","last_fullsized":"2024-08-17T02:25:14.678037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678546+0000","last_change":"2024-08-17T02:25:14.664639+0000","last_active":"2024-08-17T02:25:14.678546+0000","last_peered":"2024-08-17T02:25:14.678546+0000","last_clean":"2024-08-17T02:25:14.678546+0000","last_became_active":"2024-08-17T02:25:14.664238+0000","last_became_peered":"2024-08-17T02:25:14.664238+0000","last_unstale":"2024-08-17T02:25:14.678546+0000","last_undegraded":"2024-08-17T02:25:14.678546+0000","last_fullsized":"2024-08-17T02:25:14.678546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681035+0000","last_change":"2024-08-17T02:25:14.673971+0000","last_active":"2024-08-17T02:25:14.681035+0000","last_peered":"2024-08-17T02:25:14.681035+0000","last_clean":"2024-08-17T02:25:14.681035+0000","last_became_active":"2024-08-17T02:25:14.673681+0000","last_became_peered":"2024-08-17T02:25:14.673681+0000","last_unstale":"2024-08-17T02:25:14.681035+0000","last_undegraded":"2024-08-17T02:25:14.681035+0000","last_fullsized":"2024-08-17T02:25:14.681035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681015+0000","last_change":"2024-08-17T02:25:14.679222+0000","last_active":"2024-08-17T02:25:14.681015+0000","last_peered":"2024-08-17T02:25:14.681015+0000","last_clean":"2024-08-17T02:25:14.681015+0000","last_became_active":"2024-08-17T02:25:14.678854+0000","last_became_peered":"2024-08-17T02:25:14.678854+0000","last_unstale":"2024-08-17T02:25:14.681015+0000","last_undegraded":"2024-08-17T02:25:14.681015+0000","last_fullsized":"2024-08-17T02:25:14.681015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:49.762929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690292+0000","last_change":"2024-08-17T02:25:14.675322+0000","last_active":"2024-08-17T02:25:14.690292+0000","last_peered":"2024-08-17T02:25:14.690292+0000","last_clean":"2024-08-17T02:25:14.690292+0000","last_became_active":"2024-08-17T02:25:14.675062+0000","last_became_peered":"2024-08-17T02:25:14.675062+0000","last_unstale":"2024-08-17T02:25:14.690292+0000","last_undegraded":"2024-08-17T02:25:14.690292+0000","last_fullsized":"2024-08-17T02:25:14.690292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693140+0000","last_change":"2024-08-17T02:25:14.688691+0000","last_active":"2024-08-17T02:25:14.693140+0000","last_peered":"2024-08-17T02:25:14.693140+0000","last_clean":"2024-08-17T02:25:14.693140+0000","last_became_active":"2024-08-17T02:25:14.688426+0000","last_became_peered":"2024-08-17T02:25:14.688426+0000","last_unstale":"2024-08-17T02:25:14.693140+0000","last_undegraded":"2024-08-17T02:25:14.693140+0000","last_fullsized":"2024-08-17T02:25:14.693140+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684959+0000","last_change":"2024-08-17T02:25:14.677713+0000","last_active":"2024-08-17T02:25:14.684959+0000","last_peered":"2024-08-17T02:25:14.684959+0000","last_clean":"2024-08-17T02:25:14.684959+0000","last_became_active":"2024-08-17T02:25:14.676684+0000","last_became_peered":"2024-08-17T02:25:14.676684+0000","last_unstale":"2024-08-17T02:25:14.684959+0000","last_undegraded":"2024-08-17T02:25:14.684959+0000","last_fullsized":"2024-08-17T02:25:14.684959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:19:52.028804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683534+0000","last_change":"2024-08-17T02:25:14.677693+0000","last_active":"2024-08-17T02:25:14.683534+0000","last_peered":"2024-08-17T02:25:14.683534+0000","last_clean":"2024-08-17T02:25:14.683534+0000","last_became_active":"2024-08-17T02:25:14.675085+0000","last_became_peered":"2024-08-17T02:25:14.675085+0000","last_unstale":"2024-08-17T02:25:14.683534+0000","last_undegraded":"2024-08-17T02:25:14.683534+0000","last_fullsized":"2024-08-17T02:25:14.683534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686732+0000","last_change":"2024-08-17T02:25:14.680570+0000","last_active":"2024-08-17T02:25:14.686732+0000","last_peered":"2024-08-17T02:25:14.686732+0000","last_clean":"2024-08-17T02:25:14.686732+0000","last_became_active":"2024-08-17T02:25:14.680331+0000","last_became_peered":"2024-08-17T02:25:14.680331+0000","last_unstale":"2024-08-17T02:25:14.686732+0000","last_undegraded":"2024-08-17T02:25:14.686732+0000","last_fullsized":"2024-08-17T02:25:14.686732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678558+0000","last_change":"2024-08-17T02:25:14.669965+0000","last_active":"2024-08-17T02:25:14.678558+0000","last_peered":"2024-08-17T02:25:14.678558+0000","last_clean":"2024-08-17T02:25:14.678558+0000","last_became_active":"2024-08-17T02:25:14.669710+0000","last_became_peered":"2024-08-17T02:25:14.669710+0000","last_unstale":"2024-08-17T02:25:14.678558+0000","last_undegraded":"2024-08-17T02:25:14.678558+0000","last_fullsized":"2024-08-17T02:25:14.678558+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T07:01:51.364710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686777+0000","last_change":"2024-08-17T02:25:14.680996+0000","last_active":"2024-08-17T02:25:14.686777+0000","last_peered":"2024-08-17T02:25:14.686777+0000","last_clean":"2024-08-17T02:25:14.686777+0000","last_became_active":"2024-08-17T02:25:14.680672+0000","last_became_peered":"2024-08-17T02:25:14.680672+0000","last_unstale":"2024-08-17T02:25:14.686777+0000","last_undegraded":"2024-08-17T02:25:14.686777+0000","last_fullsized":"2024-08-17T02:25:14.686777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686709+0000","last_change":"2024-08-17T02:25:14.682018+0000","last_active":"2024-08-17T02:25:14.686709+0000","last_peered":"2024-08-17T02:25:14.686709+0000","last_clean":"2024-08-17T02:25:14.686709+0000","last_became_active":"2024-08-17T02:25:14.681624+0000","last_became_peered":"2024-08-17T02:25:14.681624+0000","last_unstale":"2024-08-17T02:25:14.686709+0000","last_undegraded":"2024-08-17T02:25:14.686709+0000","last_fullsized":"2024-08-17T02:25:14.686709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.674157+0000","last_change":"2024-08-17T02:25:14.673348+0000","last_active":"2024-08-17T02:25:14.674157+0000","last_peered":"2024-08-17T02:25:14.674157+0000","last_clean":"2024-08-17T02:25:14.674157+0000","last_became_active":"2024-08-17T02:25:14.672984+0000","last_became_peered":"2024-08-17T02:25:14.672984+0000","last_unstale":"2024-08-17T02:25:14.674157+0000","last_undegraded":"2024-08-17T02:25:14.674157+0000","last_fullsized":"2024-08-17T02:25:14.674157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686798+0000","last_change":"2024-08-17T02:25:14.681879+0000","last_active":"2024-08-17T02:25:14.686798+0000","last_peered":"2024-08-17T02:25:14.686798+0000","last_clean":"2024-08-17T02:25:14.686798+0000","last_became_active":"2024-08-17T02:25:14.681545+0000","last_became_peered":"2024-08-17T02:25:14.681545+0000","last_unstale":"2024-08-17T02:25:14.686798+0000","last_undegraded":"2024-08-17T02:25:14.686798+0000","last_fullsized":"2024-08-17T02:25:14.686798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:59.372660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684978+0000","last_change":"2024-08-17T02:25:14.680092+0000","last_active":"2024-08-17T02:25:14.684978+0000","last_peered":"2024-08-17T02:25:14.684978+0000","last_clean":"2024-08-17T02:25:14.684978+0000","last_became_active":"2024-08-17T02:25:14.677406+0000","last_became_peered":"2024-08-17T02:25:14.677406+0000","last_unstale":"2024-08-17T02:25:14.684978+0000","last_undegraded":"2024-08-17T02:25:14.684978+0000","last_fullsized":"2024-08-17T02:25:14.684978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:12.662553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678115+0000","last_change":"2024-08-17T02:25:14.668666+0000","last_active":"2024-08-17T02:25:14.678115+0000","last_peered":"2024-08-17T02:25:14.678115+0000","last_clean":"2024-08-17T02:25:14.678115+0000","last_became_active":"2024-08-17T02:25:14.668347+0000","last_became_peered":"2024-08-17T02:25:14.668347+0000","last_unstale":"2024-08-17T02:25:14.678115+0000","last_undegraded":"2024-08-17T02:25:14.678115+0000","last_fullsized":"2024-08-17T02:25:14.678115+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:27:44.886508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670824+0000","last_change":"2024-08-17T02:25:14.668138+0000","last_active":"2024-08-17T02:25:14.670824+0000","last_peered":"2024-08-17T02:25:14.670824+0000","last_clean":"2024-08-17T02:25:14.670824+0000","last_became_active":"2024-08-17T02:25:14.667760+0000","last_became_peered":"2024-08-17T02:25:14.667760+0000","last_unstale":"2024-08-17T02:25:14.670824+0000","last_undegraded":"2024-08-17T02:25:14.670824+0000","last_fullsized":"2024-08-17T02:25:14.670824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:07.734690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683761+0000","last_change":"2024-08-17T02:25:14.674636+0000","last_active":"2024-08-17T02:25:14.683761+0000","last_peered":"2024-08-17T02:25:14.683761+0000","last_clean":"2024-08-17T02:25:14.683761+0000","last_became_active":"2024-08-17T02:25:14.674133+0000","last_became_peered":"2024-08-17T02:25:14.674133+0000","last_unstale":"2024-08-17T02:25:14.683761+0000","last_undegraded":"2024-08-17T02:25:14.683761+0000","last_fullsized":"2024-08-17T02:25:14.683761+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689013+0000","last_change":"2024-08-17T02:25:14.677807+0000","last_active":"2024-08-17T02:25:14.689013+0000","last_peered":"2024-08-17T02:25:14.689013+0000","last_clean":"2024-08-17T02:25:14.689013+0000","last_became_active":"2024-08-17T02:25:14.677600+0000","last_became_peered":"2024-08-17T02:25:14.677600+0000","last_unstale":"2024-08-17T02:25:14.689013+0000","last_undegraded":"2024-08-17T02:25:14.689013+0000","last_fullsized":"2024-08-17T02:25:14.689013+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:47:20.793789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700661+0000","last_change":"2024-08-17T02:25:13.676038+0000","last_active":"2024-08-17T02:25:14.700661+0000","last_peered":"2024-08-17T02:25:14.700661+0000","last_clean":"2024-08-17T02:25:14.700661+0000","last_became_active":"2024-08-17T02:25:13.675729+0000","last_became_peered":"2024-08-17T02:25:13.675729+0000","last_unstale":"2024-08-17T02:25:14.700661+0000","last_undegraded":"2024-08-17T02:25:14.700661+0000","last_fullsized":"2024-08-17T02:25:14.700661+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684995+0000","last_change":"2024-08-17T02:25:14.680735+0000","last_active":"2024-08-17T02:25:14.684995+0000","last_peered":"2024-08-17T02:25:14.684995+0000","last_clean":"2024-08-17T02:25:14.684995+0000","last_became_active":"2024-08-17T02:25:14.679254+0000","last_became_peered":"2024-08-17T02:25:14.679254+0000","last_unstale":"2024-08-17T02:25:14.684995+0000","last_undegraded":"2024-08-17T02:25:14.684995+0000","last_fullsized":"2024-08-17T02:25:14.684995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700214+0000","last_change":"2024-08-17T02:25:13.685739+0000","last_active":"2024-08-17T02:25:14.700214+0000","last_peered":"2024-08-17T02:25:14.700214+0000","last_clean":"2024-08-17T02:25:14.700214+0000","last_became_active":"2024-08-17T02:25:13.685479+0000","last_became_peered":"2024-08-17T02:25:13.685479+0000","last_unstale":"2024-08-17T02:25:14.700214+0000","last_undegraded":"2024-08-17T02:25:14.700214+0000","last_fullsized":"2024-08-17T02:25:14.700214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660450+0000","last_change":"2024-08-17T02:25:13.674789+0000","last_active":"2024-08-17T02:25:14.660450+0000","last_peered":"2024-08-17T02:25:14.660450+0000","last_clean":"2024-08-17T02:25:14.660450+0000","last_became_active":"2024-08-17T02:25:13.674512+0000","last_became_peered":"2024-08-17T02:25:13.674512+0000","last_unstale":"2024-08-17T02:25:14.660450+0000","last_undegraded":"2024-08-17T02:25:14.660450+0000","last_fullsized":"2024-08-17T02:25:14.660450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671875+0000","last_change":"2024-08-17T02:25:14.663923+0000","last_active":"2024-08-17T02:25:14.671875+0000","last_peered":"2024-08-17T02:25:14.671875+0000","last_clean":"2024-08-17T02:25:14.671875+0000","last_became_active":"2024-08-17T02:25:14.663671+0000","last_became_peered":"2024-08-17T02:25:14.663671+0000","last_unstale":"2024-08-17T02:25:14.671875+0000","last_undegraded":"2024-08-17T02:25:14.671875+0000","last_fullsized":"2024-08-17T02:25:14.671875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.659542+0000","last_change":"2024-08-17T02:25:13.679503+0000","last_active":"2024-08-17T02:25:14.659542+0000","last_peered":"2024-08-17T02:25:14.659542+0000","last_clean":"2024-08-17T02:25:14.659542+0000","last_became_active":"2024-08-17T02:25:13.679226+0000","last_became_peered":"2024-08-17T02:25:13.679226+0000","last_unstale":"2024-08-17T02:25:14.659542+0000","last_undegraded":"2024-08-17T02:25:14.659542+0000","last_fullsized":"2024-08-17T02:25:14.659542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678019+0000","last_change":"2024-08-17T02:25:14.675096+0000","last_active":"2024-08-17T02:25:14.678019+0000","last_peered":"2024-08-17T02:25:14.678019+0000","last_clean":"2024-08-17T02:25:14.678019+0000","last_became_active":"2024-08-17T02:25:14.672309+0000","last_became_peered":"2024-08-17T02:25:14.672309+0000","last_unstale":"2024-08-17T02:25:14.678019+0000","last_undegraded":"2024-08-17T02:25:14.678019+0000","last_fullsized":"2024-08-17T02:25:14.678019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:31:20.940949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.676600+0000","last_change":"2024-08-17T02:25:13.676652+0000","last_active":"2024-08-17T02:25:14.676600+0000","last_peered":"2024-08-17T02:25:14.676600+0000","last_clean":"2024-08-17T02:25:14.676600+0000","last_became_active":"2024-08-17T02:25:13.676364+0000","last_became_peered":"2024-08-17T02:25:13.676364+0000","last_unstale":"2024-08-17T02:25:14.676600+0000","last_undegraded":"2024-08-17T02:25:14.676600+0000","last_fullsized":"2024-08-17T02:25:14.676600+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.682522+0000","last_change":"2024-08-17T02:25:14.672988+0000","last_active":"2024-08-17T02:25:14.682522+0000","last_peered":"2024-08-17T02:25:14.682522+0000","last_clean":"2024-08-17T02:25:14.682522+0000","last_became_active":"2024-08-17T02:25:14.672662+0000","last_became_peered":"2024-08-17T02:25:14.672662+0000","last_unstale":"2024-08-17T02:25:14.682522+0000","last_undegraded":"2024-08-17T02:25:14.682522+0000","last_fullsized":"2024-08-17T02:25:14.682522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658744+0000","last_change":"2024-08-17T02:25:13.676993+0000","last_active":"2024-08-17T02:25:14.658744+0000","last_peered":"2024-08-17T02:25:14.658744+0000","last_clean":"2024-08-17T02:25:14.658744+0000","last_became_active":"2024-08-17T02:25:13.674529+0000","last_became_peered":"2024-08-17T02:25:13.674529+0000","last_unstale":"2024-08-17T02:25:14.658744+0000","last_undegraded":"2024-08-17T02:25:14.658744+0000","last_fullsized":"2024-08-17T02:25:14.658744+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681456+0000","last_change":"2024-08-17T02:25:14.677046+0000","last_active":"2024-08-17T02:25:14.681456+0000","last_peered":"2024-08-17T02:25:14.681456+0000","last_clean":"2024-08-17T02:25:14.681456+0000","last_became_active":"2024-08-17T02:25:14.676726+0000","last_became_peered":"2024-08-17T02:25:14.676726+0000","last_unstale":"2024-08-17T02:25:14.681456+0000","last_undegraded":"2024-08-17T02:25:14.681456+0000","last_fullsized":"2024-08-17T02:25:14.681456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700073+0000","last_change":"2024-08-17T02:25:13.685185+0000","last_active":"2024-08-17T02:25:14.700073+0000","last_peered":"2024-08-17T02:25:14.700073+0000","last_clean":"2024-08-17T02:25:14.700073+0000","last_became_active":"2024-08-17T02:25:13.684855+0000","last_became_peered":"2024-08-17T02:25:13.684855+0000","last_unstale":"2024-08-17T02:25:14.700073+0000","last_undegraded":"2024-08-17T02:25:14.700073+0000","last_fullsized":"2024-08-17T02:25:14.700073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689679+0000","last_change":"2024-08-17T02:25:14.684052+0000","last_active":"2024-08-17T02:25:14.689679+0000","last_peered":"2024-08-17T02:25:14.689679+0000","last_clean":"2024-08-17T02:25:14.689679+0000","last_became_active":"2024-08-17T02:25:14.682595+0000","last_became_peered":"2024-08-17T02:25:14.682595+0000","last_unstale":"2024-08-17T02:25:14.689679+0000","last_undegraded":"2024-08-17T02:25:14.689679+0000","last_fullsized":"2024-08-17T02:25:14.689679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:49.693684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.702862+0000","last_change":"2024-08-17T02:25:13.679399+0000","last_active":"2024-08-17T02:25:14.702862+0000","last_peered":"2024-08-17T02:25:14.702862+0000","last_clean":"2024-08-17T02:25:14.702862+0000","last_became_active":"2024-08-17T02:25:13.679142+0000","last_became_peered":"2024-08-17T02:25:13.679142+0000","last_unstale":"2024-08-17T02:25:14.702862+0000","last_undegraded":"2024-08-17T02:25:14.702862+0000","last_fullsized":"2024-08-17T02:25:14.702862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.690311+0000","last_change":"2024-08-17T02:25:14.682175+0000","last_active":"2024-08-17T02:25:14.690311+0000","last_peered":"2024-08-17T02:25:14.690311+0000","last_clean":"2024-08-17T02:25:14.690311+0000","last_became_active":"2024-08-17T02:25:14.681498+0000","last_became_peered":"2024-08-17T02:25:14.681498+0000","last_unstale":"2024-08-17T02:25:14.690311+0000","last_undegraded":"2024-08-17T02:25:14.690311+0000","last_fullsized":"2024-08-17T02:25:14.690311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699519+0000","last_change":"2024-08-17T02:25:13.681889+0000","last_active":"2024-08-17T02:25:14.699519+0000","last_peered":"2024-08-17T02:25:14.699519+0000","last_clean":"2024-08-17T02:25:14.699519+0000","last_became_active":"2024-08-17T02:25:13.681485+0000","last_became_peered":"2024-08-17T02:25:13.681485+0000","last_unstale":"2024-08-17T02:25:14.699519+0000","last_undegraded":"2024-08-17T02:25:14.699519+0000","last_fullsized":"2024-08-17T02:25:14.699519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683304+0000","last_change":"2024-08-17T02:25:14.678042+0000","last_active":"2024-08-17T02:25:14.683304+0000","last_peered":"2024-08-17T02:25:14.683304+0000","last_clean":"2024-08-17T02:25:14.683304+0000","last_became_active":"2024-08-17T02:25:14.677441+0000","last_became_peered":"2024-08-17T02:25:14.677441+0000","last_unstale":"2024-08-17T02:25:14.683304+0000","last_undegraded":"2024-08-17T02:25:14.683304+0000","last_fullsized":"2024-08-17T02:25:14.683304+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:15:34.726799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658041+0000","last_change":"2024-08-17T02:25:13.672280+0000","last_active":"2024-08-17T02:25:14.658041+0000","last_peered":"2024-08-17T02:25:14.658041+0000","last_clean":"2024-08-17T02:25:14.658041+0000","last_became_active":"2024-08-17T02:25:13.672021+0000","last_became_peered":"2024-08-17T02:25:13.672021+0000","last_unstale":"2024-08-17T02:25:14.658041+0000","last_undegraded":"2024-08-17T02:25:14.658041+0000","last_fullsized":"2024-08-17T02:25:14.658041+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694737+0000","last_change":"2024-08-17T02:25:14.690951+0000","last_active":"2024-08-17T02:25:14.694737+0000","last_peered":"2024-08-17T02:25:14.694737+0000","last_clean":"2024-08-17T02:25:14.694737+0000","last_became_active":"2024-08-17T02:25:14.690640+0000","last_became_peered":"2024-08-17T02:25:14.690640+0000","last_unstale":"2024-08-17T02:25:14.694737+0000","last_undegraded":"2024-08-17T02:25:14.694737+0000","last_fullsized":"2024-08-17T02:25:14.694737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:38.177445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.666609+0000","last_change":"2024-08-17T02:25:13.678799+0000","last_active":"2024-08-17T02:25:14.666609+0000","last_peered":"2024-08-17T02:25:14.666609+0000","last_clean":"2024-08-17T02:25:14.666609+0000","last_became_active":"2024-08-17T02:25:13.678338+0000","last_became_peered":"2024-08-17T02:25:13.678338+0000","last_unstale":"2024-08-17T02:25:14.666609+0000","last_undegraded":"2024-08-17T02:25:14.666609+0000","last_fullsized":"2024-08-17T02:25:14.666609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684933+0000","last_change":"2024-08-17T02:25:14.677309+0000","last_active":"2024-08-17T02:25:14.684933+0000","last_peered":"2024-08-17T02:25:14.684933+0000","last_clean":"2024-08-17T02:25:14.684933+0000","last_became_active":"2024-08-17T02:25:14.673828+0000","last_became_peered":"2024-08-17T02:25:14.673828+0000","last_unstale":"2024-08-17T02:25:14.684933+0000","last_undegraded":"2024-08-17T02:25:14.684933+0000","last_fullsized":"2024-08-17T02:25:14.684933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.701579+0000","last_change":"2024-08-17T02:25:13.679207+0000","last_active":"2024-08-17T02:25:14.701579+0000","last_peered":"2024-08-17T02:25:14.701579+0000","last_clean":"2024-08-17T02:25:14.701579+0000","last_became_active":"2024-08-17T02:25:13.678895+0000","last_became_peered":"2024-08-17T02:25:13.678895+0000","last_unstale":"2024-08-17T02:25:14.701579+0000","last_undegraded":"2024-08-17T02:25:14.701579+0000","last_fullsized":"2024-08-17T02:25:14.701579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.693362+0000","last_change":"2024-08-17T02:25:14.684764+0000","last_active":"2024-08-17T02:25:14.693362+0000","last_peered":"2024-08-17T02:25:14.693362+0000","last_clean":"2024-08-17T02:25:14.693362+0000","last_became_active":"2024-08-17T02:25:14.682919+0000","last_became_peered":"2024-08-17T02:25:14.682919+0000","last_unstale":"2024-08-17T02:25:14.693362+0000","last_undegraded":"2024-08-17T02:25:14.693362+0000","last_fullsized":"2024-08-17T02:25:14.693362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:22.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699314+0000","last_change":"2024-08-17T02:25:13.680283+0000","last_active":"2024-08-17T02:25:14.699314+0000","last_peered":"2024-08-17T02:25:14.699314+0000","last_clean":"2024-08-17T02:25:14.699314+0000","last_became_active":"2024-08-17T02:25:13.679891+0000","last_became_peered":"2024-08-17T02:25:13.679891+0000","last_unstale":"2024-08-17T02:25:14.699314+0000","last_undegraded":"2024-08-17T02:25:14.699314+0000","last_fullsized":"2024-08-17T02:25:14.699314+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:48:27.445541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694975+0000","last_change":"2024-08-17T02:25:14.691471+0000","last_active":"2024-08-17T02:25:14.694975+0000","last_peered":"2024-08-17T02:25:14.694975+0000","last_clean":"2024-08-17T02:25:14.694975+0000","last_became_active":"2024-08-17T02:25:14.691171+0000","last_became_peered":"2024-08-17T02:25:14.691171+0000","last_unstale":"2024-08-17T02:25:14.694975+0000","last_undegraded":"2024-08-17T02:25:14.694975+0000","last_fullsized":"2024-08-17T02:25:14.694975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:19.535692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700333+0000","last_change":"2024-08-17T02:25:13.677536+0000","last_active":"2024-08-17T02:25:14.700333+0000","last_peered":"2024-08-17T02:25:14.700333+0000","last_clean":"2024-08-17T02:25:14.700333+0000","last_became_active":"2024-08-17T02:25:13.675183+0000","last_became_peered":"2024-08-17T02:25:13.675183+0000","last_unstale":"2024-08-17T02:25:14.700333+0000","last_undegraded":"2024-08-17T02:25:14.700333+0000","last_fullsized":"2024-08-17T02:25:14.700333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.695063+0000","last_change":"2024-08-17T02:25:14.692018+0000","last_active":"2024-08-17T02:25:14.695063+0000","last_peered":"2024-08-17T02:25:14.695063+0000","last_clean":"2024-08-17T02:25:14.695063+0000","last_became_active":"2024-08-17T02:25:14.691753+0000","last_became_peered":"2024-08-17T02:25:14.691753+0000","last_unstale":"2024-08-17T02:25:14.695063+0000","last_undegraded":"2024-08-17T02:25:14.695063+0000","last_fullsized":"2024-08-17T02:25:14.695063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:57.832736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699649+0000","last_change":"2024-08-17T02:25:13.684009+0000","last_active":"2024-08-17T02:25:14.699649+0000","last_peered":"2024-08-17T02:25:14.699649+0000","last_clean":"2024-08-17T02:25:14.699649+0000","last_became_active":"2024-08-17T02:25:13.683242+0000","last_became_peered":"2024-08-17T02:25:13.683242+0000","last_unstale":"2024-08-17T02:25:14.699649+0000","last_undegraded":"2024-08-17T02:25:14.699649+0000","last_fullsized":"2024-08-17T02:25:14.699649+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:48.757464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.678098+0000","last_change":"2024-08-17T02:25:14.667634+0000","last_active":"2024-08-17T02:25:14.678098+0000","last_peered":"2024-08-17T02:25:14.678098+0000","last_clean":"2024-08-17T02:25:14.678098+0000","last_became_active":"2024-08-17T02:25:14.667363+0000","last_became_peered":"2024-08-17T02:25:14.667363+0000","last_unstale":"2024-08-17T02:25:14.678098+0000","last_undegraded":"2024-08-17T02:25:14.678098+0000","last_fullsized":"2024-08-17T02:25:14.678098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:00:59.372660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660728+0000","last_change":"2024-08-17T02:25:13.668855+0000","last_active":"2024-08-17T02:25:14.660728+0000","last_peered":"2024-08-17T02:25:14.660728+0000","last_clean":"2024-08-17T02:25:14.660728+0000","last_became_active":"2024-08-17T02:25:13.668568+0000","last_became_peered":"2024-08-17T02:25:13.668568+0000","last_unstale":"2024-08-17T02:25:14.660728+0000","last_undegraded":"2024-08-17T02:25:14.660728+0000","last_fullsized":"2024-08-17T02:25:14.660728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.694943+0000","last_change":"2024-08-17T02:25:14.691327+0000","last_active":"2024-08-17T02:25:14.694943+0000","last_peered":"2024-08-17T02:25:14.694943+0000","last_clean":"2024-08-17T02:25:14.694943+0000","last_became_active":"2024-08-17T02:25:14.690760+0000","last_became_peered":"2024-08-17T02:25:14.690760+0000","last_unstale":"2024-08-17T02:25:14.694943+0000","last_undegraded":"2024-08-17T02:25:14.694943+0000","last_fullsized":"2024-08-17T02:25:14.694943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.664056+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:25:14.664056+0000","last_peered":"2024-08-17T02:25:14.664056+0000","last_clean":"2024-08-17T02:25:14.664056+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:25:14.664056+0000","last_undegraded":"2024-08-17T02:25:14.664056+0000","last_fullsized":"2024-08-17T02:25:14.664056+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.657956+0000","last_change":"2024-08-17T02:25:13.671609+0000","last_active":"2024-08-17T02:25:14.657956+0000","last_peered":"2024-08-17T02:25:14.657956+0000","last_clean":"2024-08-17T02:25:14.657956+0000","last_became_active":"2024-08-17T02:25:13.665871+0000","last_became_peered":"2024-08-17T02:25:13.665871+0000","last_unstale":"2024-08-17T02:25:14.657956+0000","last_undegraded":"2024-08-17T02:25:14.657956+0000","last_fullsized":"2024-08-17T02:25:14.657956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:20:37.562251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679635+0000","last_change":"2024-08-17T02:25:14.671245+0000","last_active":"2024-08-17T02:25:14.679635+0000","last_peered":"2024-08-17T02:25:14.679635+0000","last_clean":"2024-08-17T02:25:14.679635+0000","last_became_active":"2024-08-17T02:25:14.670965+0000","last_became_peered":"2024-08-17T02:25:14.670965+0000","last_unstale":"2024-08-17T02:25:14.679635+0000","last_undegraded":"2024-08-17T02:25:14.679635+0000","last_fullsized":"2024-08-17T02:25:14.679635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.663915+0000","last_change":"2024-08-17T02:25:13.687566+0000","last_active":"2024-08-17T02:25:14.663915+0000","last_peered":"2024-08-17T02:25:14.663915+0000","last_clean":"2024-08-17T02:25:14.663915+0000","last_became_active":"2024-08-17T02:25:13.687289+0000","last_became_peered":"2024-08-17T02:25:13.687289+0000","last_unstale":"2024-08-17T02:25:14.663915+0000","last_undegraded":"2024-08-17T02:25:14.663915+0000","last_fullsized":"2024-08-17T02:25:14.663915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:31:04.348610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684731+0000","last_change":"2024-08-17T02:25:14.678546+0000","last_active":"2024-08-17T02:25:14.684731+0000","last_peered":"2024-08-17T02:25:14.684731+0000","last_clean":"2024-08-17T02:25:14.684731+0000","last_became_active":"2024-08-17T02:25:14.677779+0000","last_became_peered":"2024-08-17T02:25:14.677779+0000","last_unstale":"2024-08-17T02:25:14.684731+0000","last_undegraded":"2024-08-17T02:25:14.684731+0000","last_fullsized":"2024-08-17T02:25:14.684731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.660654+0000","last_change":"2024-08-17T02:25:13.668305+0000","last_active":"2024-08-17T02:25:14.660654+0000","last_peered":"2024-08-17T02:25:14.660654+0000","last_clean":"2024-08-17T02:25:14.660654+0000","last_became_active":"2024-08-17T02:25:13.667891+0000","last_became_peered":"2024-08-17T02:25:13.667891+0000","last_unstale":"2024-08-17T02:25:14.660654+0000","last_undegraded":"2024-08-17T02:25:14.660654+0000","last_fullsized":"2024-08-17T02:25:14.660654+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.672921+0000","last_change":"2024-08-17T02:25:14.671227+0000","last_active":"2024-08-17T02:25:14.672921+0000","last_peered":"2024-08-17T02:25:14.672921+0000","last_clean":"2024-08-17T02:25:14.672921+0000","last_became_active":"2024-08-17T02:25:14.670957+0000","last_became_peered":"2024-08-17T02:25:14.670957+0000","last_unstale":"2024-08-17T02:25:14.672921+0000","last_undegraded":"2024-08-17T02:25:14.672921+0000","last_fullsized":"2024-08-17T02:25:14.672921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.658042+0000","last_change":"2024-08-17T02:25:13.682523+0000","last_active":"2024-08-17T02:25:14.658042+0000","last_peered":"2024-08-17T02:25:14.658042+0000","last_clean":"2024-08-17T02:25:14.658042+0000","last_became_active":"2024-08-17T02:25:13.681263+0000","last_became_peered":"2024-08-17T02:25:13.681263+0000","last_unstale":"2024-08-17T02:25:14.658042+0000","last_undegraded":"2024-08-17T02:25:14.658042+0000","last_fullsized":"2024-08-17T02:25:14.658042+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:28:38.166305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.689867+0000","last_change":"2024-08-17T02:25:14.684673+0000","last_active":"2024-08-17T02:25:14.689867+0000","last_peered":"2024-08-17T02:25:14.689867+0000","last_clean":"2024-08-17T02:25:14.689867+0000","last_became_active":"2024-08-17T02:25:14.684108+0000","last_became_peered":"2024-08-17T02:25:14.684108+0000","last_unstale":"2024-08-17T02:25:14.689867+0000","last_undegraded":"2024-08-17T02:25:14.689867+0000","last_fullsized":"2024-08-17T02:25:14.689867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:49.762929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671095+0000","last_change":"2024-08-17T02:25:13.683299+0000","last_active":"2024-08-17T02:25:14.671095+0000","last_peered":"2024-08-17T02:25:14.671095+0000","last_clean":"2024-08-17T02:25:14.671095+0000","last_became_active":"2024-08-17T02:25:13.682446+0000","last_became_peered":"2024-08-17T02:25:13.682446+0000","last_unstale":"2024-08-17T02:25:14.671095+0000","last_undegraded":"2024-08-17T02:25:14.671095+0000","last_fullsized":"2024-08-17T02:25:14.671095+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:48.688219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683680+0000","last_change":"2024-08-17T02:25:14.670920+0000","last_active":"2024-08-17T02:25:14.683680+0000","last_peered":"2024-08-17T02:25:14.683680+0000","last_clean":"2024-08-17T02:25:14.683680+0000","last_became_active":"2024-08-17T02:25:14.670641+0000","last_became_peered":"2024-08-17T02:25:14.670641+0000","last_unstale":"2024-08-17T02:25:14.683680+0000","last_undegraded":"2024-08-17T02:25:14.683680+0000","last_fullsized":"2024-08-17T02:25:14.683680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:50:41.821996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.666369+0000","last_change":"2024-08-17T02:25:13.686375+0000","last_active":"2024-08-17T02:25:14.666369+0000","last_peered":"2024-08-17T02:25:14.666369+0000","last_clean":"2024-08-17T02:25:14.666369+0000","last_became_active":"2024-08-17T02:25:13.686118+0000","last_became_peered":"2024-08-17T02:25:13.686118+0000","last_unstale":"2024-08-17T02:25:14.666369+0000","last_undegraded":"2024-08-17T02:25:14.666369+0000","last_fullsized":"2024-08-17T02:25:14.666369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:59:48.688219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.673713+0000","last_change":"2024-08-17T02:25:14.672615+0000","last_active":"2024-08-17T02:25:14.673713+0000","last_peered":"2024-08-17T02:25:14.673713+0000","last_clean":"2024-08-17T02:25:14.673713+0000","last_became_active":"2024-08-17T02:25:14.672282+0000","last_became_peered":"2024-08-17T02:25:14.672282+0000","last_unstale":"2024-08-17T02:25:14.673713+0000","last_undegraded":"2024-08-17T02:25:14.673713+0000","last_fullsized":"2024-08-17T02:25:14.673713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:49:13.736168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-08-17T02:25:15.670485+0000","last_change":"2024-08-17T02:25:13.683744+0000","last_active":"2024-08-17T02:25:15.670485+0000","last_peered":"2024-08-17T02:25:15.670485+0000","last_clean":"2024-08-17T02:25:15.670485+0000","last_became_active":"2024-08-17T02:25:13.683299+0000","last_became_peered":"2024-08-17T02:25:13.683299+0000","last_unstale":"2024-08-17T02:25:15.670485+0000","last_undegraded":"2024-08-17T02:25:15.670485+0000","last_fullsized":"2024-08-17T02:25:15.670485+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:06.729225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686757+0000","last_change":"2024-08-17T02:25:14.680936+0000","last_active":"2024-08-17T02:25:14.686757+0000","last_peered":"2024-08-17T02:25:14.686757+0000","last_clean":"2024-08-17T02:25:14.686757+0000","last_became_active":"2024-08-17T02:25:14.680661+0000","last_became_peered":"2024-08-17T02:25:14.680661+0000","last_unstale":"2024-08-17T02:25:14.686757+0000","last_undegraded":"2024-08-17T02:25:14.686757+0000","last_fullsized":"2024-08-17T02:25:14.686757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.701405+0000","last_change":"2024-08-17T02:25:13.677363+0000","last_active":"2024-08-17T02:25:14.701405+0000","last_peered":"2024-08-17T02:25:14.701405+0000","last_clean":"2024-08-17T02:25:14.701405+0000","last_became_active":"2024-08-17T02:25:13.677094+0000","last_became_peered":"2024-08-17T02:25:13.677094+0000","last_unstale":"2024-08-17T02:25:14.701405+0000","last_undegraded":"2024-08-17T02:25:14.701405+0000","last_fullsized":"2024-08-17T02:25:14.701405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:42:16.603896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.686590+0000","last_change":"2024-08-17T02:25:14.683885+0000","last_active":"2024-08-17T02:25:14.686590+0000","last_peered":"2024-08-17T02:25:14.686590+0000","last_clean":"2024-08-17T02:25:14.686590+0000","last_became_active":"2024-08-17T02:25:14.679041+0000","last_became_peered":"2024-08-17T02:25:14.679041+0000","last_unstale":"2024-08-17T02:25:14.686590+0000","last_undegraded":"2024-08-17T02:25:14.686590+0000","last_fullsized":"2024-08-17T02:25:14.686590+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:44:22.261428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.661849+0000","last_change":"2024-08-17T02:25:13.685837+0000","last_active":"2024-08-17T02:25:14.661849+0000","last_peered":"2024-08-17T02:25:14.661849+0000","last_clean":"2024-08-17T02:25:14.661849+0000","last_became_active":"2024-08-17T02:25:13.685565+0000","last_became_peered":"2024-08-17T02:25:13.685565+0000","last_unstale":"2024-08-17T02:25:14.661849+0000","last_undegraded":"2024-08-17T02:25:14.661849+0000","last_fullsized":"2024-08-17T02:25:14.661849+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:33.349779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.672818+0000","last_change":"2024-08-17T02:25:14.668966+0000","last_active":"2024-08-17T02:25:14.672818+0000","last_peered":"2024-08-17T02:25:14.672818+0000","last_clean":"2024-08-17T02:25:14.672818+0000","last_became_active":"2024-08-17T02:25:14.668718+0000","last_became_peered":"2024-08-17T02:25:14.668718+0000","last_unstale":"2024-08-17T02:25:14.672818+0000","last_undegraded":"2024-08-17T02:25:14.672818+0000","last_fullsized":"2024-08-17T02:25:14.672818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:34.355244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670142+0000","last_change":"2024-08-17T02:25:13.687912+0000","last_active":"2024-08-17T02:25:14.670142+0000","last_peered":"2024-08-17T02:25:14.670142+0000","last_clean":"2024-08-17T02:25:14.670142+0000","last_became_active":"2024-08-17T02:25:13.687603+0000","last_became_peered":"2024-08-17T02:25:13.687603+0000","last_unstale":"2024-08-17T02:25:14.670142+0000","last_undegraded":"2024-08-17T02:25:14.670142+0000","last_fullsized":"2024-08-17T02:25:14.670142+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:51:33.349779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.679271+0000","last_change":"2024-08-17T02:25:14.674759+0000","last_active":"2024-08-17T02:25:14.679271+0000","last_peered":"2024-08-17T02:25:14.679271+0000","last_clean":"2024-08-17T02:25:14.679271+0000","last_became_active":"2024-08-17T02:25:14.674396+0000","last_became_peered":"2024-08-17T02:25:14.674396+0000","last_unstale":"2024-08-17T02:25:14.679271+0000","last_undegraded":"2024-08-17T02:25:14.679271+0000","last_fullsized":"2024-08-17T02:25:14.679271+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:22:06.603755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.671878+0000","last_change":"2024-08-17T02:25:13.678511+0000","last_active":"2024-08-17T02:25:14.671878+0000","last_peered":"2024-08-17T02:25:14.671878+0000","last_clean":"2024-08-17T02:25:14.671878+0000","last_became_active":"2024-08-17T02:25:13.678154+0000","last_became_peered":"2024-08-17T02:25:13.678154+0000","last_unstale":"2024-08-17T02:25:14.671878+0000","last_undegraded":"2024-08-17T02:25:14.671878+0000","last_fullsized":"2024-08-17T02:25:14.671878+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.670650+0000","last_change":"2024-08-17T02:25:14.664508+0000","last_active":"2024-08-17T02:25:14.670650+0000","last_peered":"2024-08-17T02:25:14.670650+0000","last_clean":"2024-08-17T02:25:14.670650+0000","last_became_active":"2024-08-17T02:25:14.664227+0000","last_became_peered":"2024-08-17T02:25:14.664227+0000","last_unstale":"2024-08-17T02:25:14.670650+0000","last_undegraded":"2024-08-17T02:25:14.670650+0000","last_fullsized":"2024-08-17T02:25:14.670650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700270+0000","last_change":"2024-08-17T02:25:13.688660+0000","last_active":"2024-08-17T02:25:14.700270+0000","last_peered":"2024-08-17T02:25:14.700270+0000","last_clean":"2024-08-17T02:25:14.700270+0000","last_became_active":"2024-08-17T02:25:13.688164+0000","last_became_peered":"2024-08-17T02:25:13.688164+0000","last_unstale":"2024-08-17T02:25:14.700270+0000","last_undegraded":"2024-08-17T02:25:14.700270+0000","last_fullsized":"2024-08-17T02:25:14.700270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:21:48.757464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.685034+0000","last_change":"2024-08-17T02:25:14.673503+0000","last_active":"2024-08-17T02:25:14.685034+0000","last_peered":"2024-08-17T02:25:14.685034+0000","last_clean":"2024-08-17T02:25:14.685034+0000","last_became_active":"2024-08-17T02:25:14.673240+0000","last_became_peered":"2024-08-17T02:25:14.673240+0000","last_unstale":"2024-08-17T02:25:14.685034+0000","last_undegraded":"2024-08-17T02:25:14.685034+0000","last_fullsized":"2024-08-17T02:25:14.685034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:49:00.194161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.683703+0000","last_change":"2024-08-17T02:25:14.676439+0000","last_active":"2024-08-17T02:25:14.683703+0000","last_peered":"2024-08-17T02:25:14.683703+0000","last_clean":"2024-08-17T02:25:14.683703+0000","last_became_active":"2024-08-17T02:25:14.676156+0000","last_became_peered":"2024-08-17T02:25:14.676156+0000","last_unstale":"2024-08-17T02:25:14.683703+0000","last_undegraded":"2024-08-17T02:25:14.683703+0000","last_fullsized":"2024-08-17T02:25:14.683703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:19.535692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700344+0000","last_change":"2024-08-17T02:25:13.686099+0000","last_active":"2024-08-17T02:25:14.700344+0000","last_peered":"2024-08-17T02:25:14.700344+0000","last_clean":"2024-08-17T02:25:14.700344+0000","last_became_active":"2024-08-17T02:25:13.685723+0000","last_became_peered":"2024-08-17T02:25:13.685723+0000","last_unstale":"2024-08-17T02:25:14.700344+0000","last_undegraded":"2024-08-17T02:25:14.700344+0000","last_fullsized":"2024-08-17T02:25:14.700344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:13:06.729225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.684455+0000","last_change":"2024-08-17T02:25:14.678735+0000","last_active":"2024-08-17T02:25:14.684455+0000","last_peered":"2024-08-17T02:25:14.684455+0000","last_clean":"2024-08-17T02:25:14.684455+0000","last_became_active":"2024-08-17T02:25:14.676285+0000","last_became_peered":"2024-08-17T02:25:14.676285+0000","last_unstale":"2024-08-17T02:25:14.684455+0000","last_undegraded":"2024-08-17T02:25:14.684455+0000","last_fullsized":"2024-08-17T02:25:14.684455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:08:22.365032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700787+0000","last_change":"2024-08-17T02:25:13.686181+0000","last_active":"2024-08-17T02:25:14.700787+0000","last_peered":"2024-08-17T02:25:14.700787+0000","last_clean":"2024-08-17T02:25:14.700787+0000","last_became_active":"2024-08-17T02:25:13.685840+0000","last_became_peered":"2024-08-17T02:25:13.685840+0000","last_unstale":"2024-08-17T02:25:14.700787+0000","last_undegraded":"2024-08-17T02:25:14.700787+0000","last_fullsized":"2024-08-17T02:25:14.700787+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:44:36.602540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.681432+0000","last_change":"2024-08-17T02:25:14.677008+0000","last_active":"2024-08-17T02:25:14.681432+0000","last_peered":"2024-08-17T02:25:14.681432+0000","last_clean":"2024-08-17T02:25:14.681432+0000","last_became_active":"2024-08-17T02:25:14.675860+0000","last_became_peered":"2024-08-17T02:25:14.675860+0000","last_unstale":"2024-08-17T02:25:14.681432+0000","last_undegraded":"2024-08-17T02:25:14.681432+0000","last_fullsized":"2024-08-17T02:25:14.681432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:42:44.244853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.699765+0000","last_change":"2024-08-17T02:25:13.680804+0000","last_active":"2024-08-17T02:25:14.699765+0000","last_peered":"2024-08-17T02:25:14.699765+0000","last_clean":"2024-08-17T02:25:14.699765+0000","last_became_active":"2024-08-17T02:25:13.679930+0000","last_became_peered":"2024-08-17T02:25:13.679930+0000","last_unstale":"2024-08-17T02:25:14.699765+0000","last_undegraded":"2024-08-17T02:25:14.699765+0000","last_fullsized":"2024-08-17T02:25:14.699765+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:47:31.284498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.685317+0000","last_change":"2024-08-17T02:25:14.678511+0000","last_active":"2024-08-17T02:25:14.685317+0000","last_peered":"2024-08-17T02:25:14.685317+0000","last_clean":"2024-08-17T02:25:14.685317+0000","last_became_active":"2024-08-17T02:25:14.677265+0000","last_became_peered":"2024-08-17T02:25:14.677265+0000","last_unstale":"2024-08-17T02:25:14.685317+0000","last_undegraded":"2024-08-17T02:25:14.685317+0000","last_fullsized":"2024-08-17T02:25:14.685317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:13.648231+0000","last_clean_scrub_stamp":"2024-08-17T02:25:13.648231+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:35:32.562891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-08-17T02:25:14.700062+0000","last_change":"2024-08-17T02:25:13.688293+0000","last_active":"2024-08-17T02:25:14.700062+0000","last_peered":"2024-08-17T02:25:14.700062+0000","last_clean":"2024-08-17T02:25:14.700062+0000","last_became_active":"2024-08-17T02:25:13.688046+0000","last_became_peered":"2024-08-17T02:25:13.688046+0000","last_unstale":"2024-08-17T02:25:14.700062+0000","last_undegraded":"2024-08-17T02:25:14.700062+0000","last_fullsized":"2024-08-17T02:25:14.700062+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:12.642766+0000","last_clean_scrub_stamp":"2024-08-17T02:25:12.642766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:10:47.291951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298140,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073700,"statfs":{"total":96636764160,"available":96331468800,"internally_reserved":0,"allocated":802816,"data_stored":661592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297568,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074272,"statfs":{"total":96636764160,"available":96332054528,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5339999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301728,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070112,"statfs":{"total":96636764160,"available":96327794688,"internally_reserved":0,"allocated":217088,"data_stored":72206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301716,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070124,"statfs":{"total":96636764160,"available":96327806976,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.931}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.0800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4790000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.302}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1709999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.512}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301724,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94070116,"statfs":{"total":96636764160,"available":96327798784,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302316,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069524,"statfs":{"total":96636764160,"available":96327192576,"internally_reserved":0,"allocated":811008,"data_stored":661648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:25:27.167 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:25:27.167 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-17T02:25:27.167 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-08-17T02:25:27.167 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-08-17T02:25:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.353+0000 7fb166200640 1 Processor -- start 2024-08-17T02:25:27.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.353+0000 7fb166200640 1 -- start start 2024-08-17T02:25:27.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.354+0000 7fb166200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1600d08d0 0x7fb1600c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.354+0000 7fb166200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1600cb340 0x7fb1601590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.354+0000 7fb166200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1600cb7c0 con 0x7fb160158ce0 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.354+0000 7fb166200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1600cf0c0 con 0x7fb1600cb340 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.354+0000 7fb166200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb160089000 con 0x7fb1600d08d0 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.354+0000 7fb15fe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1600cb340 0x7fb1601590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.354+0000 7fb15f400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb160158ce0 0x7fb1600cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33504/0 (socket says 172.21.15.45:33504) 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.354+0000 7fb15f400640 1 -- 172.21.15.45:0/3599014292 learned_addr learned my addr 172.21.15.45:0/3599014292 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.355+0000 7fb15ea00640 1 --2- 172.21.15.45:0/3599014292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1600d08d0 0x7fb1600c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.355+0000 7fb15fe00640 1 -- 172.21.15.45:0/3599014292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1600d08d0 msgr2=0x7fb1600c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.355+0000 7fb15fe00640 1 --2- 172.21.15.45:0/3599014292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1600d08d0 0x7fb1600c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.355+0000 7fb15fe00640 1 -- 172.21.15.45:0/3599014292 >> v1:172.21.15.45:6789/0 conn(0x7fb160158ce0 legacy=0x7fb1600cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.355+0000 7fb15fe00640 1 -- 172.21.15.45:0/3599014292 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600ceb20 con 0x7fb1600cb340 2024-08-17T02:25:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.355+0000 7fb15e000640 1 -- 172.21.15.45:0/3599014292 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909127871 0 0) 0x7fb1600cb7c0 con 0x7fb160158ce0 2024-08-17T02:25:27.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.356+0000 7fb15fe00640 1 --2- 172.21.15.45:0/3599014292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1600cb340 0x7fb1601590b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb158009e90 tx=0x7fb158009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e568aa28df5dce4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.356+0000 7fb15e000640 1 -- 172.21.15.45:0/3599014292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158007550 con 0x7fb1600cb340 2024-08-17T02:25:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.356+0000 7fb15e000640 1 -- 172.21.15.45:0/3599014292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15802d050 con 0x7fb1600cb340 2024-08-17T02:25:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.356+0000 7fb15e000640 1 -- 172.21.15.45:0/3599014292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1580078e0 con 0x7fb1600cb340 2024-08-17T02:25:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.357+0000 7fb166200640 1 -- 172.21.15.45:0/3599014292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1600cb340 msgr2=0x7fb1601590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.357+0000 7fb166200640 1 --2- 172.21.15.45:0/3599014292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1600cb340 0x7fb1601590b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb158009e90 tx=0x7fb158009780 comp rx=0 tx=0).stop 2024-08-17T02:25:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.357+0000 7fb166200640 1 -- 172.21.15.45:0/3599014292 shutdown_connections 2024-08-17T02:25:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.357+0000 7fb166200640 1 --2- 172.21.15.45:0/3599014292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1600cb340 0x7fb1601590b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.357+0000 7fb166200640 1 --2- 172.21.15.45:0/3599014292 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1600d08d0 0x7fb1600c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.357+0000 7fb166200640 1 -- 172.21.15.45:0/3599014292 >> 172.21.15.45:0/3599014292 conn(0x7fb1600cfdc0 msgr2=0x7fb1600d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.357+0000 7fb166200640 1 -- 172.21.15.45:0/3599014292 shutdown_connections 2024-08-17T02:25:27.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.357+0000 7fb166200640 1 -- 172.21.15.45:0/3599014292 wait complete. 2024-08-17T02:25:27.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.358+0000 7fb166200640 1 Processor -- start 2024-08-17T02:25:27.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.358+0000 7fb166200640 1 -- start start 2024-08-17T02:25:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.359+0000 7fb166200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1600cb340 0x7fb1600b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.359+0000 7fb166200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1600d08d0 0x7fb16014dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.359+0000 7fb166200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb160158ce0 0x7fb1600c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.359+0000 7fb166200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb16014e440 con 0x7fb1600cb340 2024-08-17T02:25:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.359+0000 7fb166200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600c7f40 con 0x7fb160158ce0 2024-08-17T02:25:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.359+0000 7fb166200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1600c7330 con 0x7fb1600d08d0 2024-08-17T02:25:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.359+0000 7fb15f400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1600cb340 0x7fb1600b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.359+0000 7fb15f400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1600cb340 0x7fb1600b5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57266/0 (socket says 172.21.15.45:57266) 2024-08-17T02:25:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb15f400640 1 -- 172.21.15.45:0/338126472 learned_addr learned my addr 172.21.15.45:0/338126472 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb15fe00640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb160158ce0 0x7fb1600c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb15ea00640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1600d08d0 0x7fb16014dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb15f400640 1 -- 172.21.15.45:0/338126472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1600d08d0 msgr2=0x7fb16014dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb15f400640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1600d08d0 0x7fb16014dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb15f400640 1 -- 172.21.15.45:0/338126472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb160158ce0 msgr2=0x7fb1600c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb15f400640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb160158ce0 0x7fb1600c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb15f400640 1 -- 172.21.15.45:0/338126472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb158009a20 con 0x7fb1600cb340 2024-08-17T02:25:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb15ea00640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1600d08d0 0x7fb16014dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb15f400640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1600cb340 0x7fb1600b5120 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb15000c510 tx=0x7fb15000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb156a00640 1 -- 172.21.15.45:0/338126472 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb150005aa0 con 0x7fb1600cb340 2024-08-17T02:25:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb156a00640 1 -- 172.21.15.45:0/338126472 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb150005c00 con 0x7fb1600cb340 2024-08-17T02:25:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb156a00640 1 -- 172.21.15.45:0/338126472 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1500070d0 con 0x7fb1600cb340 2024-08-17T02:25:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.360+0000 7fb166200640 1 -- 172.21.15.45:0/338126472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1600c7610 con 0x7fb1600cb340 2024-08-17T02:25:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.361+0000 7fb166200640 1 -- 172.21.15.45:0/338126472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1600c7bd0 con 0x7fb1600cb340 2024-08-17T02:25:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.362+0000 7fb166200640 1 -- 172.21.15.45:0/338126472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb160064db0 con 0x7fb1600cb340 2024-08-17T02:25:27.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.362+0000 7fb156a00640 1 -- 172.21.15.45:0/338126472 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb150007500 con 0x7fb1600cb340 2024-08-17T02:25:27.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.364+0000 7fb156a00640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb140065180 0x7fb140067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.364+0000 7fb156a00640 1 -- 172.21.15.45:0/338126472 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb150081900 con 0x7fb1600cb340 2024-08-17T02:25:27.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.364+0000 7fb15ea00640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb140065180 0x7fb140067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.364+0000 7fb15ea00640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb140065180 0x7fb140067630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb1601560b0 tx=0x7fb14c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.368+0000 7fb156a00640 1 -- 172.21.15.45:0/338126472 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb15004fa50 con 0x7fb1600cb340 2024-08-17T02:25:27.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.584+0000 7fb166200640 1 -- 172.21.15.45:0/338126472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb1600c5c00 con 0x7fb1600cb340 2024-08-17T02:25:27.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.584+0000 7fb156a00640 1 -- 172.21.15.45:0/338126472 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb150017040 con 0x7fb1600cb340 2024-08-17T02:25:27.585 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:27.585 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-17T02:25:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 -- 172.21.15.45:0/338126472 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb140065180 msgr2=0x7fb140067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb140065180 0x7fb140067630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb1601560b0 tx=0x7fb14c008040 comp rx=0 tx=0).stop 2024-08-17T02:25:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 -- 172.21.15.45:0/338126472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1600cb340 msgr2=0x7fb1600b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1600cb340 0x7fb1600b5120 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb15000c510 tx=0x7fb15000c910 comp rx=0 tx=0).stop 2024-08-17T02:25:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 -- 172.21.15.45:0/338126472 shutdown_connections 2024-08-17T02:25:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb160158ce0 0x7fb1600c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb140065180 0x7fb140067630 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1600d08d0 0x7fb16014dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 --2- 172.21.15.45:0/338126472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1600cb340 0x7fb1600b5120 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 -- 172.21.15.45:0/338126472 >> 172.21.15.45:0/338126472 conn(0x7fb1600cfdc0 msgr2=0x7fb1600675f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 -- 172.21.15.45:0/338126472 shutdown_connections 2024-08-17T02:25:27.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.586+0000 7fb166200640 1 -- 172.21.15.45:0/338126472 wait complete. 2024-08-17T02:25:27.602 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-08-17T02:25:27.602 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:27.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.753+0000 7f2302e00640 1 Processor -- start 2024-08-17T02:25:27.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.753+0000 7f2302e00640 1 -- start start 2024-08-17T02:25:27.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.754+0000 7f2302e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22fc0d08d0 0x7f22fc0c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.754+0000 7f2302e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc0cb7c0 con 0x7f22fc0cb340 2024-08-17T02:25:27.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.754+0000 7f2302e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22fc0ceb20 con 0x7f22fc158ce0 2024-08-17T02:25:27.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.754+0000 7f2302e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22fc0cf0c0 con 0x7f22fc0d08d0 2024-08-17T02:25:27.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.755+0000 7f22fb400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22fc0d08d0 0x7f22fc0c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.755+0000 7f2300e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f22fc0cb340 0x7f22fc0c5520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33518/0 (socket says 172.21.15.45:33518) 2024-08-17T02:25:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.755+0000 7f2300e00640 1 -- 172.21.15.45:0/1982088087 learned_addr learned my addr 172.21.15.45:0/1982088087 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.755+0000 7f22fb400640 1 -- 172.21.15.45:0/1982088087 >> v1:172.21.15.169:6789/0 conn(0x7f22fc158ce0 legacy=0x7f22fc0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.755+0000 7f22faa00640 1 -- 172.21.15.45:0/1982088087 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662676746 0 0) 0x7f22fc0cb7c0 con 0x7f22fc0cb340 2024-08-17T02:25:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.755+0000 7f22fb400640 1 -- 172.21.15.45:0/1982088087 >> v1:172.21.15.45:6789/0 conn(0x7f22fc0cb340 legacy=0x7f22fc0c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.755+0000 7f22fb400640 1 -- 172.21.15.45:0/1982088087 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22fc0cede0 con 0x7f22fc0d08d0 2024-08-17T02:25:27.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.756+0000 7f22fb400640 1 --2- 172.21.15.45:0/1982088087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22fc0d08d0 0x7f22fc0c68c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009850 tx=0x7f22e80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6989c126ffaa7ec6 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.756+0000 7f22faa00640 1 -- 172.21.15.45:0/1982088087 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e802ad90 con 0x7f22fc0d08d0 2024-08-17T02:25:27.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.756+0000 7f22faa00640 1 -- 172.21.15.45:0/1982088087 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e8032440 con 0x7f22fc0d08d0 2024-08-17T02:25:27.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.756+0000 7f22faa00640 1 -- 172.21.15.45:0/1982088087 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e80327e0 con 0x7f22fc0d08d0 2024-08-17T02:25:27.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.757+0000 7f2302e00640 1 -- 172.21.15.45:0/1982088087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22fc0d08d0 msgr2=0x7f22fc0c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.757+0000 7f2302e00640 1 --2- 172.21.15.45:0/1982088087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22fc0d08d0 0x7f22fc0c68c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f22e8009850 tx=0x7f22e80090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.757+0000 7f2302e00640 1 -- 172.21.15.45:0/1982088087 shutdown_connections 2024-08-17T02:25:27.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.757+0000 7f2302e00640 1 --2- 172.21.15.45:0/1982088087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22fc0d08d0 0x7f22fc0c68c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.757+0000 7f2302e00640 1 -- 172.21.15.45:0/1982088087 >> 172.21.15.45:0/1982088087 conn(0x7f22fc0cfdc0 msgr2=0x7f22fc0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.757+0000 7f2302e00640 1 -- 172.21.15.45:0/1982088087 shutdown_connections 2024-08-17T02:25:27.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.757+0000 7f2302e00640 1 -- 172.21.15.45:0/1982088087 wait complete. 2024-08-17T02:25:27.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.758+0000 7f2302e00640 1 Processor -- start 2024-08-17T02:25:27.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.758+0000 7f2302e00640 1 -- start start 2024-08-17T02:25:27.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.759+0000 7f2302e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22fc0cb340 0x7f22fc15c410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.759+0000 7f2302e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22fc0d08d0 0x7f22fc15dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.759+0000 7f2302e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22fc158ce0 0x7f22fc15e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.759+0000 7f2302e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc15d720 con 0x7f22fc0cb340 2024-08-17T02:25:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.759+0000 7f2302e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc155020 con 0x7f22fc158ce0 2024-08-17T02:25:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.759+0000 7f2302e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc15cb10 con 0x7f22fc0d08d0 2024-08-17T02:25:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.759+0000 7f22fbe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22fc0cb340 0x7f22fc15c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f22fbe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22fc0cb340 0x7f22fc15c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57286/0 (socket says 172.21.15.45:57286) 2024-08-17T02:25:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f22fbe00640 1 -- 172.21.15.45:0/2855629458 learned_addr learned my addr 172.21.15.45:0/2855629458 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f2300e00640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22fc158ce0 0x7f22fc15e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f22fb400640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22fc0d08d0 0x7f22fc15dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f22fbe00640 1 -- 172.21.15.45:0/2855629458 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22fc0d08d0 msgr2=0x7f22fc15dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f22fbe00640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22fc0d08d0 0x7f22fc15dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f22fbe00640 1 -- 172.21.15.45:0/2855629458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22fc158ce0 msgr2=0x7f22fc15e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f22fbe00640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22fc158ce0 0x7f22fc15e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f22fbe00640 1 -- 172.21.15.45:0/2855629458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e8009390 con 0x7f22fc0cb340 2024-08-17T02:25:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f2300e00640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22fc158ce0 0x7f22fc15e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f22fb400640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22fc0d08d0 0x7f22fc15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f22fbe00640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22fc0cb340 0x7f22fc15c410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c610 tx=0x7f22ec007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.760+0000 7f22f3400640 1 -- 172.21.15.45:0/2855629458 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec012630 con 0x7f22fc0cb340 2024-08-17T02:25:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.761+0000 7f22f3400640 1 -- 172.21.15.45:0/2855629458 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22ec0127b0 con 0x7f22fc0cb340 2024-08-17T02:25:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.761+0000 7f22f3400640 1 -- 172.21.15.45:0/2855629458 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec012b70 con 0x7f22fc0cb340 2024-08-17T02:25:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.761+0000 7f2302e00640 1 -- 172.21.15.45:0/2855629458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc15cdf0 con 0x7f22fc0cb340 2024-08-17T02:25:27.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.761+0000 7f2302e00640 1 -- 172.21.15.45:0/2855629458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc15d3b0 con 0x7f22fc0cb340 2024-08-17T02:25:27.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.762+0000 7f2302e00640 1 -- 172.21.15.45:0/2855629458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22fc064db0 con 0x7f22fc0cb340 2024-08-17T02:25:27.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.762+0000 7f22f3400640 1 -- 172.21.15.45:0/2855629458 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f22ec01a3b0 con 0x7f22fc0cb340 2024-08-17T02:25:27.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.763+0000 7f22f3400640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22dc065150 0x7f22dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:27.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.763+0000 7f22f3400640 1 -- 172.21.15.45:0/2855629458 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22ec081ff0 con 0x7f22fc0cb340 2024-08-17T02:25:27.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.763+0000 7f22fb400640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22dc065150 0x7f22dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:27.765 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.764+0000 7f22fb400640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22dc065150 0x7f22dc067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22e8034000 tx=0x7f22e8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:27.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.767+0000 7f22f3400640 1 -- 172.21.15.45:0/2855629458 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f22ec050010 con 0x7f22fc0cb340 2024-08-17T02:25:27.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.948+0000 7f2302e00640 1 -- 172.21.15.45:0/2855629458 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22fc0ccfe0 con 0x7f22fc0cb340 2024-08-17T02:25:27.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.949+0000 7f22f3400640 1 -- 172.21.15.45:0/2855629458 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f22ec053630 con 0x7f22fc0cb340 2024-08-17T02:25:27.950 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:27.951 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 -- 172.21.15.45:0/2855629458 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22dc065150 msgr2=0x7f22dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22dc065150 0x7f22dc067600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f22e8034000 tx=0x7f22e8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 -- 172.21.15.45:0/2855629458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22fc0cb340 msgr2=0x7f22fc15c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22fc0cb340 0x7f22fc15c410 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f22ec00c610 tx=0x7f22ec007ed0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 -- 172.21.15.45:0/2855629458 shutdown_connections 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22fc158ce0 0x7f22fc15e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22dc065150 0x7f22dc067600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22fc0d08d0 0x7f22fc15dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 --2- 172.21.15.45:0/2855629458 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22fc0cb340 0x7f22fc15c410 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 -- 172.21.15.45:0/2855629458 >> 172.21.15.45:0/2855629458 conn(0x7f22fc0cfdc0 msgr2=0x7f22fc0cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 -- 172.21.15.45:0/2855629458 shutdown_connections 2024-08-17T02:25:27.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:27.952+0000 7f2302e00640 1 -- 172.21.15.45:0/2855629458 wait complete. 2024-08-17T02:25:27.968 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:12.166249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:13.072271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:27.968 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:28.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.122+0000 7f2354a00640 1 Processor -- start 2024-08-17T02:25:28.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.123+0000 7f2354a00640 1 -- start start 2024-08-17T02:25:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.124+0000 7f2354a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2350068d40 0x7f2350069170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.124+0000 7f2354a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23500af1b0 0x7f23500af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.124+0000 7f2354a00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23500aed20 con 0x7f23500ac290 2024-08-17T02:25:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.124+0000 7f2354a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23500ae460 con 0x7f23500af1b0 2024-08-17T02:25:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.124+0000 7f2354a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2350069aa0 con 0x7f2350068d40 2024-08-17T02:25:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.124+0000 7f234e800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f23500ac290 0x7f23500ac660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33524/0 (socket says 172.21.15.45:33524) 2024-08-17T02:25:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.124+0000 7f234e800640 1 -- 172.21.15.45:0/3537108905 learned_addr learned my addr 172.21.15.45:0/3537108905 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.124+0000 7f234f200640 1 --2- 172.21.15.45:0/3537108905 >> v2:172.21.15.45:3300/0 conn(0x7f23500af1b0 0x7f23500af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.124+0000 7f2345e00640 1 --2- 172.21.15.45:0/3537108905 >> v2:172.21.15.169:3300/0 conn(0x7f2350068d40 0x7f2350069170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.125+0000 7f234de00640 1 -- 172.21.15.45:0/3537108905 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841559811 0 0) 0x7f23500aed20 con 0x7f23500ac290 2024-08-17T02:25:28.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.125+0000 7f234de00640 1 -- 172.21.15.45:0/3537108905 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23340034e0 con 0x7f23500ac290 2024-08-17T02:25:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.125+0000 7f234f200640 1 -- 172.21.15.45:0/3537108905 >> v2:172.21.15.169:3300/0 conn(0x7f2350068d40 msgr2=0x7f2350069170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.125+0000 7f234f200640 1 --2- 172.21.15.45:0/3537108905 >> v2:172.21.15.169:3300/0 conn(0x7f2350068d40 0x7f2350069170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.125+0000 7f234f200640 1 -- 172.21.15.45:0/3537108905 >> v1:172.21.15.45:6789/0 conn(0x7f23500ac290 legacy=0x7f23500ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.125+0000 7f234f200640 1 -- 172.21.15.45:0/3537108905 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500ae6d0 con 0x7f23500af1b0 2024-08-17T02:25:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.126+0000 7f234f200640 1 --2- 172.21.15.45:0/3537108905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23500af1b0 0x7f23500af5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f23500c9f90 tx=0x7f2348009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7abed97ea478a1dd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.126+0000 7f234de00640 1 -- 172.21.15.45:0/3537108905 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348007550 con 0x7f23500af1b0 2024-08-17T02:25:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.126+0000 7f234de00640 1 -- 172.21.15.45:0/3537108905 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234802d050 con 0x7f23500af1b0 2024-08-17T02:25:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.126+0000 7f234de00640 1 -- 172.21.15.45:0/3537108905 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348007900 con 0x7f23500af1b0 2024-08-17T02:25:28.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.126+0000 7f2354a00640 1 -- 172.21.15.45:0/3537108905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23500af1b0 msgr2=0x7f23500af5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.126+0000 7f2354a00640 1 --2- 172.21.15.45:0/3537108905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23500af1b0 0x7f23500af5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f23500c9f90 tx=0x7f2348009780 comp rx=0 tx=0).stop 2024-08-17T02:25:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.127+0000 7f2354a00640 1 -- 172.21.15.45:0/3537108905 shutdown_connections 2024-08-17T02:25:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.127+0000 7f2354a00640 1 --2- 172.21.15.45:0/3537108905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23500af1b0 0x7f23500af5d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.127+0000 7f2354a00640 1 --2- 172.21.15.45:0/3537108905 >> v2:172.21.15.169:3300/0 conn(0x7f2350068d40 0x7f2350069170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.127+0000 7f2354a00640 1 -- 172.21.15.45:0/3537108905 >> 172.21.15.45:0/3537108905 conn(0x7f2350096a70 msgr2=0x7f2350096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.127+0000 7f2354a00640 1 -- 172.21.15.45:0/3537108905 shutdown_connections 2024-08-17T02:25:28.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.127+0000 7f2354a00640 1 -- 172.21.15.45:0/3537108905 wait complete. 2024-08-17T02:25:28.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.128+0000 7f2354a00640 1 Processor -- start 2024-08-17T02:25:28.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.128+0000 7f2354a00640 1 -- start start 2024-08-17T02:25:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.129+0000 7f2354a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2350068d40 0x7f2350097830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.129+0000 7f2354a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23500ac290 0x7f2350155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.129+0000 7f2354a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23500af1b0 0x7f23500b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.129+0000 7f2354a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2350098080 con 0x7f23500af1b0 2024-08-17T02:25:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.129+0000 7f2354a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2350098360 con 0x7f23500ac290 2024-08-17T02:25:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.129+0000 7f2354a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2350098640 con 0x7f2350068d40 2024-08-17T02:25:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.129+0000 7f234f200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23500af1b0 0x7f23500b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.129+0000 7f234f200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23500af1b0 0x7f23500b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57292/0 (socket says 172.21.15.45:57292) 2024-08-17T02:25:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.129+0000 7f234f200640 1 -- 172.21.15.45:0/3199294589 learned_addr learned my addr 172.21.15.45:0/3199294589 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.129+0000 7f234e800640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2350068d40 0x7f2350097830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.129+0000 7f2345e00640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23500ac290 0x7f2350155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.130+0000 7f234f200640 1 -- 172.21.15.45:0/3199294589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2350068d40 msgr2=0x7f2350097830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.130+0000 7f234f200640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2350068d40 0x7f2350097830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.130+0000 7f234f200640 1 -- 172.21.15.45:0/3199294589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23500ac290 msgr2=0x7f2350155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.130+0000 7f234f200640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23500ac290 0x7f2350155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.130+0000 7f234f200640 1 -- 172.21.15.45:0/3199294589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2348009a20 con 0x7f23500af1b0 2024-08-17T02:25:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.130+0000 7f234f200640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23500af1b0 0x7f23500b2830 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2348009e90 tx=0x7f2348037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.130+0000 7f2346a00640 1 -- 172.21.15.45:0/3199294589 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23480078d0 con 0x7f23500af1b0 2024-08-17T02:25:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.130+0000 7f2346a00640 1 -- 172.21.15.45:0/3199294589 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2348031ac0 con 0x7f23500af1b0 2024-08-17T02:25:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.130+0000 7f2346a00640 1 -- 172.21.15.45:0/3199294589 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2348031e80 con 0x7f23500af1b0 2024-08-17T02:25:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.131+0000 7f2354a00640 1 -- 172.21.15.45:0/3199294589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235015b6d0 con 0x7f23500af1b0 2024-08-17T02:25:28.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.131+0000 7f2354a00640 1 -- 172.21.15.45:0/3199294589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2350097d70 con 0x7f23500af1b0 2024-08-17T02:25:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.132+0000 7f2354a00640 1 -- 172.21.15.45:0/3199294589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235015b530 con 0x7f23500af1b0 2024-08-17T02:25:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.132+0000 7f2346a00640 1 -- 172.21.15.45:0/3199294589 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f234803c630 con 0x7f23500af1b0 2024-08-17T02:25:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.133+0000 7f2346a00640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f232c065150 0x7f232c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.133+0000 7f2346a00640 1 -- 172.21.15.45:0/3199294589 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f23480a3b80 con 0x7f23500af1b0 2024-08-17T02:25:28.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.133+0000 7f234e800640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f232c065150 0x7f232c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.134+0000 7f234e800640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f232c065150 0x7f232c067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2340005840 tx=0x7f2340009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.137+0000 7f2346a00640 1 -- 172.21.15.45:0/3199294589 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f235015b530 con 0x7f23500af1b0 2024-08-17T02:25:28.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.321+0000 7f2354a00640 1 -- 172.21.15.45:0/3199294589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f235015b530 con 0x7f23500af1b0 2024-08-17T02:25:28.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.322+0000 7f2346a00640 1 -- 172.21.15.45:0/3199294589 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f235015b530 con 0x7f23500af1b0 2024-08-17T02:25:28.323 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:25:28.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 -- 172.21.15.45:0/3199294589 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f232c065150 msgr2=0x7f232c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f232c065150 0x7f232c067600 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2340005840 tx=0x7f2340009040 comp rx=0 tx=0).stop 2024-08-17T02:25:28.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 -- 172.21.15.45:0/3199294589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23500af1b0 msgr2=0x7f23500b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23500af1b0 0x7f23500b2830 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2348009e90 tx=0x7f2348037000 comp rx=0 tx=0).stop 2024-08-17T02:25:28.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 -- 172.21.15.45:0/3199294589 shutdown_connections 2024-08-17T02:25:28.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23500af1b0 0x7f23500b2830 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23500ac290 0x7f2350155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f232c065150 0x7f232c067600 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 --2- 172.21.15.45:0/3199294589 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2350068d40 0x7f2350097830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 -- 172.21.15.45:0/3199294589 >> 172.21.15.45:0/3199294589 conn(0x7f2350096a70 msgr2=0x7f23500ce1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 -- 172.21.15.45:0/3199294589 shutdown_connections 2024-08-17T02:25:28.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.324+0000 7f2354a00640 1 -- 172.21.15.45:0/3199294589 wait complete. 2024-08-17T02:25:28.340 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:28.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.492+0000 7f403b200640 1 Processor -- start 2024-08-17T02:25:28.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.492+0000 7f403b200640 1 -- start start 2024-08-17T02:25:28.494 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.494+0000 7f403b200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40340c92e0 0x7f4034160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.494+0000 7f403b200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40341598f0 con 0x7f40340c7db0 2024-08-17T02:25:28.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.494+0000 7f403b200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4034159bd0 con 0x7f4034155a80 2024-08-17T02:25:28.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.494+0000 7f403b200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4034159eb0 con 0x7f40340c92e0 2024-08-17T02:25:28.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.494+0000 7f4039200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40340c92e0 0x7f4034160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.494+0000 7f4033400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f40340c7db0 0x7f40340c8bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33526/0 (socket says 172.21.15.45:33526) 2024-08-17T02:25:28.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.494+0000 7f4033400640 1 -- 172.21.15.45:0/83870741 learned_addr learned my addr 172.21.15.45:0/83870741 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:28.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.494+0000 7f4039200640 1 -- 172.21.15.45:0/83870741 >> v1:172.21.15.169:6789/0 conn(0x7f4034155a80 legacy=0x7f403406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.494+0000 7f4039200640 1 -- 172.21.15.45:0/83870741 >> v1:172.21.15.45:6789/0 conn(0x7f40340c7db0 legacy=0x7f40340c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.495 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.494+0000 7f4039200640 1 -- 172.21.15.45:0/83870741 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403415a190 con 0x7f40340c92e0 2024-08-17T02:25:28.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.495+0000 7f4039200640 1 --2- 172.21.15.45:0/83870741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40340c92e0 0x7f4034160b90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f402c009e60 tx=0x7f402c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9189c4a71176ae1a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.495+0000 7f4032a00640 1 -- 172.21.15.45:0/83870741 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c030560 con 0x7f40340c92e0 2024-08-17T02:25:28.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.496+0000 7f4032a00640 1 -- 172.21.15.45:0/83870741 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f402c0306c0 con 0x7f40340c92e0 2024-08-17T02:25:28.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.496+0000 7f4032a00640 1 -- 172.21.15.45:0/83870741 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f402c030aa0 con 0x7f40340c92e0 2024-08-17T02:25:28.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.496+0000 7f403b200640 1 -- 172.21.15.45:0/83870741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40340c92e0 msgr2=0x7f4034160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.496+0000 7f403b200640 1 --2- 172.21.15.45:0/83870741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40340c92e0 0x7f4034160b90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f402c009e60 tx=0x7f402c009780 comp rx=0 tx=0).stop 2024-08-17T02:25:28.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.496+0000 7f403b200640 1 -- 172.21.15.45:0/83870741 shutdown_connections 2024-08-17T02:25:28.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.496+0000 7f403b200640 1 --2- 172.21.15.45:0/83870741 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40340c92e0 0x7f4034160b90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.496+0000 7f403b200640 1 -- 172.21.15.45:0/83870741 >> 172.21.15.45:0/83870741 conn(0x7f4034067750 msgr2=0x7f40340c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.496+0000 7f403b200640 1 -- 172.21.15.45:0/83870741 shutdown_connections 2024-08-17T02:25:28.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.496+0000 7f403b200640 1 -- 172.21.15.45:0/83870741 wait complete. 2024-08-17T02:25:28.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.498+0000 7f403b200640 1 Processor -- start 2024-08-17T02:25:28.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.498+0000 7f403b200640 1 -- start start 2024-08-17T02:25:28.500 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f403b200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40340c7db0 0x7f40341500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f403b200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40340c92e0 0x7f4034148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f403b200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4034155a80 0x7f403415d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f403b200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4034148bc0 con 0x7f40340c7db0 2024-08-17T02:25:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f403b200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403415d790 con 0x7f40340c92e0 2024-08-17T02:25:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f403b200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403415c1f0 con 0x7f4034155a80 2024-08-17T02:25:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f4033e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40340c7db0 0x7f40341500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f4033e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40340c7db0 0x7f40341500a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57300/0 (socket says 172.21.15.45:57300) 2024-08-17T02:25:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f4033e00640 1 -- 172.21.15.45:0/3741795373 learned_addr learned my addr 172.21.15.45:0/3741795373 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f4033400640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40340c92e0 0x7f4034148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.501 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f4039200640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4034155a80 0x7f403415d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f4033e00640 1 -- 172.21.15.45:0/3741795373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4034155a80 msgr2=0x7f403415d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f4033e00640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4034155a80 0x7f403415d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f4033e00640 1 -- 172.21.15.45:0/3741795373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40340c92e0 msgr2=0x7f4034148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f4033e00640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40340c92e0 0x7f4034148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f4033e00640 1 -- 172.21.15.45:0/3741795373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402c009a20 con 0x7f40340c7db0 2024-08-17T02:25:28.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.499+0000 7f4033e00640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40340c7db0 0x7f40341500a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f402400c4f0 tx=0x7f4024007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.500+0000 7f402b400640 1 -- 172.21.15.45:0/3741795373 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024011590 con 0x7f40340c7db0 2024-08-17T02:25:28.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.500+0000 7f402b400640 1 -- 172.21.15.45:0/3741795373 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4024011710 con 0x7f40340c7db0 2024-08-17T02:25:28.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.500+0000 7f403b200640 1 -- 172.21.15.45:0/3741795373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f403415c490 con 0x7f40340c7db0 2024-08-17T02:25:28.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.500+0000 7f402b400640 1 -- 172.21.15.45:0/3741795373 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4024011ad0 con 0x7f40340c7db0 2024-08-17T02:25:28.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.500+0000 7f403b200640 1 -- 172.21.15.45:0/3741795373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403415ca50 con 0x7f40340c7db0 2024-08-17T02:25:28.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.501+0000 7f403b200640 1 -- 172.21.15.45:0/3741795373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4034071050 con 0x7f40340c7db0 2024-08-17T02:25:28.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.502+0000 7f402b400640 1 -- 172.21.15.45:0/3741795373 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f402401b3b0 con 0x7f40340c7db0 2024-08-17T02:25:28.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.503+0000 7f402b400640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4014065150 0x7f4014067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.503+0000 7f402b400640 1 -- 172.21.15.45:0/3741795373 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40240818e0 con 0x7f40340c7db0 2024-08-17T02:25:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.503+0000 7f4033400640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4014065150 0x7f4014067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.503+0000 7f4033400640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4014065150 0x7f4014067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4020007fd0 tx=0x7f4020009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.507+0000 7f402b400640 1 -- 172.21.15.45:0/3741795373 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f402404f900 con 0x7f40340c7db0 2024-08-17T02:25:28.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.693+0000 7f403b200640 1 -- 172.21.15.45:0/3741795373 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40340ae540 con 0x7f40340c7db0 2024-08-17T02:25:28.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.693+0000 7f402b400640 1 -- 172.21.15.45:0/3741795373 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4024017020 con 0x7f40340c7db0 2024-08-17T02:25:28.694 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:25:28.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.695+0000 7f403b200640 1 -- 172.21.15.45:0/3741795373 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4014065150 msgr2=0x7f4014067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.696 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.695+0000 7f403b200640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4014065150 0x7f4014067600 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4020007fd0 tx=0x7f4020009040 comp rx=0 tx=0).stop 2024-08-17T02:25:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.695+0000 7f403b200640 1 -- 172.21.15.45:0/3741795373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40340c7db0 msgr2=0x7f40341500a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.695+0000 7f403b200640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40340c7db0 0x7f40341500a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f402400c4f0 tx=0x7f4024007ef0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.695+0000 7f403b200640 1 -- 172.21.15.45:0/3741795373 shutdown_connections 2024-08-17T02:25:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.695+0000 7f403b200640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4014065150 0x7f4014067600 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.695+0000 7f403b200640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4034155a80 0x7f403415d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.695+0000 7f403b200640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f40340c92e0 0x7f4034148680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.695+0000 7f403b200640 1 --2- 172.21.15.45:0/3741795373 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40340c7db0 0x7f40341500a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.695+0000 7f403b200640 1 -- 172.21.15.45:0/3741795373 >> 172.21.15.45:0/3741795373 conn(0x7f4034067750 msgr2=0x7f403414a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.695+0000 7f403b200640 1 -- 172.21.15.45:0/3741795373 shutdown_connections 2024-08-17T02:25:28.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.696+0000 7f403b200640 1 -- 172.21.15.45:0/3741795373 wait complete. 2024-08-17T02:25:28.712 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:28.866 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.865+0000 7fcd26e00640 1 Processor -- start 2024-08-17T02:25:28.867 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.866+0000 7fcd26e00640 1 -- start start 2024-08-17T02:25:28.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.867+0000 7fcd26e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcd200c7db0 0x7fcd200c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.867+0000 7fcd26e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd20155e50 0x7fcd200c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.867+0000 7fcd26e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd201598f0 con 0x7fcd20155a80 2024-08-17T02:25:28.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.867+0000 7fcd26e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd20159bd0 con 0x7fcd20155e50 2024-08-17T02:25:28.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.867+0000 7fcd26e00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd20159eb0 con 0x7fcd200c7db0 2024-08-17T02:25:28.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.867+0000 7fcd24e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd20155e50 0x7fcd200c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.867+0000 7fcd24e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcd20155e50 0x7fcd200c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57316/0 (socket says 172.21.15.45:57316) 2024-08-17T02:25:28.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.867+0000 7fcd24e00640 1 -- 172.21.15.45:0/2971309106 learned_addr learned my addr 172.21.15.45:0/2971309106 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:28.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.867+0000 7fcd17e00640 1 --2- 172.21.15.45:0/2971309106 >> v2:172.21.15.169:3300/0 conn(0x7fcd200c7db0 0x7fcd200c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.868+0000 7fcd24e00640 1 -- 172.21.15.45:0/2971309106 >> v2:172.21.15.169:3300/0 conn(0x7fcd200c7db0 msgr2=0x7fcd200c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:28.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.868+0000 7fcd24e00640 1 --2- 172.21.15.45:0/2971309106 >> v2:172.21.15.169:3300/0 conn(0x7fcd200c7db0 0x7fcd200c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.868+0000 7fcd24e00640 1 -- 172.21.15.45:0/2971309106 >> v1:172.21.15.169:6789/0 conn(0x7fcd20155a80 legacy=0x7fcd2006dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.868+0000 7fcd24e00640 1 -- 172.21.15.45:0/2971309106 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2015a190 con 0x7fcd20155e50 2024-08-17T02:25:28.869 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.869+0000 7fcd24e00640 1 --2- 172.21.15.45:0/2971309106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd20155e50 0x7fcd200c9110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd2006c750 tx=0x7fcd18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757a011f63dc463 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.870 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.869+0000 7fcd1f400640 1 -- 172.21.15.45:0/2971309106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18032480 con 0x7fcd20155e50 2024-08-17T02:25:28.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.869+0000 7fcd1f400640 1 -- 172.21.15.45:0/2971309106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd180325e0 con 0x7fcd20155e50 2024-08-17T02:25:28.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.869+0000 7fcd1f400640 1 -- 172.21.15.45:0/2971309106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd180329c0 con 0x7fcd20155e50 2024-08-17T02:25:28.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.869+0000 7fcd26e00640 1 -- 172.21.15.45:0/2971309106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd20155e50 msgr2=0x7fcd200c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.869+0000 7fcd26e00640 1 --2- 172.21.15.45:0/2971309106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd20155e50 0x7fcd200c9110 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcd2006c750 tx=0x7fcd18009840 comp rx=0 tx=0).stop 2024-08-17T02:25:28.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.870+0000 7fcd26e00640 1 -- 172.21.15.45:0/2971309106 shutdown_connections 2024-08-17T02:25:28.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.870+0000 7fcd26e00640 1 --2- 172.21.15.45:0/2971309106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd20155e50 0x7fcd200c9110 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.870+0000 7fcd26e00640 1 --2- 172.21.15.45:0/2971309106 >> v2:172.21.15.169:3300/0 conn(0x7fcd200c7db0 0x7fcd200c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.870+0000 7fcd26e00640 1 -- 172.21.15.45:0/2971309106 >> 172.21.15.45:0/2971309106 conn(0x7fcd20067750 msgr2=0x7fcd200c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:28.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.870+0000 7fcd26e00640 1 -- 172.21.15.45:0/2971309106 shutdown_connections 2024-08-17T02:25:28.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.870+0000 7fcd26e00640 1 -- 172.21.15.45:0/2971309106 wait complete. 2024-08-17T02:25:28.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.871+0000 7fcd26e00640 1 Processor -- start 2024-08-17T02:25:28.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.871+0000 7fcd26e00640 1 -- start start 2024-08-17T02:25:28.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.872+0000 7fcd26e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd200c7db0 0x7fcd2015b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.872+0000 7fcd26e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd20155a80 0x7fcd201503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.872+0000 7fcd26e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd20155e50 0x7fcd2015c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.872+0000 7fcd26e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd201562d0 con 0x7fcd20155e50 2024-08-17T02:25:28.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.872+0000 7fcd26e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd20150910 con 0x7fcd20155a80 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.872+0000 7fcd26e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2015cc80 con 0x7fcd200c7db0 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.872+0000 7fcd24e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd20155e50 0x7fcd2015c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.872+0000 7fcd24e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd20155e50 0x7fcd2015c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57324/0 (socket says 172.21.15.45:57324) 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.872+0000 7fcd24e00640 1 -- 172.21.15.45:0/2771286819 learned_addr learned my addr 172.21.15.45:0/2771286819 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.872+0000 7fcd1fe00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd200c7db0 0x7fcd2015b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.872+0000 7fcd17e00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd20155a80 0x7fcd201503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd24e00640 1 -- 172.21.15.45:0/2771286819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd200c7db0 msgr2=0x7fcd2015b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd24e00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd200c7db0 0x7fcd2015b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd24e00640 1 -- 172.21.15.45:0/2771286819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd20155a80 msgr2=0x7fcd201503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd24e00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd20155a80 0x7fcd201503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd24e00640 1 -- 172.21.15.45:0/2771286819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd18009ae0 con 0x7fcd20155e50 2024-08-17T02:25:28.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd17e00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd20155a80 0x7fcd201503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:28.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd24e00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd20155e50 0x7fcd2015c430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd1802adf0 tx=0x7fcd18037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd17400640 1 -- 172.21.15.45:0/2771286819 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd18032480 con 0x7fcd20155e50 2024-08-17T02:25:28.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd17400640 1 -- 172.21.15.45:0/2771286819 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd18008ad0 con 0x7fcd20155e50 2024-08-17T02:25:28.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd17400640 1 -- 172.21.15.45:0/2771286819 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1803c410 con 0x7fcd20155e50 2024-08-17T02:25:28.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd26e00640 1 -- 172.21.15.45:0/2771286819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2015cf60 con 0x7fcd20155e50 2024-08-17T02:25:28.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.873+0000 7fcd26e00640 1 -- 172.21.15.45:0/2771286819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2015d520 con 0x7fcd20155e50 2024-08-17T02:25:28.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.874+0000 7fcd26e00640 1 -- 172.21.15.45:0/2771286819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd20156480 con 0x7fcd20155e50 2024-08-17T02:25:28.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.875+0000 7fcd17400640 1 -- 172.21.15.45:0/2771286819 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcd18039050 con 0x7fcd20155e50 2024-08-17T02:25:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.876+0000 7fcd17400640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccfc065150 0x7fccfc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.877+0000 7fcd17400640 1 -- 172.21.15.45:0/2771286819 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcd180a2cd0 con 0x7fcd20155e50 2024-08-17T02:25:28.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.877+0000 7fcd1fe00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccfc065150 0x7fccfc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:28.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.877+0000 7fcd1fe00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccfc065150 0x7fccfc067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcd10007fd0 tx=0x7fcd10007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:28.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:28.880+0000 7fcd17400640 1 -- 172.21.15.45:0/2771286819 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcd20156480 con 0x7fcd20155e50 2024-08-17T02:25:29.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.062+0000 7fcd26e00640 1 -- 172.21.15.45:0/2771286819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd20071050 con 0x7fcd20155e50 2024-08-17T02:25:29.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.062+0000 7fcd17400640 1 -- 172.21.15.45:0/2771286819 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd18070da0 con 0x7fcd20155e50 2024-08-17T02:25:29.063 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-08-17T02:25:29.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 -- 172.21.15.45:0/2771286819 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccfc065150 msgr2=0x7fccfc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccfc065150 0x7fccfc067600 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcd10007fd0 tx=0x7fcd10007e30 comp rx=0 tx=0).stop 2024-08-17T02:25:29.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 -- 172.21.15.45:0/2771286819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd20155e50 msgr2=0x7fcd2015c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd20155e50 0x7fcd2015c430 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fcd1802adf0 tx=0x7fcd18037000 comp rx=0 tx=0).stop 2024-08-17T02:25:29.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 -- 172.21.15.45:0/2771286819 shutdown_connections 2024-08-17T02:25:29.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcd20155e50 0x7fcd2015c430 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcd20155a80 0x7fcd201503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccfc065150 0x7fccfc067600 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 --2- 172.21.15.45:0/2771286819 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcd200c7db0 0x7fcd2015b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 -- 172.21.15.45:0/2771286819 >> 172.21.15.45:0/2771286819 conn(0x7fcd20067750 msgr2=0x7fcd200adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 -- 172.21.15.45:0/2771286819 shutdown_connections 2024-08-17T02:25:29.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.064+0000 7fcd26e00640 1 -- 172.21.15.45:0/2771286819 wait complete. 2024-08-17T02:25:29.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.231+0000 7f778c800640 1 Processor -- start 2024-08-17T02:25:29.232 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.231+0000 7f778c800640 1 -- start start 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.232+0000 7f778c800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7784140580 0x7f77840c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.234 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.232+0000 7f778c800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77840caa80 con 0x7f77841401b0 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.232+0000 7f778c800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77840c9e70 con 0x7f77840b1440 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.232+0000 7f778c800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77840c9c90 con 0x7f7784140580 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.233+0000 7f778a800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7784140580 0x7f77840c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.233+0000 7f7789e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f77841401b0 0x7f77840b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33532/0 (socket says 172.21.15.45:33532) 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.233+0000 7f7789e00640 1 -- 172.21.15.45:0/2085371232 learned_addr learned my addr 172.21.15.45:0/2085371232 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.233+0000 7f778a800640 1 -- 172.21.15.45:0/2085371232 >> v1:172.21.15.169:6789/0 conn(0x7f77840b1440 legacy=0x7f77840c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.233+0000 7f778a800640 1 -- 172.21.15.45:0/2085371232 >> v1:172.21.15.45:6789/0 conn(0x7f77841401b0 legacy=0x7f77840b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.233+0000 7f778a800640 1 -- 172.21.15.45:0/2085371232 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77840ca150 con 0x7f7784140580 2024-08-17T02:25:29.236 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.233+0000 7f7788a00640 1 -- 172.21.15.45:0/2085371232 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384156303 0 0) 0x7f77840caa80 con 0x7f77841401b0 2024-08-17T02:25:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.234+0000 7f778a800640 1 --2- 172.21.15.45:0/2085371232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7784140580 0x7f77840c9750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7780009e60 tx=0x7f7780009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebf39d93de16690 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.234+0000 7f7788a00640 1 -- 172.21.15.45:0/2085371232 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780007550 con 0x7f7784140580 2024-08-17T02:25:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.234+0000 7f7788a00640 1 -- 172.21.15.45:0/2085371232 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778002d050 con 0x7f7784140580 2024-08-17T02:25:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.234+0000 7f7788a00640 1 -- 172.21.15.45:0/2085371232 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77800078e0 con 0x7f7784140580 2024-08-17T02:25:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.235+0000 7f778c800640 1 -- 172.21.15.45:0/2085371232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7784140580 msgr2=0x7f77840c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.235+0000 7f778c800640 1 --2- 172.21.15.45:0/2085371232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7784140580 0x7f77840c9750 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7780009e60 tx=0x7f7780009780 comp rx=0 tx=0).stop 2024-08-17T02:25:29.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.235+0000 7f778c800640 1 -- 172.21.15.45:0/2085371232 shutdown_connections 2024-08-17T02:25:29.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.235+0000 7f778c800640 1 --2- 172.21.15.45:0/2085371232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7784140580 0x7f77840c9750 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.235+0000 7f778c800640 1 -- 172.21.15.45:0/2085371232 >> 172.21.15.45:0/2085371232 conn(0x7f77840cb9b0 msgr2=0x7f77840cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.235+0000 7f778c800640 1 -- 172.21.15.45:0/2085371232 shutdown_connections 2024-08-17T02:25:29.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.235+0000 7f778c800640 1 -- 172.21.15.45:0/2085371232 wait complete. 2024-08-17T02:25:29.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.236+0000 7f778c800640 1 Processor -- start 2024-08-17T02:25:29.239 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.237+0000 7f778c800640 1 -- start start 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.237+0000 7f778c800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77840b1440 0x7f7784139d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.237+0000 7f778c800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77841401b0 0x7f778415ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f778c800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7784140580 0x7f778415efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f778c800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778416ac00 con 0x7f77841401b0 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f778c800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7784169f50 con 0x7f7784140580 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f778c800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778416a2d0 con 0x7f77840b1440 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f7789400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77841401b0 0x7f778415ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f7789400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77841401b0 0x7f778415ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57338/0 (socket says 172.21.15.45:57338) 2024-08-17T02:25:29.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f7789400640 1 -- 172.21.15.45:0/2448996247 learned_addr learned my addr 172.21.15.45:0/2448996247 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:29.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f778a800640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7784140580 0x7f778415efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f7789e00640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77840b1440 0x7f7784139d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f7789400640 1 -- 172.21.15.45:0/2448996247 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77840b1440 msgr2=0x7f7784139d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f7789400640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77840b1440 0x7f7784139d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f7789400640 1 -- 172.21.15.45:0/2448996247 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7784140580 msgr2=0x7f778415efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f7789400640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7784140580 0x7f778415efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f7789400640 1 -- 172.21.15.45:0/2448996247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7780009a20 con 0x7f77841401b0 2024-08-17T02:25:29.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.238+0000 7f7789e00640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77840b1440 0x7f7784139d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:29.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.239+0000 7f7789400640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77841401b0 0x7f778415ea90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f777400c5e0 tx=0x7f7774007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.239+0000 7f777d600640 1 -- 172.21.15.45:0/2448996247 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774012630 con 0x7f77841401b0 2024-08-17T02:25:29.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.239+0000 7f777d600640 1 -- 172.21.15.45:0/2448996247 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77740127b0 con 0x7f77841401b0 2024-08-17T02:25:29.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.239+0000 7f777d600640 1 -- 172.21.15.45:0/2448996247 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7774012bb0 con 0x7f77841401b0 2024-08-17T02:25:29.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.239+0000 7f778c800640 1 -- 172.21.15.45:0/2448996247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778416a5b0 con 0x7f77841401b0 2024-08-17T02:25:29.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.239+0000 7f778c800640 1 -- 172.21.15.45:0/2448996247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778413a240 con 0x7f77841401b0 2024-08-17T02:25:29.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.240+0000 7f778c800640 1 -- 172.21.15.45:0/2448996247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7784064db0 con 0x7f77841401b0 2024-08-17T02:25:29.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.241+0000 7f777d600640 1 -- 172.21.15.45:0/2448996247 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f777401b400 con 0x7f77841401b0 2024-08-17T02:25:29.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.242+0000 7f777d600640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7768065150 0x7f7768067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.242+0000 7f777d600640 1 -- 172.21.15.45:0/2448996247 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7774082560 con 0x7f77841401b0 2024-08-17T02:25:29.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.242+0000 7f7789e00640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7768065150 0x7f7768067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.242+0000 7f7789e00640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7768065150 0x7f7768067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77840ae540 tx=0x7f7778009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.245+0000 7f777d600640 1 -- 172.21.15.45:0/2448996247 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7774050580 con 0x7f77841401b0 2024-08-17T02:25:29.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.467+0000 7f778c800640 1 -- 172.21.15.45:0/2448996247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77840cb400 con 0x7f77841401b0 2024-08-17T02:25:29.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.468+0000 7f777d600640 1 -- 172.21.15.45:0/2448996247 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f7774016090 con 0x7f77841401b0 2024-08-17T02:25:29.469 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:29.469 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1637538519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1637538519},{"type":"v1","addr":"172.21.15.45:6837","nonce":1637538519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1027153973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1027153973},{"type":"v1","addr":"172.21.15.169:6835","nonce":1027153973}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2482387224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2482387224},{"type":"v1","addr":"172.21.15.45:6835","nonce":2482387224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:14.095016+0000","modified":"2024-08-17T02:25:17.687006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6834/911178485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":911178485},{"type":"v1","addr":"172.21.15.169:6834","nonce":911178485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:29.470 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2024-08-17T02:25:29.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.470+0000 7f778c800640 1 -- 172.21.15.45:0/2448996247 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7768065150 msgr2=0x7f7768067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.470+0000 7f778c800640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7768065150 0x7f7768067600 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77840ae540 tx=0x7f7778009040 comp rx=0 tx=0).stop 2024-08-17T02:25:29.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.470+0000 7f778c800640 1 -- 172.21.15.45:0/2448996247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77841401b0 msgr2=0x7f778415ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.470+0000 7f778c800640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77841401b0 0x7f778415ea90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f777400c5e0 tx=0x7f7774007ed0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.470+0000 7f778c800640 1 -- 172.21.15.45:0/2448996247 shutdown_connections 2024-08-17T02:25:29.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.470+0000 7f778c800640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7784140580 0x7f778415efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.470+0000 7f778c800640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77841401b0 0x7f778415ea90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.470+0000 7f778c800640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7768065150 0x7f7768067600 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.470+0000 7f778c800640 1 --2- 172.21.15.45:0/2448996247 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f77840b1440 0x7f7784139d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.470+0000 7f778c800640 1 -- 172.21.15.45:0/2448996247 >> 172.21.15.45:0/2448996247 conn(0x7f77840cb9b0 msgr2=0x7f77840cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.471+0000 7f778c800640 1 -- 172.21.15.45:0/2448996247 shutdown_connections 2024-08-17T02:25:29.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.471+0000 7f778c800640 1 -- 172.21.15.45:0/2448996247 wait complete. 2024-08-17T02:25:29.486 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.635+0000 7f85c5600640 1 Processor -- start 2024-08-17T02:25:29.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.635+0000 7f85c5600640 1 -- start start 2024-08-17T02:25:29.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85c5600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85c0158d60 0x7f85c00b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85c5600640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f85c015cb30 0x7f85c00b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85c5600640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c00b18d0 con 0x7f85c0159130 2024-08-17T02:25:29.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85c5600640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c00b0d00 con 0x7f85c0158d60 2024-08-17T02:25:29.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85c5600640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c00b0fa0 con 0x7f85c015cb30 2024-08-17T02:25:29.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85bea00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85c0158d60 0x7f85c00b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85bea00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85c0158d60 0x7f85c00b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57348/0 (socket says 172.21.15.45:57348) 2024-08-17T02:25:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85bea00640 1 -- 172.21.15.45:0/3615314101 learned_addr learned my addr 172.21.15.45:0/3615314101 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85b7e00640 1 --2- 172.21.15.45:0/3615314101 >> v2:172.21.15.169:3300/0 conn(0x7f85c015cb30 0x7f85c00b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85bea00640 1 -- 172.21.15.45:0/3615314101 >> v2:172.21.15.169:3300/0 conn(0x7f85c015cb30 msgr2=0x7f85c00b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85bea00640 1 --2- 172.21.15.45:0/3615314101 >> v2:172.21.15.169:3300/0 conn(0x7f85c015cb30 0x7f85c00b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85bea00640 1 -- 172.21.15.45:0/3615314101 >> v1:172.21.15.169:6789/0 conn(0x7f85c0159130 legacy=0x7f85c00c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.637+0000 7f85bea00640 1 -- 172.21.15.45:0/3615314101 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c00b1280 con 0x7f85c0158d60 2024-08-17T02:25:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.638+0000 7f85bea00640 1 --2- 172.21.15.45:0/3615314101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0158d60 0x7f85c00b1d60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009910 tx=0x7f85b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4918597116cfff3d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.639+0000 7f85be000640 1 -- 172.21.15.45:0/3615314101 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b002ae60 con 0x7f85c0158d60 2024-08-17T02:25:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.639+0000 7f85be000640 1 -- 172.21.15.45:0/3615314101 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b0032440 con 0x7f85c0158d60 2024-08-17T02:25:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.639+0000 7f85be000640 1 -- 172.21.15.45:0/3615314101 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00327e0 con 0x7f85c0158d60 2024-08-17T02:25:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.639+0000 7f85c5600640 1 -- 172.21.15.45:0/3615314101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0158d60 msgr2=0x7f85c00b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.639+0000 7f85c5600640 1 --2- 172.21.15.45:0/3615314101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0158d60 0x7f85c00b1d60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009910 tx=0x7f85b00091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.640 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.639+0000 7f85c5600640 1 -- 172.21.15.45:0/3615314101 shutdown_connections 2024-08-17T02:25:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.639+0000 7f85c5600640 1 --2- 172.21.15.45:0/3615314101 >> v2:172.21.15.169:3300/0 conn(0x7f85c015cb30 0x7f85c00b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.639+0000 7f85c5600640 1 --2- 172.21.15.45:0/3615314101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0158d60 0x7f85c00b1d60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.639+0000 7f85c5600640 1 -- 172.21.15.45:0/3615314101 >> 172.21.15.45:0/3615314101 conn(0x7f85c00b3040 msgr2=0x7f85c00b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.639+0000 7f85c5600640 1 -- 172.21.15.45:0/3615314101 shutdown_connections 2024-08-17T02:25:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.640+0000 7f85c5600640 1 -- 172.21.15.45:0/3615314101 wait complete. 2024-08-17T02:25:29.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.641+0000 7f85c5600640 1 Processor -- start 2024-08-17T02:25:29.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.641+0000 7f85c5600640 1 -- start start 2024-08-17T02:25:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.642+0000 7f85c5600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0158d60 0x7f85c0152720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.642+0000 7f85c5600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85c0159130 0x7f85c0154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.642+0000 7f85c5600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85c015cb30 0x7f85c0156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.642+0000 7f85c5600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0155c60 con 0x7f85c0158d60 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.642+0000 7f85c5600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0155050 con 0x7f85c015cb30 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.642+0000 7f85c5600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c0155330 con 0x7f85c0159130 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.642+0000 7f85bea00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0158d60 0x7f85c0152720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.642+0000 7f85bea00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0158d60 0x7f85c0152720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57356/0 (socket says 172.21.15.45:57356) 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.642+0000 7f85bea00640 1 -- 172.21.15.45:0/3984733085 learned_addr learned my addr 172.21.15.45:0/3984733085 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85b7e00640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85c0159130 0x7f85c0154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85bea00640 1 -- 172.21.15.45:0/3984733085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85c0159130 msgr2=0x7f85c0154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85bf400640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85c015cb30 0x7f85c0156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85bea00640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85c0159130 0x7f85c0154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85bea00640 1 -- 172.21.15.45:0/3984733085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85c015cb30 msgr2=0x7f85c0156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85bea00640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85c015cb30 0x7f85c0156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85bea00640 1 -- 172.21.15.45:0/3984733085 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0009450 con 0x7f85c0158d60 2024-08-17T02:25:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85b7e00640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85c0159130 0x7f85c0154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85bf400640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85c015cb30 0x7f85c0156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85bea00640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0158d60 0x7f85c0152720 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f85b0035040 tx=0x7f85b0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85b6000640 1 -- 172.21.15.45:0/3984733085 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0006b30 con 0x7f85c0158d60 2024-08-17T02:25:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85b6000640 1 -- 172.21.15.45:0/3984733085 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b0031de0 con 0x7f85c0158d60 2024-08-17T02:25:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85b6000640 1 -- 172.21.15.45:0/3984733085 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b003d650 con 0x7f85c0158d60 2024-08-17T02:25:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85c5600640 1 -- 172.21.15.45:0/3984733085 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c0155610 con 0x7f85c0158d60 2024-08-17T02:25:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.643+0000 7f85c5600640 1 -- 172.21.15.45:0/3984733085 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c0152c60 con 0x7f85c0158d60 2024-08-17T02:25:29.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.644+0000 7f85c5600640 1 -- 172.21.15.45:0/3984733085 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c0064db0 con 0x7f85c0158d60 2024-08-17T02:25:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.645+0000 7f85b6000640 1 -- 172.21.15.45:0/3984733085 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f85b0039040 con 0x7f85c0158d60 2024-08-17T02:25:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.646+0000 7f85b6000640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f859c065150 0x7f859c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.647+0000 7f85b6000640 1 -- 172.21.15.45:0/3984733085 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f85b00a22d0 con 0x7f85c0158d60 2024-08-17T02:25:29.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.647+0000 7f85b7e00640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f859c065150 0x7f859c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:29.648 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.647+0000 7f85b7e00640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f859c065150 0x7f859c067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f85c006be40 tx=0x7f85a8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:29.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.651+0000 7f85b6000640 1 -- 172.21.15.45:0/3984733085 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f85b00702f0 con 0x7f85c0158d60 2024-08-17T02:25:29.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.839+0000 7f85c5600640 1 -- 172.21.15.45:0/3984733085 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85c0069af0 con 0x7f85c0158d60 2024-08-17T02:25:29.840 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.840+0000 7f85b6000640 1 -- 172.21.15.45:0/3984733085 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f85b002ae60 con 0x7f85c0158d60 2024-08-17T02:25:29.841 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:29.841 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:29.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 -- 172.21.15.45:0/3984733085 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f859c065150 msgr2=0x7f859c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f859c065150 0x7f859c067600 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f85c006be40 tx=0x7f85a8008040 comp rx=0 tx=0).stop 2024-08-17T02:25:29.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 -- 172.21.15.45:0/3984733085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0158d60 msgr2=0x7f85c0152720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:29.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0158d60 0x7f85c0152720 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f85b0035040 tx=0x7f85b0032000 comp rx=0 tx=0).stop 2024-08-17T02:25:29.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 -- 172.21.15.45:0/3984733085 shutdown_connections 2024-08-17T02:25:29.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f85c015cb30 0x7f85c0156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f859c065150 0x7f859c067600 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f85c0159130 0x7f85c0154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 --2- 172.21.15.45:0/3984733085 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85c0158d60 0x7f85c0152720 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:29.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 -- 172.21.15.45:0/3984733085 >> 172.21.15.45:0/3984733085 conn(0x7f85c00b3040 msgr2=0x7f85c0152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:29.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 -- 172.21.15.45:0/3984733085 shutdown_connections 2024-08-17T02:25:29.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:29.842+0000 7f85c5600640 1 -- 172.21.15.45:0/3984733085 wait complete. 2024-08-17T02:25:29.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:12.166249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:13.072271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:29.859 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:30.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.010+0000 7f4a4d400640 1 Processor -- start 2024-08-17T02:25:30.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.010+0000 7f4a4d400640 1 -- start start 2024-08-17T02:25:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a4d400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a4806df00 0x7f4a4806e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a4d400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4a4815a0e0 0x7f4a480aa900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a4d400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a480aae40 0x7f4a480ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a4d400640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a480af5f0 con 0x7f4a4806df00 2024-08-17T02:25:30.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a4d400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a48159600 con 0x7f4a4815a0e0 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a4d400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a481598e0 con 0x7f4a480aae40 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a47e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a4806df00 0x7f4a4806e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a47e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4a4806df00 0x7f4a4806e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57368/0 (socket says 172.21.15.45:57368) 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a47e00640 1 -- 172.21.15.45:0/3552179415 learned_addr learned my addr 172.21.15.45:0/3552179415 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a4ca00640 1 --2- 172.21.15.45:0/3552179415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a480aae40 0x7f4a480ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a3f400640 1 --2- 172.21.15.45:0/3552179415 >> v2:172.21.15.169:3300/0 conn(0x7f4a4815a0e0 0x7f4a480aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a47e00640 1 -- 172.21.15.45:0/3552179415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a480aae40 msgr2=0x7f4a480ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a47e00640 1 --2- 172.21.15.45:0/3552179415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a480aae40 0x7f4a480ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a47e00640 1 -- 172.21.15.45:0/3552179415 >> v2:172.21.15.169:3300/0 conn(0x7f4a4815a0e0 msgr2=0x7f4a480aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a47e00640 1 --2- 172.21.15.45:0/3552179415 >> v2:172.21.15.169:3300/0 conn(0x7f4a4815a0e0 0x7f4a480aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.012+0000 7f4a47e00640 1 -- 172.21.15.45:0/3552179415 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a48159bc0 con 0x7f4a4806df00 2024-08-17T02:25:30.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.013+0000 7f4a47e00640 1 --2- 172.21.15.45:0/3552179415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a4806df00 0x7f4a4806e2d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4a480c8890 tx=0x7f4a380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68e490d9486d571 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a47400640 1 -- 172.21.15.45:0/3552179415 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a3802adb0 con 0x7f4a4806df00 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a47400640 1 -- 172.21.15.45:0/3552179415 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a38032440 con 0x7f4a4806df00 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a47400640 1 -- 172.21.15.45:0/3552179415 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38032820 con 0x7f4a4806df00 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a4d400640 1 -- 172.21.15.45:0/3552179415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a4806df00 msgr2=0x7f4a4806e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a4d400640 1 --2- 172.21.15.45:0/3552179415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a4806df00 0x7f4a4806e2d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4a480c8890 tx=0x7f4a380091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a4d400640 1 -- 172.21.15.45:0/3552179415 shutdown_connections 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a4d400640 1 --2- 172.21.15.45:0/3552179415 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a480aae40 0x7f4a480ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a4d400640 1 --2- 172.21.15.45:0/3552179415 >> v2:172.21.15.169:3300/0 conn(0x7f4a4815a0e0 0x7f4a480aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a4d400640 1 --2- 172.21.15.45:0/3552179415 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a4806df00 0x7f4a4806e2d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a4d400640 1 -- 172.21.15.45:0/3552179415 >> 172.21.15.45:0/3552179415 conn(0x7f4a48067750 msgr2=0x7f4a4806c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a4d400640 1 -- 172.21.15.45:0/3552179415 shutdown_connections 2024-08-17T02:25:30.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.014+0000 7f4a4d400640 1 -- 172.21.15.45:0/3552179415 wait complete. 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.016+0000 7f4a4d400640 1 Processor -- start 2024-08-17T02:25:30.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.016+0000 7f4a4d400640 1 -- start start 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a4d400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a4806df00 0x7f4a4814f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a4d400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a480aae40 0x7f4a480c9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a4d400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a4815a0e0 0x7f4a480ac230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a4d400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a48156e90 con 0x7f4a4806df00 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a4d400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a481501f0 con 0x7f4a4815a0e0 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a4d400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a48156840 con 0x7f4a480aae40 2024-08-17T02:25:30.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a47e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a4806df00 0x7f4a4814f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a47e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a4806df00 0x7f4a4814f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57374/0 (socket says 172.21.15.45:57374) 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a47e00640 1 -- 172.21.15.45:0/1834872308 learned_addr learned my addr 172.21.15.45:0/1834872308 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a4ca00640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a4815a0e0 0x7f4a480ac230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a3f400640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a480aae40 0x7f4a480c9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a47e00640 1 -- 172.21.15.45:0/1834872308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a480aae40 msgr2=0x7f4a480c9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a47e00640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a480aae40 0x7f4a480c9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a47e00640 1 -- 172.21.15.45:0/1834872308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a4815a0e0 msgr2=0x7f4a480ac230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a47e00640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a4815a0e0 0x7f4a480ac230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.017+0000 7f4a47e00640 1 -- 172.21.15.45:0/1834872308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a38009450 con 0x7f4a4806df00 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.018+0000 7f4a47e00640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a4806df00 0x7f4a4814f930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009210 tx=0x7f4a38032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.018+0000 7f4a3fe00640 1 -- 172.21.15.45:0/1834872308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38031bb0 con 0x7f4a4806df00 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.018+0000 7f4a3fe00640 1 -- 172.21.15.45:0/1834872308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a38031d30 con 0x7f4a4806df00 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.018+0000 7f4a3fe00640 1 -- 172.21.15.45:0/1834872308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a38031ea0 con 0x7f4a4806df00 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.018+0000 7f4a4d400640 1 -- 172.21.15.45:0/1834872308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a48156b20 con 0x7f4a4806df00 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.018+0000 7f4a4d400640 1 -- 172.21.15.45:0/1834872308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a4814fe70 con 0x7f4a4806df00 2024-08-17T02:25:30.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.019+0000 7f4a4d400640 1 -- 172.21.15.45:0/1834872308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a48156ce0 con 0x7f4a4806df00 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.020+0000 7f4a3fe00640 1 -- 172.21.15.45:0/1834872308 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4a38039040 con 0x7f4a4806df00 2024-08-17T02:25:30.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.021+0000 7f4a3fe00640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a24065150 0x7f4a24067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.021+0000 7f4a3fe00640 1 -- 172.21.15.45:0/1834872308 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4a380a23c0 con 0x7f4a4806df00 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.021+0000 7f4a3f400640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a24065150 0x7f4a24067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.022+0000 7f4a3f400640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a24065150 0x7f4a24067600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4a480709f0 tx=0x7f4a300090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.025+0000 7f4a3fe00640 1 -- 172.21.15.45:0/1834872308 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4a38070490 con 0x7f4a4806df00 2024-08-17T02:25:30.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.209+0000 7f4a4d400640 1 -- 172.21.15.45:0/1834872308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a48155d90 con 0x7f4a4806df00 2024-08-17T02:25:30.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.209+0000 7f4a3fe00640 1 -- 172.21.15.45:0/1834872308 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a380370a0 con 0x7f4a4806df00 2024-08-17T02:25:30.211 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:25:30.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.211+0000 7f4a4d400640 1 -- 172.21.15.45:0/1834872308 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a24065150 msgr2=0x7f4a24067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.211+0000 7f4a4d400640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a24065150 0x7f4a24067600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4a480709f0 tx=0x7f4a300090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.211+0000 7f4a4d400640 1 -- 172.21.15.45:0/1834872308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a4806df00 msgr2=0x7f4a4814f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.211+0000 7f4a4d400640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a4806df00 0x7f4a4814f930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4a38009210 tx=0x7f4a38032000 comp rx=0 tx=0).stop 2024-08-17T02:25:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.212+0000 7f4a4d400640 1 -- 172.21.15.45:0/1834872308 shutdown_connections 2024-08-17T02:25:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.212+0000 7f4a4d400640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4a4815a0e0 0x7f4a480ac230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.212+0000 7f4a4d400640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4a24065150 0x7f4a24067600 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.212+0000 7f4a4d400640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4a480aae40 0x7f4a480c9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.212+0000 7f4a4d400640 1 --2- 172.21.15.45:0/1834872308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a4806df00 0x7f4a4814f930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.212+0000 7f4a4d400640 1 -- 172.21.15.45:0/1834872308 >> 172.21.15.45:0/1834872308 conn(0x7f4a48067750 msgr2=0x7f4a48155180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.212+0000 7f4a4d400640 1 -- 172.21.15.45:0/1834872308 shutdown_connections 2024-08-17T02:25:30.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.212+0000 7f4a4d400640 1 -- 172.21.15.45:0/1834872308 wait complete. 2024-08-17T02:25:30.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.380+0000 7ff31d400640 1 Processor -- start 2024-08-17T02:25:30.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.380+0000 7ff31d400640 1 -- start start 2024-08-17T02:25:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.382+0000 7ff31d400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff318066cd0 0x7ff31806d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.382+0000 7ff31d400640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31806d720 con 0x7ff3180cb9f0 2024-08-17T02:25:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.382+0000 7ff31d400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff31806da00 con 0x7ff31815c760 2024-08-17T02:25:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.382+0000 7ff31d400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3181536c0 con 0x7ff318066cd0 2024-08-17T02:25:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.382+0000 7ff317e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff3180cb9f0 0x7ff3180abde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33540/0 (socket says 172.21.15.45:33540) 2024-08-17T02:25:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.382+0000 7ff317e00640 1 -- 172.21.15.45:0/3788229919 learned_addr learned my addr 172.21.15.45:0/3788229919 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.382+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039737084 0 0) 0x7ff31806d720 con 0x7ff3180cb9f0 2024-08-17T02:25:30.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.382+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2fc0034e0 con 0x7ff3180cb9f0 2024-08-17T02:25:30.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.382+0000 7ff30fe00640 1 --2- 172.21.15.45:0/3788229919 >> v2:172.21.15.169:3300/0 conn(0x7ff318066cd0 0x7ff31806d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 267506840 0 0) 0x7ff2fc0034e0 con 0x7ff3180cb9f0 2024-08-17T02:25:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 >> v2:172.21.15.169:3300/0 conn(0x7ff318066cd0 msgr2=0x7ff31806d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 --2- 172.21.15.45:0/3788229919 >> v2:172.21.15.169:3300/0 conn(0x7ff318066cd0 0x7ff31806d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 >> v1:172.21.15.169:6789/0 conn(0x7ff31815c760 legacy=0x7ff31815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31806dce0 con 0x7ff3180cb9f0 2024-08-17T02:25:30.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7ff308001470 con 0x7ff3180cb9f0 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 >> v1:172.21.15.45:6789/0 conn(0x7ff3180cb9f0 legacy=0x7ff3180abde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2fc0039d0 0x7ff2fc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 0x7ff2fc004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2fc005130 0x7ff2fc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc00c0a0 con 0x7ff2fc004780 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc00c210 con 0x7ff2fc005130 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc00c3d0 con 0x7ff2fc0039d0 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff30fe00640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 0x7ff2fc004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff317e00640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2fc0039d0 0x7ff2fc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff31ca00640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2fc005130 0x7ff2fc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.383+0000 7ff30fe00640 1 -- 172.21.15.45:0/3788229919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2fc0039d0 msgr2=0x7ff2fc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.384+0000 7ff30fe00640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff2fc0039d0 0x7ff2fc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.384+0000 7ff30fe00640 1 -- 172.21.15.45:0/3788229919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2fc005130 msgr2=0x7ff2fc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.384+0000 7ff30fe00640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2fc005130 0x7ff2fc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.384+0000 7ff30fe00640 1 -- 172.21.15.45:0/3788229919 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0034e0 con 0x7ff2fc004780 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.384+0000 7ff31ca00640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff2fc005130 0x7ff2fc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.384+0000 7ff31ca00640 1 -- 172.21.15.45:0/3788229919 reap_dead start 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.385+0000 7ff30fe00640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 0x7ff2fc004bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff300009b50 tx=0x7ff3000090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d407b8133d709a1e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.385+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300031400 con 0x7ff2fc004780 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.385+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30002d050 con 0x7ff2fc004780 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.385+0000 7ff317400640 1 -- 172.21.15.45:0/3788229919 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff300031790 con 0x7ff2fc004780 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.385+0000 7ff31d400640 1 -- 172.21.15.45:0/3788229919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 msgr2=0x7ff2fc004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.385+0000 7ff31d400640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 0x7ff2fc004bf0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff300009b50 tx=0x7ff3000090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.385+0000 7ff31d400640 1 -- 172.21.15.45:0/3788229919 shutdown_connections 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.385+0000 7ff31d400640 1 --2- 172.21.15.45:0/3788229919 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 0x7ff2fc004bf0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.385+0000 7ff31d400640 1 -- 172.21.15.45:0/3788229919 >> 172.21.15.45:0/3788229919 conn(0x7ff3180cca90 msgr2=0x7ff3180a8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.386+0000 7ff31d400640 1 -- 172.21.15.45:0/3788229919 shutdown_connections 2024-08-17T02:25:30.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.386+0000 7ff31d400640 1 -- 172.21.15.45:0/3788229919 wait complete. 2024-08-17T02:25:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.387+0000 7ff31d400640 1 Processor -- start 2024-08-17T02:25:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.387+0000 7ff31d400640 1 -- start start 2024-08-17T02:25:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff31d400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 0x7ff318150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff31d400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3180aef70 0x7ff3180696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff31d400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff318069c30 0x7ff318098fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff31d400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff318097a80 con 0x7ff2fc004780 2024-08-17T02:25:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff31d400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31806a0a0 con 0x7ff318069c30 2024-08-17T02:25:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff31d400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3181514f0 con 0x7ff3180aef70 2024-08-17T02:25:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff317e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 0x7ff318150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff317e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 0x7ff318150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57392/0 (socket says 172.21.15.45:57392) 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff317e00640 1 -- 172.21.15.45:0/345271975 learned_addr learned my addr 172.21.15.45:0/345271975 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff30fe00640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3180aef70 0x7ff3180696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff31ca00640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff318069c30 0x7ff318098fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff317e00640 1 -- 172.21.15.45:0/345271975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3180aef70 msgr2=0x7ff3180696f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff317e00640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3180aef70 0x7ff3180696f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff317e00640 1 -- 172.21.15.45:0/345271975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff318069c30 msgr2=0x7ff318098fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff317e00640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff318069c30 0x7ff318098fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff317e00640 1 -- 172.21.15.45:0/345271975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff318098210 con 0x7ff2fc004780 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.388+0000 7ff31ca00640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff318069c30 0x7ff318098fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.389+0000 7ff317e00640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 0x7ff318150fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff308004ad0 tx=0x7ff308001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.389+0000 7ff30f400640 1 -- 172.21.15.45:0/345271975 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30800f9c0 con 0x7ff2fc004780 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.389+0000 7ff30f400640 1 -- 172.21.15.45:0/345271975 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff30800fb40 con 0x7ff2fc004780 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.389+0000 7ff30f400640 1 -- 172.21.15.45:0/345271975 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080133f0 con 0x7ff2fc004780 2024-08-17T02:25:30.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.389+0000 7ff31d400640 1 -- 172.21.15.45:0/345271975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3180984f0 con 0x7ff2fc004780 2024-08-17T02:25:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.389+0000 7ff31d400640 1 -- 172.21.15.45:0/345271975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff318098ab0 con 0x7ff2fc004780 2024-08-17T02:25:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.390+0000 7ff31d400640 1 -- 172.21.15.45:0/345271975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff318098cd0 con 0x7ff2fc004780 2024-08-17T02:25:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.391+0000 7ff30f400640 1 -- 172.21.15.45:0/345271975 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff3080137a0 con 0x7ff2fc004780 2024-08-17T02:25:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.392+0000 7ff30f400640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff2f4065150 0x7ff2f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.392+0000 7ff30f400640 1 -- 172.21.15.45:0/345271975 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff308082760 con 0x7ff2fc004780 2024-08-17T02:25:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.392+0000 7ff30fe00640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff2f4065150 0x7ff2f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.393+0000 7ff30fe00640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff2f4065150 0x7ff2f4067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff300034000 tx=0x7ff300035000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.396+0000 7ff30f400640 1 -- 172.21.15.45:0/345271975 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff308050780 con 0x7ff2fc004780 2024-08-17T02:25:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.577+0000 7ff31d400640 1 -- 172.21.15.45:0/345271975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff318071050 con 0x7ff2fc004780 2024-08-17T02:25:30.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.577+0000 7ff30f400640 1 -- 172.21.15.45:0/345271975 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff308053da0 con 0x7ff2fc004780 2024-08-17T02:25:30.578 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:25:30.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.579+0000 7ff31d400640 1 -- 172.21.15.45:0/345271975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff2f4065150 msgr2=0x7ff2f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.580 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.579+0000 7ff31d400640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff2f4065150 0x7ff2f4067600 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ff300034000 tx=0x7ff300035000 comp rx=0 tx=0).stop 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.579+0000 7ff31d400640 1 -- 172.21.15.45:0/345271975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 msgr2=0x7ff318150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.579+0000 7ff31d400640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 0x7ff318150fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff308004ad0 tx=0x7ff308001e50 comp rx=0 tx=0).stop 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.580+0000 7ff31d400640 1 -- 172.21.15.45:0/345271975 shutdown_connections 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.580+0000 7ff31d400640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff318069c30 0x7ff318098fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.580+0000 7ff31d400640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff2f4065150 0x7ff2f4067600 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.580+0000 7ff31d400640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff3180aef70 0x7ff3180696f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.580+0000 7ff31d400640 1 --2- 172.21.15.45:0/345271975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc004780 0x7ff318150fb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.580+0000 7ff31d400640 1 -- 172.21.15.45:0/345271975 >> 172.21.15.45:0/345271975 conn(0x7ff3180cca90 msgr2=0x7ff31806e200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.580+0000 7ff31d400640 1 -- 172.21.15.45:0/345271975 shutdown_connections 2024-08-17T02:25:30.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.580+0000 7ff31d400640 1 -- 172.21.15.45:0/345271975 wait complete. 2024-08-17T02:25:30.595 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:30.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.750+0000 7fb73d600640 1 Processor -- start 2024-08-17T02:25:30.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.750+0000 7fb73d600640 1 -- start start 2024-08-17T02:25:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.752+0000 7fb73d600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb738155090 0x7fb7380abc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.752+0000 7fb73d600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb73806e060 0x7fb73815ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.752+0000 7fb73d600640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb738156870 con 0x7fb738155460 2024-08-17T02:25:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.752+0000 7fb73d600640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb738155c60 con 0x7fb73806e060 2024-08-17T02:25:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.752+0000 7fb73d600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb738155f40 con 0x7fb738155090 2024-08-17T02:25:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.752+0000 7fb73cc00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb73806e060 0x7fb73815ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.752+0000 7fb73cc00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb73806e060 0x7fb73815ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57408/0 (socket says 172.21.15.45:57408) 2024-08-17T02:25:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.752+0000 7fb73cc00640 1 -- 172.21.15.45:0/2319969935 learned_addr learned my addr 172.21.15.45:0/2319969935 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:30.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.752+0000 7fb737e00640 1 --2- 172.21.15.45:0/2319969935 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb738155090 0x7fb7380abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.752+0000 7fb73cc00640 1 -- 172.21.15.45:0/2319969935 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb738155090 msgr2=0x7fb7380abc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:30.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.752+0000 7fb73cc00640 1 --2- 172.21.15.45:0/2319969935 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb738155090 0x7fb7380abc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.753+0000 7fb73cc00640 1 -- 172.21.15.45:0/2319969935 >> v1:172.21.15.169:6789/0 conn(0x7fb738155460 legacy=0x7fb7380ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.753+0000 7fb73cc00640 1 -- 172.21.15.45:0/2319969935 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738156220 con 0x7fb73806e060 2024-08-17T02:25:30.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.753+0000 7fb737e00640 1 --2- 172.21.15.45:0/2319969935 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb738155090 0x7fb7380abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:30.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.754+0000 7fb73cc00640 1 --2- 172.21.15.45:0/2319969935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb73806e060 0x7fb73815ec90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb73000d1a0 tx=0x7fb73000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61020f5a187529c4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.755+0000 7fb736a00640 1 -- 172.21.15.45:0/2319969935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb730033650 con 0x7fb73806e060 2024-08-17T02:25:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.755+0000 7fb736a00640 1 -- 172.21.15.45:0/2319969935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7300337b0 con 0x7fb73806e060 2024-08-17T02:25:30.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.755+0000 7fb736a00640 1 -- 172.21.15.45:0/2319969935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb730033b90 con 0x7fb73806e060 2024-08-17T02:25:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.756+0000 7fb73d600640 1 -- 172.21.15.45:0/2319969935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb73806e060 msgr2=0x7fb73815ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.756+0000 7fb73d600640 1 --2- 172.21.15.45:0/2319969935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb73806e060 0x7fb73815ec90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb73000d1a0 tx=0x7fb73000ba50 comp rx=0 tx=0).stop 2024-08-17T02:25:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.756+0000 7fb73d600640 1 -- 172.21.15.45:0/2319969935 shutdown_connections 2024-08-17T02:25:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.756+0000 7fb73d600640 1 --2- 172.21.15.45:0/2319969935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb73806e060 0x7fb73815ec90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.756+0000 7fb73d600640 1 --2- 172.21.15.45:0/2319969935 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb738155090 0x7fb7380abc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.756+0000 7fb73d600640 1 -- 172.21.15.45:0/2319969935 >> 172.21.15.45:0/2319969935 conn(0x7fb738066cd0 msgr2=0x7fb7380670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.756+0000 7fb73d600640 1 -- 172.21.15.45:0/2319969935 shutdown_connections 2024-08-17T02:25:30.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.756+0000 7fb73d600640 1 -- 172.21.15.45:0/2319969935 wait complete. 2024-08-17T02:25:30.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.757+0000 7fb73d600640 1 Processor -- start 2024-08-17T02:25:30.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.757+0000 7fb73d600640 1 -- start start 2024-08-17T02:25:30.759 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.758+0000 7fb73d600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb73806e060 0x7fb7381533d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.758+0000 7fb73d600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb738155090 0x7fb73815a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.758+0000 7fb73d600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb738155460 0x7fb73815a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.758+0000 7fb73d600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb738157e00 con 0x7fb738155090 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.758+0000 7fb73d600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7381424c0 con 0x7fb73806e060 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.758+0000 7fb73d600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73815efd0 con 0x7fb738155460 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb737400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb738155090 0x7fb73815a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb737e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb73806e060 0x7fb7381533d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb737e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb73806e060 0x7fb7381533d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:38704/0 (socket says 172.21.15.45:38704) 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb737e00640 1 -- 172.21.15.45:0/3521853390 learned_addr learned my addr 172.21.15.45:0/3521853390 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb737400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb738155090 0x7fb73815a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57418/0 (socket says 172.21.15.45:57418) 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb73cc00640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb738155460 0x7fb73815a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb737400640 1 -- 172.21.15.45:0/3521853390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb738155460 msgr2=0x7fb73815a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb737400640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb738155460 0x7fb73815a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb737400640 1 -- 172.21.15.45:0/3521853390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb73806e060 msgr2=0x7fb7381533d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb737400640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb73806e060 0x7fb7381533d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb737400640 1 -- 172.21.15.45:0/3521853390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73000bcf0 con 0x7fb738155090 2024-08-17T02:25:30.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.759+0000 7fb737400640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb738155090 0x7fb73815a3a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb724000c00 tx=0x7fb724007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.760+0000 7fb72f400640 1 -- 172.21.15.45:0/3521853390 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724011590 con 0x7fb738155090 2024-08-17T02:25:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.760+0000 7fb72f400640 1 -- 172.21.15.45:0/3521853390 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7240116f0 con 0x7fb738155090 2024-08-17T02:25:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.760+0000 7fb72f400640 1 -- 172.21.15.45:0/3521853390 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724011ab0 con 0x7fb738155090 2024-08-17T02:25:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.760+0000 7fb73d600640 1 -- 172.21.15.45:0/3521853390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73815f2b0 con 0x7fb738155090 2024-08-17T02:25:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.760+0000 7fb73d600640 1 -- 172.21.15.45:0/3521853390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb738158330 con 0x7fb738155090 2024-08-17T02:25:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.761+0000 7fb73d600640 1 -- 172.21.15.45:0/3521853390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb738158580 con 0x7fb738155090 2024-08-17T02:25:30.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.761+0000 7fb72f400640 1 -- 172.21.15.45:0/3521853390 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb72401b3b0 con 0x7fb738155090 2024-08-17T02:25:30.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.762+0000 7fb72f400640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb718065150 0x7fb718067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:30.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.762+0000 7fb72f400640 1 -- 172.21.15.45:0/3521853390 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb724081800 con 0x7fb738155090 2024-08-17T02:25:30.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.763+0000 7fb737e00640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb718065150 0x7fb718067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:30.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.763+0000 7fb737e00640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb718065150 0x7fb718067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb728007ce0 tx=0x7fb728008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:30.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.766+0000 7fb72f400640 1 -- 172.21.15.45:0/3521853390 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb72404f8d0 con 0x7fb738155090 2024-08-17T02:25:30.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.946+0000 7fb73d600640 1 -- 172.21.15.45:0/3521853390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb7380aab00 con 0x7fb738155090 2024-08-17T02:25:30.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.947+0000 7fb72f400640 1 -- 172.21.15.45:0/3521853390 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7380aab00 con 0x7fb738155090 2024-08-17T02:25:30.948 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-08-17T02:25:30.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 -- 172.21.15.45:0/3521853390 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb718065150 msgr2=0x7fb718067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb718065150 0x7fb718067600 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb728007ce0 tx=0x7fb728008040 comp rx=0 tx=0).stop 2024-08-17T02:25:30.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 -- 172.21.15.45:0/3521853390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb738155090 msgr2=0x7fb73815a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:30.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb738155090 0x7fb73815a3a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb724000c00 tx=0x7fb724007e10 comp rx=0 tx=0).stop 2024-08-17T02:25:30.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 -- 172.21.15.45:0/3521853390 shutdown_connections 2024-08-17T02:25:30.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb718065150 0x7fb718067600 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb738155460 0x7fb73815a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb738155090 0x7fb73815a3a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 --2- 172.21.15.45:0/3521853390 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb73806e060 0x7fb7381533d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:30.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 -- 172.21.15.45:0/3521853390 >> 172.21.15.45:0/3521853390 conn(0x7fb738066cd0 msgr2=0x7fb7380a9ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:30.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 -- 172.21.15.45:0/3521853390 shutdown_connections 2024-08-17T02:25:30.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:30.949+0000 7fb73d600640 1 -- 172.21.15.45:0/3521853390 wait complete. 2024-08-17T02:25:30.964 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:31.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.115+0000 7fc316a00640 1 Processor -- start 2024-08-17T02:25:31.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.115+0000 7fc316a00640 1 -- start start 2024-08-17T02:25:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.116+0000 7fc316a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3100b1440 0x7fc3100caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.116+0000 7fc316a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc310140580 0x7fc3100c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.116+0000 7fc316a00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3100caa80 con 0x7fc3101401b0 2024-08-17T02:25:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.116+0000 7fc316a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3100cb450 con 0x7fc310140580 2024-08-17T02:25:31.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.116+0000 7fc316a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100c9e70 con 0x7fc3100b1440 2024-08-17T02:25:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.117+0000 7fc307400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3100b1440 0x7fc3100caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.117+0000 7fc307400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3100b1440 0x7fc3100caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:58720/0 (socket says 172.21.15.45:58720) 2024-08-17T02:25:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.117+0000 7fc307400640 1 -- 172.21.15.45:0/1173528554 learned_addr learned my addr 172.21.15.45:0/1173528554 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.117+0000 7fc314a00640 1 --2- 172.21.15.45:0/1173528554 >> v2:172.21.15.169:3300/0 conn(0x7fc310140580 0x7fc3100c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.117+0000 7fc307400640 1 -- 172.21.15.45:0/1173528554 >> v2:172.21.15.169:3300/0 conn(0x7fc310140580 msgr2=0x7fc3100c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.117+0000 7fc307400640 1 --2- 172.21.15.45:0/1173528554 >> v2:172.21.15.169:3300/0 conn(0x7fc310140580 0x7fc3100c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.117+0000 7fc307400640 1 -- 172.21.15.45:0/1173528554 >> v1:172.21.15.169:6789/0 conn(0x7fc3101401b0 legacy=0x7fc3100b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.117+0000 7fc307400640 1 -- 172.21.15.45:0/1173528554 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3100ca150 con 0x7fc3100b1440 2024-08-17T02:25:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.118+0000 7fc307400640 1 --2- 172.21.15.45:0/1173528554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3100b1440 0x7fc3100caf10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009910 tx=0x7fc2f80091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c783591c6294b4e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.119+0000 7fc30f400640 1 -- 172.21.15.45:0/1173528554 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f802ae40 con 0x7fc3100b1440 2024-08-17T02:25:31.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.119+0000 7fc30f400640 1 -- 172.21.15.45:0/1173528554 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f8032440 con 0x7fc3100b1440 2024-08-17T02:25:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.119+0000 7fc30f400640 1 -- 172.21.15.45:0/1173528554 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8032820 con 0x7fc3100b1440 2024-08-17T02:25:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.119+0000 7fc316a00640 1 -- 172.21.15.45:0/1173528554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3100b1440 msgr2=0x7fc3100caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.119+0000 7fc316a00640 1 --2- 172.21.15.45:0/1173528554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3100b1440 0x7fc3100caf10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009910 tx=0x7fc2f80091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.119+0000 7fc316a00640 1 -- 172.21.15.45:0/1173528554 shutdown_connections 2024-08-17T02:25:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.119+0000 7fc316a00640 1 --2- 172.21.15.45:0/1173528554 >> v2:172.21.15.169:3300/0 conn(0x7fc310140580 0x7fc3100c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.119+0000 7fc316a00640 1 --2- 172.21.15.45:0/1173528554 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3100b1440 0x7fc3100caf10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.119+0000 7fc316a00640 1 -- 172.21.15.45:0/1173528554 >> 172.21.15.45:0/1173528554 conn(0x7fc3100cb9b0 msgr2=0x7fc3100cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.120+0000 7fc316a00640 1 -- 172.21.15.45:0/1173528554 shutdown_connections 2024-08-17T02:25:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.120+0000 7fc316a00640 1 -- 172.21.15.45:0/1173528554 wait complete. 2024-08-17T02:25:31.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.121+0000 7fc316a00640 1 Processor -- start 2024-08-17T02:25:31.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.121+0000 7fc316a00640 1 -- start start 2024-08-17T02:25:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.122+0000 7fc316a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3100b1440 0x7fc31013f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.122+0000 7fc316a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3101401b0 0x7fc310169020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.122+0000 7fc316a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc310140580 0x7fc3100abd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.122+0000 7fc316a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100aee70 con 0x7fc310140580 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.122+0000 7fc316a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100ab8d0 con 0x7fc3100b1440 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.122+0000 7fc316a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3100aacc0 con 0x7fc3101401b0 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.122+0000 7fc314a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc310140580 0x7fc3100abd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.122+0000 7fc314a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc310140580 0x7fc3100abd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57422/0 (socket says 172.21.15.45:57422) 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.122+0000 7fc314a00640 1 -- 172.21.15.45:0/1227860165 learned_addr learned my addr 172.21.15.45:0/1227860165 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.122+0000 7fc307400640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3101401b0 0x7fc310169020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.122+0000 7fc30fe00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3100b1440 0x7fc31013f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.123+0000 7fc314a00640 1 -- 172.21.15.45:0/1227860165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3101401b0 msgr2=0x7fc310169020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.123+0000 7fc314a00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3101401b0 0x7fc310169020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.123+0000 7fc314a00640 1 -- 172.21.15.45:0/1227860165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3100b1440 msgr2=0x7fc31013f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.123+0000 7fc314a00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3100b1440 0x7fc31013f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.123+0000 7fc314a00640 1 -- 172.21.15.45:0/1227860165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f8009450 con 0x7fc310140580 2024-08-17T02:25:31.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.123+0000 7fc314a00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc310140580 0x7fc3100abd60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc308009e90 tx=0x7fc30800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.123+0000 7fc307e00640 1 -- 172.21.15.45:0/1227860165 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30800ce10 con 0x7fc310140580 2024-08-17T02:25:31.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.123+0000 7fc307e00640 1 -- 172.21.15.45:0/1227860165 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30800f040 con 0x7fc310140580 2024-08-17T02:25:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.123+0000 7fc316a00640 1 -- 172.21.15.45:0/1227860165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3100aafa0 con 0x7fc310140580 2024-08-17T02:25:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.123+0000 7fc307e00640 1 -- 172.21.15.45:0/1227860165 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3080146d0 con 0x7fc310140580 2024-08-17T02:25:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.123+0000 7fc316a00640 1 -- 172.21.15.45:0/1227860165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3100ab560 con 0x7fc310140580 2024-08-17T02:25:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.125+0000 7fc316a00640 1 -- 172.21.15.45:0/1227860165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3100aba60 con 0x7fc310140580 2024-08-17T02:25:31.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.125+0000 7fc307e00640 1 -- 172.21.15.45:0/1227860165 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc308014a80 con 0x7fc310140580 2024-08-17T02:25:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.126+0000 7fc307e00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc2ec065150 0x7fc2ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.126+0000 7fc307e00640 1 -- 172.21.15.45:0/1227860165 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc308082fd0 con 0x7fc310140580 2024-08-17T02:25:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.126+0000 7fc30fe00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc2ec065150 0x7fc2ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.127+0000 7fc30fe00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc2ec065150 0x7fc2ec067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc300007fd0 tx=0x7fc300007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.130+0000 7fc307e00640 1 -- 172.21.15.45:0/1227860165 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc308054b30 con 0x7fc310140580 2024-08-17T02:25:31.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.352+0000 7fc316a00640 1 -- 172.21.15.45:0/1227860165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc310064db0 con 0x7fc310140580 2024-08-17T02:25:31.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.353+0000 7fc307e00640 1 -- 172.21.15.45:0/1227860165 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fc308018090 con 0x7fc310140580 2024-08-17T02:25:31.354 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:31.354 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1637538519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1637538519},{"type":"v1","addr":"172.21.15.45:6837","nonce":1637538519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1027153973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1027153973},{"type":"v1","addr":"172.21.15.169:6835","nonce":1027153973}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2482387224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2482387224},{"type":"v1","addr":"172.21.15.45:6835","nonce":2482387224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:14.095016+0000","modified":"2024-08-17T02:25:17.687006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6834/911178485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":911178485},{"type":"v1","addr":"172.21.15.169:6834","nonce":911178485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:31.354 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2024-08-17T02:25:31.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.355+0000 7fc316a00640 1 -- 172.21.15.45:0/1227860165 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc2ec065150 msgr2=0x7fc2ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.355+0000 7fc316a00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc2ec065150 0x7fc2ec067600 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc300007fd0 tx=0x7fc300007e30 comp rx=0 tx=0).stop 2024-08-17T02:25:31.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.355+0000 7fc316a00640 1 -- 172.21.15.45:0/1227860165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc310140580 msgr2=0x7fc3100abd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.355+0000 7fc316a00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc310140580 0x7fc3100abd60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc308009e90 tx=0x7fc30800b040 comp rx=0 tx=0).stop 2024-08-17T02:25:31.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.355+0000 7fc316a00640 1 -- 172.21.15.45:0/1227860165 shutdown_connections 2024-08-17T02:25:31.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.355+0000 7fc316a00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc310140580 0x7fc3100abd60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.355+0000 7fc316a00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc2ec065150 0x7fc2ec067600 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.355+0000 7fc316a00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3101401b0 0x7fc310169020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.355+0000 7fc316a00640 1 --2- 172.21.15.45:0/1227860165 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3100b1440 0x7fc31013f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.355+0000 7fc316a00640 1 -- 172.21.15.45:0/1227860165 >> 172.21.15.45:0/1227860165 conn(0x7fc3100cb9b0 msgr2=0x7fc31006dfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:31.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.356+0000 7fc316a00640 1 -- 172.21.15.45:0/1227860165 shutdown_connections 2024-08-17T02:25:31.357 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.356+0000 7fc316a00640 1 -- 172.21.15.45:0/1227860165 wait complete. 2024-08-17T02:25:31.371 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:31.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.521+0000 7fb2e2c00640 1 Processor -- start 2024-08-17T02:25:31.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.521+0000 7fb2e2c00640 1 -- start start 2024-08-17T02:25:31.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.523+0000 7fb2e2c00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb2dc0acd60 0x7fb2dc156f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.523+0000 7fb2e2c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2dc0aeaa0 con 0x7fb2dc066cd0 2024-08-17T02:25:31.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.523+0000 7fb2e2c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2dc0cb310 con 0x7fb2dc1574b0 2024-08-17T02:25:31.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.523+0000 7fb2e2c00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2dc0ca9e0 con 0x7fb2dc0acd60 2024-08-17T02:25:31.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.523+0000 7fb2e2200640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb2dc066cd0 0x7fb2dc0cb7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33542/0 (socket says 172.21.15.45:33542) 2024-08-17T02:25:31.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.523+0000 7fb2e2200640 1 -- 172.21.15.45:0/4282573482 learned_addr learned my addr 172.21.15.45:0/4282573482 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:31.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.523+0000 7fb2e1800640 1 --2- 172.21.15.45:0/4282573482 >> v2:172.21.15.169:3300/0 conn(0x7fb2dc0acd60 0x7fb2dc156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.523+0000 7fb2dbe00640 1 -- 172.21.15.45:0/4282573482 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3011217603 0 0) 0x7fb2dc0aeaa0 con 0x7fb2dc066cd0 2024-08-17T02:25:31.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.523+0000 7fb2dbe00640 1 -- 172.21.15.45:0/4282573482 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2c40034e0 con 0x7fb2dc066cd0 2024-08-17T02:25:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.524+0000 7fb2e1800640 1 -- 172.21.15.45:0/4282573482 >> v1:172.21.15.169:6789/0 conn(0x7fb2dc1574b0 legacy=0x7fb2dc0ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.524+0000 7fb2e1800640 1 -- 172.21.15.45:0/4282573482 >> v1:172.21.15.45:6789/0 conn(0x7fb2dc066cd0 legacy=0x7fb2dc0cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.524+0000 7fb2e1800640 1 -- 172.21.15.45:0/4282573482 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2dc0cacc0 con 0x7fb2dc0acd60 2024-08-17T02:25:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.525+0000 7fb2e1800640 1 --2- 172.21.15.45:0/4282573482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2dc0acd60 0x7fb2dc156f70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009850 tx=0x7fb2d00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c9dffeadfa1fc68 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.525+0000 7fb2dbe00640 1 -- 172.21.15.45:0/4282573482 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d002ad90 con 0x7fb2dc0acd60 2024-08-17T02:25:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.525+0000 7fb2dbe00640 1 -- 172.21.15.45:0/4282573482 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d0032440 con 0x7fb2dc0acd60 2024-08-17T02:25:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.525+0000 7fb2dbe00640 1 -- 172.21.15.45:0/4282573482 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0032820 con 0x7fb2dc0acd60 2024-08-17T02:25:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.525+0000 7fb2e2c00640 1 -- 172.21.15.45:0/4282573482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2dc0acd60 msgr2=0x7fb2dc156f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.525+0000 7fb2e2c00640 1 --2- 172.21.15.45:0/4282573482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2dc0acd60 0x7fb2dc156f70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009850 tx=0x7fb2d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.526+0000 7fb2e2c00640 1 -- 172.21.15.45:0/4282573482 shutdown_connections 2024-08-17T02:25:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.526+0000 7fb2e2c00640 1 --2- 172.21.15.45:0/4282573482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2dc0acd60 0x7fb2dc156f70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.526+0000 7fb2e2c00640 1 -- 172.21.15.45:0/4282573482 >> 172.21.15.45:0/4282573482 conn(0x7fb2dc067de0 msgr2=0x7fb2dc0681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.526+0000 7fb2e2c00640 1 -- 172.21.15.45:0/4282573482 shutdown_connections 2024-08-17T02:25:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.526+0000 7fb2e2c00640 1 -- 172.21.15.45:0/4282573482 wait complete. 2024-08-17T02:25:31.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.527+0000 7fb2e2c00640 1 Processor -- start 2024-08-17T02:25:31.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.527+0000 7fb2e2c00640 1 -- start start 2024-08-17T02:25:31.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e2c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc066cd0 0x7fb2dc0a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e2c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2dc0acd60 0x7fb2dc141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e2c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2dc1574b0 0x7fb2dc0ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e2c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc0ac6e0 con 0x7fb2dc066cd0 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e2c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc0a7cd0 con 0x7fb2dc1574b0 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e2c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2dc141f90 con 0x7fb2dc0acd60 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e1800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc066cd0 0x7fb2dc0a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e1800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc066cd0 0x7fb2dc0a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57436/0 (socket says 172.21.15.45:57436) 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e1800640 1 -- 172.21.15.45:0/3437756640 learned_addr learned my addr 172.21.15.45:0/3437756640 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e2200640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2dc1574b0 0x7fb2dc0ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e0e00640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2dc0acd60 0x7fb2dc141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.528+0000 7fb2e1800640 1 -- 172.21.15.45:0/3437756640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2dc0acd60 msgr2=0x7fb2dc141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.529+0000 7fb2e1800640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2dc0acd60 0x7fb2dc141a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.529+0000 7fb2e1800640 1 -- 172.21.15.45:0/3437756640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2dc1574b0 msgr2=0x7fb2dc0ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.529+0000 7fb2e1800640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2dc1574b0 0x7fb2dc0ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.529+0000 7fb2e1800640 1 -- 172.21.15.45:0/3437756640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d0009390 con 0x7fb2dc066cd0 2024-08-17T02:25:31.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.529+0000 7fb2e1800640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc066cd0 0x7fb2dc0a70c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00098b0 tx=0x7fb2d0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.529+0000 7fb2d8c00640 1 -- 172.21.15.45:0/3437756640 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0031de0 con 0x7fb2dc066cd0 2024-08-17T02:25:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.529+0000 7fb2d8c00640 1 -- 172.21.15.45:0/3437756640 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d003c400 con 0x7fb2dc066cd0 2024-08-17T02:25:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.529+0000 7fb2e2c00640 1 -- 172.21.15.45:0/3437756640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2dc0ac120 con 0x7fb2dc066cd0 2024-08-17T02:25:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.529+0000 7fb2d8c00640 1 -- 172.21.15.45:0/3437756640 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d003c800 con 0x7fb2dc066cd0 2024-08-17T02:25:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.529+0000 7fb2e2c00640 1 -- 172.21.15.45:0/3437756640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2dc0a7960 con 0x7fb2dc066cd0 2024-08-17T02:25:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.530+0000 7fb2e2c00640 1 -- 172.21.15.45:0/3437756640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2dc071050 con 0x7fb2dc066cd0 2024-08-17T02:25:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.531+0000 7fb2d8c00640 1 -- 172.21.15.45:0/3437756640 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb2d003cc30 con 0x7fb2dc066cd0 2024-08-17T02:25:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.532+0000 7fb2d8c00640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb2bc065150 0x7fb2bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.532+0000 7fb2d8c00640 1 -- 172.21.15.45:0/3437756640 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2d00a32a0 con 0x7fb2dc066cd0 2024-08-17T02:25:31.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.532+0000 7fb2e0e00640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb2bc065150 0x7fb2bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.533 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.533+0000 7fb2e0e00640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb2bc065150 0x7fb2bc067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc16a1f0 tx=0x7fb2c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.536+0000 7fb2d8c00640 1 -- 172.21.15.45:0/3437756640 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb2d0071380 con 0x7fb2dc066cd0 2024-08-17T02:25:31.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.718+0000 7fb2e2c00640 1 -- 172.21.15.45:0/3437756640 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2dc068bd0 con 0x7fb2dc066cd0 2024-08-17T02:25:31.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.719+0000 7fb2d8c00640 1 -- 172.21.15.45:0/3437756640 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb2d00749a0 con 0x7fb2dc066cd0 2024-08-17T02:25:31.720 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:31.720 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 -- 172.21.15.45:0/3437756640 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb2bc065150 msgr2=0x7fb2bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb2bc065150 0x7fb2bc067600 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb2dc16a1f0 tx=0x7fb2c8009040 comp rx=0 tx=0).stop 2024-08-17T02:25:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 -- 172.21.15.45:0/3437756640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc066cd0 msgr2=0x7fb2dc0a70c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc066cd0 0x7fb2dc0a70c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb2d00098b0 tx=0x7fb2d0032000 comp rx=0 tx=0).stop 2024-08-17T02:25:31.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 -- 172.21.15.45:0/3437756640 shutdown_connections 2024-08-17T02:25:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb2dc1574b0 0x7fb2dc0ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb2bc065150 0x7fb2bc067600 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb2dc0acd60 0x7fb2dc141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 --2- 172.21.15.45:0/3437756640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2dc066cd0 0x7fb2dc0a70c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 -- 172.21.15.45:0/3437756640 >> 172.21.15.45:0/3437756640 conn(0x7fb2dc067de0 msgr2=0x7fb2dc0cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 -- 172.21.15.45:0/3437756640 shutdown_connections 2024-08-17T02:25:31.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.721+0000 7fb2e2c00640 1 -- 172.21.15.45:0/3437756640 wait complete. 2024-08-17T02:25:31.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:31.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.889+0000 7fdfa0800640 1 Processor -- start 2024-08-17T02:25:31.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.889+0000 7fdfa0800640 1 -- start start 2024-08-17T02:25:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.890+0000 7fdfa0800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980b1120 0x7fdf980aedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.890+0000 7fdfa0800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf980b3370 0x7fdf980b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.890+0000 7fdfa0800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf980d0ab0 con 0x7fdf980ada10 2024-08-17T02:25:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.890+0000 7fdfa0800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf980b00c0 con 0x7fdf980b3370 2024-08-17T02:25:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.890+0000 7fdfa0800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980af330 con 0x7fdf980b1120 2024-08-17T02:25:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.890+0000 7fdf9e800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf980b3370 0x7fdf980b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.890+0000 7fdf9e800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdf980b3370 0x7fdf980b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47880/0 (socket says 172.21.15.45:47880) 2024-08-17T02:25:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.890+0000 7fdf9e800640 1 -- 172.21.15.45:0/4188660945 learned_addr learned my addr 172.21.15.45:0/4188660945 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:31.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.891+0000 7fdf9d400640 1 --2- 172.21.15.45:0/4188660945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980b1120 0x7fdf980aedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.891+0000 7fdf9e800640 1 -- 172.21.15.45:0/4188660945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980b1120 msgr2=0x7fdf980aedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:31.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.891+0000 7fdf9e800640 1 --2- 172.21.15.45:0/4188660945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980b1120 0x7fdf980aedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.891+0000 7fdf9e800640 1 -- 172.21.15.45:0/4188660945 >> v1:172.21.15.169:6789/0 conn(0x7fdf980ada10 legacy=0x7fdf980b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.891+0000 7fdf9e800640 1 -- 172.21.15.45:0/4188660945 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf980b0360 con 0x7fdf980b3370 2024-08-17T02:25:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.892+0000 7fdf9e800640 1 --2- 172.21.15.45:0/4188660945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf980b3370 0x7fdf980b37f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009f20 tx=0x7fdf94009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5af475f96343dd7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.892+0000 7fdf9ca00640 1 -- 172.21.15.45:0/4188660945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94032450 con 0x7fdf980b3370 2024-08-17T02:25:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.892+0000 7fdf9ca00640 1 -- 172.21.15.45:0/4188660945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf940325b0 con 0x7fdf980b3370 2024-08-17T02:25:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.892+0000 7fdf9ca00640 1 -- 172.21.15.45:0/4188660945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94032990 con 0x7fdf980b3370 2024-08-17T02:25:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.893+0000 7fdfa0800640 1 -- 172.21.15.45:0/4188660945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf980b3370 msgr2=0x7fdf980b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.893+0000 7fdfa0800640 1 --2- 172.21.15.45:0/4188660945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf980b3370 0x7fdf980b37f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fdf94009f20 tx=0x7fdf94009840 comp rx=0 tx=0).stop 2024-08-17T02:25:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.893+0000 7fdfa0800640 1 -- 172.21.15.45:0/4188660945 shutdown_connections 2024-08-17T02:25:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.893+0000 7fdfa0800640 1 --2- 172.21.15.45:0/4188660945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf980b3370 0x7fdf980b37f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.893+0000 7fdfa0800640 1 --2- 172.21.15.45:0/4188660945 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980b1120 0x7fdf980aedf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.893+0000 7fdfa0800640 1 -- 172.21.15.45:0/4188660945 >> 172.21.15.45:0/4188660945 conn(0x7fdf980cfdf0 msgr2=0x7fdf980d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.893+0000 7fdfa0800640 1 -- 172.21.15.45:0/4188660945 shutdown_connections 2024-08-17T02:25:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.893+0000 7fdfa0800640 1 -- 172.21.15.45:0/4188660945 wait complete. 2024-08-17T02:25:31.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.894+0000 7fdfa0800640 1 Processor -- start 2024-08-17T02:25:31.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.894+0000 7fdfa0800640 1 -- start start 2024-08-17T02:25:31.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.895+0000 7fdfa0800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf980ada10 0x7fdf9814cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.895+0000 7fdfa0800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980b1120 0x7fdf98159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.895+0000 7fdfa0800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf980b3370 0x7fdf98157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.895+0000 7fdfa0800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9815a9f0 con 0x7fdf980b3370 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.895+0000 7fdfa0800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9815afb0 con 0x7fdf980ada10 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.895+0000 7fdfa0800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf98159ef0 con 0x7fdf980b1120 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.895+0000 7fdf9e800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf980b3370 0x7fdf98157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.895+0000 7fdf9e800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf980b3370 0x7fdf98157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47894/0 (socket says 172.21.15.45:47894) 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.895+0000 7fdf9e800640 1 -- 172.21.15.45:0/1815082148 learned_addr learned my addr 172.21.15.45:0/1815082148 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.895+0000 7fdf9d400640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980b1120 0x7fdf98159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.895+0000 7fdf9de00640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf980ada10 0x7fdf9814cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.896+0000 7fdf9e800640 1 -- 172.21.15.45:0/1815082148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980b1120 msgr2=0x7fdf98159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.896+0000 7fdf9e800640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980b1120 0x7fdf98159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.896+0000 7fdf9e800640 1 -- 172.21.15.45:0/1815082148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf980ada10 msgr2=0x7fdf9814cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:31.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.896+0000 7fdf9e800640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf980ada10 0x7fdf9814cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:31.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.896+0000 7fdf9e800640 1 -- 172.21.15.45:0/1815082148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf94009ae0 con 0x7fdf980b3370 2024-08-17T02:25:31.898 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.896+0000 7fdf9e800640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf980b3370 0x7fdf98157a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf9402adc0 tx=0x7fdf94037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.896+0000 7fdf91600640 1 -- 172.21.15.45:0/1815082148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf94032450 con 0x7fdf980b3370 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.896+0000 7fdf91600640 1 -- 172.21.15.45:0/1815082148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf94007170 con 0x7fdf980b3370 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.896+0000 7fdf91600640 1 -- 172.21.15.45:0/1815082148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf9403d650 con 0x7fdf980b3370 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.896+0000 7fdfa0800640 1 -- 172.21.15.45:0/1815082148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf9815a1d0 con 0x7fdf980b3370 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.897+0000 7fdfa0800640 1 -- 172.21.15.45:0/1815082148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf980cef50 con 0x7fdf980b3370 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.898+0000 7fdfa0800640 1 -- 172.21.15.45:0/1815082148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9815f8c0 con 0x7fdf980b3370 2024-08-17T02:25:31.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.898+0000 7fdf91600640 1 -- 172.21.15.45:0/1815082148 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdf94003020 con 0x7fdf980b3370 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.899+0000 7fdf91600640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf7c065180 0x7fdf7c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.900+0000 7fdf91600640 1 -- 172.21.15.45:0/1815082148 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdf9402e050 con 0x7fdf980b3370 2024-08-17T02:25:31.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.900+0000 7fdf9de00640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf7c065180 0x7fdf7c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:31.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.900+0000 7fdf9de00640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf7c065180 0x7fdf7c067630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdf98150600 tx=0x7fdf8c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:31.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:31.904+0000 7fdf91600640 1 -- 172.21.15.45:0/1815082148 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdf94071600 con 0x7fdf980b3370 2024-08-17T02:25:32.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.126+0000 7fdfa0800640 1 -- 172.21.15.45:0/1815082148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf9815ade0 con 0x7fdf980b3370 2024-08-17T02:25:32.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.127+0000 7fdf91600640 1 -- 172.21.15.45:0/1815082148 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fdf94074c20 con 0x7fdf980b3370 2024-08-17T02:25:32.128 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:32.128 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1637538519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1637538519},{"type":"v1","addr":"172.21.15.45:6837","nonce":1637538519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1027153973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1027153973},{"type":"v1","addr":"172.21.15.169:6835","nonce":1027153973}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2482387224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2482387224},{"type":"v1","addr":"172.21.15.45:6835","nonce":2482387224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:14.095016+0000","modified":"2024-08-17T02:25:17.687006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6834/911178485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":911178485},{"type":"v1","addr":"172.21.15.169:6834","nonce":911178485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:32.128 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2024-08-17T02:25:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 -- 172.21.15.45:0/1815082148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf7c065180 msgr2=0x7fdf7c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf7c065180 0x7fdf7c067630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdf98150600 tx=0x7fdf8c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 -- 172.21.15.45:0/1815082148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf980b3370 msgr2=0x7fdf98157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf980b3370 0x7fdf98157a20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdf9402adc0 tx=0x7fdf94037000 comp rx=0 tx=0).stop 2024-08-17T02:25:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 -- 172.21.15.45:0/1815082148 shutdown_connections 2024-08-17T02:25:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdf980b3370 0x7fdf98157a20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf7c065180 0x7fdf7c067630 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdf980b1120 0x7fdf98159430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 --2- 172.21.15.45:0/1815082148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdf980ada10 0x7fdf9814cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 -- 172.21.15.45:0/1815082148 >> 172.21.15.45:0/1815082148 conn(0x7fdf980cfdf0 msgr2=0x7fdf980b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 -- 172.21.15.45:0/1815082148 shutdown_connections 2024-08-17T02:25:32.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.129+0000 7fdfa0800640 1 -- 172.21.15.45:0/1815082148 wait complete. 2024-08-17T02:25:32.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:25:14.095016+0000', 'modified': '2024-08-17T02:25:17.687006+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4291}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4291': {'gid': 4291, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.169:6834/911178485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.169:6832', 'nonce': 911178485}, {'type': 'v1', 'addr': '172.21.15.169:6834', 'nonce': 911178485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:25:32.548 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:25:32.549 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-08-17T02:25:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.703+0000 7f4271000640 1 Processor -- start 2024-08-17T02:25:32.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.703+0000 7f4271000640 1 -- start start 2024-08-17T02:25:32.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.703+0000 7f4271000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f426c158ce0 0x7f426c0c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.703+0000 7f4271000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f426c0cb340 0x7f426c1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.703+0000 7f4271000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f426c0cb7c0 con 0x7f426c0d08d0 2024-08-17T02:25:32.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.703+0000 7f4271000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426c0cf0c0 con 0x7f426c0cb340 2024-08-17T02:25:32.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.703+0000 7f4271000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c089000 con 0x7f426c158ce0 2024-08-17T02:25:32.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.704+0000 7f426a800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f426c0cb340 0x7f426c1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.704+0000 7f4269e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f426c158ce0 0x7f426c0c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.704+0000 7f426a800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f426c0cb340 0x7f426c1590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:55198/0 (socket says 172.21.15.45:55198) 2024-08-17T02:25:32.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.704+0000 7f426a800640 1 -- 172.21.15.45:0/3162282923 learned_addr learned my addr 172.21.15.45:0/3162282923 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:32.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.704+0000 7f4269400640 1 --1- 172.21.15.45:0/3162282923 >> v1:172.21.15.169:6789/0 conn(0x7f426c0d08d0 0x7f426c0cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:43820/0 (socket says 172.21.15.45:43820) 2024-08-17T02:25:32.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.704+0000 7f426a800640 1 -- 172.21.15.45:0/3162282923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f426c158ce0 msgr2=0x7f426c0c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.704+0000 7f426a800640 1 --2- 172.21.15.45:0/3162282923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f426c158ce0 0x7f426c0c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.704+0000 7f426a800640 1 -- 172.21.15.45:0/3162282923 >> v1:172.21.15.169:6789/0 conn(0x7f426c0d08d0 legacy=0x7f426c0cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.704+0000 7f426a800640 1 -- 172.21.15.45:0/3162282923 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c0ceb20 con 0x7f426c0cb340 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.705+0000 7f426a800640 1 --2- 172.21.15.45:0/3162282923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f426c0cb340 0x7f426c1590b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4264009f50 tx=0x7f4264009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a96c379359bb0477 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.705+0000 7f4268a00640 1 -- 172.21.15.45:0/3162282923 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264033410 con 0x7f426c0cb340 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.705+0000 7f4268a00640 1 -- 172.21.15.45:0/3162282923 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4264033570 con 0x7f426c0cb340 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.705+0000 7f4268a00640 1 -- 172.21.15.45:0/3162282923 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264033950 con 0x7f426c0cb340 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.706+0000 7f4271000640 1 -- 172.21.15.45:0/3162282923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f426c0cb340 msgr2=0x7f426c1590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.706+0000 7f4271000640 1 --2- 172.21.15.45:0/3162282923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f426c0cb340 0x7f426c1590b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4264009f50 tx=0x7f4264009840 comp rx=0 tx=0).stop 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.706+0000 7f4271000640 1 -- 172.21.15.45:0/3162282923 shutdown_connections 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.706+0000 7f4271000640 1 --2- 172.21.15.45:0/3162282923 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f426c0cb340 0x7f426c1590b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.706+0000 7f4271000640 1 --2- 172.21.15.45:0/3162282923 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f426c158ce0 0x7f426c0c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.706+0000 7f4271000640 1 -- 172.21.15.45:0/3162282923 >> 172.21.15.45:0/3162282923 conn(0x7f426c0cfdc0 msgr2=0x7f426c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.706+0000 7f4271000640 1 -- 172.21.15.45:0/3162282923 shutdown_connections 2024-08-17T02:25:32.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.706+0000 7f4271000640 1 -- 172.21.15.45:0/3162282923 wait complete. 2024-08-17T02:25:32.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.707+0000 7f4271000640 1 Processor -- start 2024-08-17T02:25:32.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.708+0000 7f4271000640 1 -- start start 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.708+0000 7f4271000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f426c0cb340 0x7f426c150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4271000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f426c0d08d0 0x7f426c14e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4271000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f426c158ce0 0x7f426c0c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4271000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c150780 con 0x7f426c0d08d0 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4271000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426c14fb70 con 0x7f426c158ce0 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4271000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426c14fe50 con 0x7f426c0cb340 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4269400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f426c0d08d0 0x7f426c14e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4269400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f426c0d08d0 0x7f426c14e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47898/0 (socket says 172.21.15.45:47898) 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4269400640 1 -- 172.21.15.45:0/3898931155 learned_addr learned my addr 172.21.15.45:0/3898931155 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f426a800640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f426c158ce0 0x7f426c0c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4269e00640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f426c0cb340 0x7f426c150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.711 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4269400640 1 -- 172.21.15.45:0/3898931155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f426c0cb340 msgr2=0x7f426c150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4269400640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f426c0cb340 0x7f426c150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4269400640 1 -- 172.21.15.45:0/3898931155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f426c158ce0 msgr2=0x7f426c0c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4269400640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f426c158ce0 0x7f426c0c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4269400640 1 -- 172.21.15.45:0/3898931155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264009ae0 con 0x7f426c0d08d0 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f4269e00640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f426c0cb340 0x7f426c150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.709+0000 7f426a800640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f426c158ce0 0x7f426c0c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.710+0000 7f4269400640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f426c0d08d0 0x7f426c14e220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f425800c4e0 tx=0x7f4258007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.710+0000 7f4261600640 1 -- 172.21.15.45:0/3898931155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42580072e0 con 0x7f426c0d08d0 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.710+0000 7f4261600640 1 -- 172.21.15.45:0/3898931155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4258007460 con 0x7f426c0d08d0 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.710+0000 7f4261600640 1 -- 172.21.15.45:0/3898931155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42580047a0 con 0x7f426c0d08d0 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.710+0000 7f4271000640 1 -- 172.21.15.45:0/3898931155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426c150130 con 0x7f426c0d08d0 2024-08-17T02:25:32.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.710+0000 7f4271000640 1 -- 172.21.15.45:0/3898931155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c14e760 con 0x7f426c0d08d0 2024-08-17T02:25:32.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.713+0000 7f4261600640 1 -- 172.21.15.45:0/3898931155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4258004bf0 con 0x7f426c0d08d0 2024-08-17T02:25:32.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.714+0000 7f4261600640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f424c065150 0x7f424c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.714+0000 7f42735ea740 1 Processor -- start 2024-08-17T02:25:32.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.714+0000 7f4261600640 1 -- 172.21.15.45:0/3898931155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4258081e30 con 0x7f426c0d08d0 2024-08-17T02:25:32.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.714+0000 7f42735ea740 1 -- start start 2024-08-17T02:25:32.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.715+0000 7f4269e00640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f424c065150 0x7f424c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.715+0000 7f4269e00640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f424c065150 0x7f424c067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f425c009cf0 tx=0x7f425c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.715+0000 7f42735ea740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db5421a30 0x557db5421e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.715+0000 7f42735ea740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db53fd0a0 0x557db543f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f42735ea740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db53f6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f42735ea740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557db53b7380 con 0x557db543fb10 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f42735ea740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x557db53609e0 con 0x557db53fd0a0 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f42735ea740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x557db535e170 con 0x557db5421a30 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f426a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db53f6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f426a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db53f6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47912/0 (socket says 172.21.15.45:47912) 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f426a800640 1 -- 172.21.15.45:0/1096819246 learned_addr learned my addr 172.21.15.45:0/1096819246 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f4269400640 1 --2- 172.21.15.45:0/1096819246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db53fd0a0 0x557db543f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f4269e00640 1 --2- 172.21.15.45:0/1096819246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db5421a30 0x557db5421e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f426a800640 1 -- 172.21.15.45:0/1096819246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db5421a30 msgr2=0x557db5421e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f426a800640 1 --2- 172.21.15.45:0/1096819246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db5421a30 0x557db5421e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f426a800640 1 -- 172.21.15.45:0/1096819246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db53fd0a0 msgr2=0x557db543f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f426a800640 1 --2- 172.21.15.45:0/1096819246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db53fd0a0 0x557db543f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f426a800640 1 -- 172.21.15.45:0/1096819246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557db530d820 con 0x557db543fb10 2024-08-17T02:25:32.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f4269400640 1 --2- 172.21.15.45:0/1096819246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db53fd0a0 0x557db543f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:32.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.716+0000 7f426a800640 1 --2- 172.21.15.45:0/1096819246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db53f6900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4264009fb0 tx=0x7f4264037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6a54fd143c65c2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.717+0000 7f4256000640 1 -- 172.21.15.45:0/1096819246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264033d80 con 0x557db543fb10 2024-08-17T02:25:32.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.717+0000 7f4256000640 1 -- 172.21.15.45:0/1096819246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42640336e0 con 0x557db543fb10 2024-08-17T02:25:32.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.717+0000 7f4256000640 1 -- 172.21.15.45:0/1096819246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426403f450 con 0x557db543fb10 2024-08-17T02:25:32.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.717+0000 7f42735ea740 1 -- 172.21.15.45:0/1096819246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 msgr2=0x557db53f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.717+0000 7f42735ea740 1 --2- 172.21.15.45:0/1096819246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db53f6900 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4264009fb0 tx=0x7f4264037000 comp rx=0 tx=0).stop 2024-08-17T02:25:32.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.717+0000 7f42735ea740 1 -- 172.21.15.45:0/1096819246 shutdown_connections 2024-08-17T02:25:32.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.717+0000 7f42735ea740 1 --2- 172.21.15.45:0/1096819246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db53f6900 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.717+0000 7f42735ea740 1 --2- 172.21.15.45:0/1096819246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db53fd0a0 0x557db543f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.717+0000 7f42735ea740 1 --2- 172.21.15.45:0/1096819246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db5421a30 0x557db5421e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.717+0000 7f42735ea740 1 -- 172.21.15.45:0/1096819246 >> 172.21.15.45:0/1096819246 conn(0x557db5395030 msgr2=0x557db5443c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.717+0000 7f42735ea740 1 -- 172.21.15.45:0/1096819246 shutdown_connections 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.718+0000 7f42735ea740 1 -- 172.21.15.45:0/1096819246 wait complete. 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.718+0000 7f42735ea740 1 -- start start 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.718+0000 7f42735ea740 1 Processor -- start 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.719+0000 7f42735ea740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db53fd0a0 0x557db5428850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.719+0000 7f42735ea740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db53faf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.719+0000 7f42735ea740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db543fb10 0x557db53fb470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.719+0000 7f42735ea740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557db5359f60 con 0x557db5421a30 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.719+0000 7f42735ea740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x557db5302690 con 0x557db53fd0a0 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.719+0000 7f42735ea740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x557db5302330 con 0x557db543fb10 2024-08-17T02:25:32.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.719+0000 7f42735ea740 10 client.0 _ll_register_callbacks cb 0x557db52fc2b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.719+0000 7f4269400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db53faf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f4269400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db53faf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47922/0 (socket says 172.21.15.45:47922) 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f4269400640 1 -- 172.21.15.45:0/445581793 learned_addr learned my addr 172.21.15.45:0/445581793 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f4269e00640 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db53fd0a0 0x557db5428850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f426a800640 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db543fb10 0x557db53fb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f4269400640 1 -- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db543fb10 msgr2=0x557db53fb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f4269400640 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db543fb10 0x557db53fb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f4269400640 1 -- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db53fd0a0 msgr2=0x557db5428850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f4269400640 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db53fd0a0 0x557db5428850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f4269400640 1 -- 172.21.15.45:0/445581793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426c0ceb20 con 0x557db5421a30 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f4269400640 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db53faf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4258053810 tx=0x7f4258080210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85655a2b6ca989 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f424aa00640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-08-17T02:25:32.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.720+0000 7f424aa00640 1 -- 172.21.15.45:0/445581793 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258004ea0 con 0x557db5421a30 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f42735ea740 1 -- 172.21.15.45:0/445581793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557db538dd20 con 0x557db5421a30 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f424aa00640 1 -- 172.21.15.45:0/445581793 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f425805aab0 con 0x557db5421a30 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f424aa00640 1 -- 172.21.15.45:0/445581793 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4258053650 con 0x557db5421a30 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f42735ea740 10 client.4650 fetch_fsmap learned FSMap version 8 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f42735ea740 1 -- 172.21.15.45:0/445581793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x557db5323ab0 con 0x557db5421a30 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f424aa00640 1 -- 172.21.15.45:0/445581793 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557db538dd20 con 0x557db5421a30 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f424aa00640 1 -- 172.21.15.45:0/445581793 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4258053000 con 0x557db5421a30 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f42735ea740 10 client.4650 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f42735ea740 10 client.4650 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f42735ea740 20 client.4650 populate_metadata read hostname 'smithi045' 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f42735ea740 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:6832/911178485,v1:172.21.15.169:6834/911178485] conn(0x557db541e6b0 0x557db5426a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f42735ea740 4 client.4650 mds_command: new command op to 4291 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:25:32.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f42735ea740 1 -- 172.21.15.45:0/445581793 --> [v2:172.21.15.169:6832/911178485,v1:172.21.15.169:6834/911178485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557db50613c0 con 0x557db541e6b0 2024-08-17T02:25:32.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.721+0000 7f4269e00640 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:6832/911178485,v1:172.21.15.169:6834/911178485] conn(0x557db541e6b0 0x557db5426a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.722+0000 7f4269e00640 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:6832/911178485,v1:172.21.15.169:6834/911178485] conn(0x557db541e6b0 0x557db5426a10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5996d78515e4bdf0 server_cookie=57c7d5b1a21f3c18 in_seq=0 out_seq=0 2024-08-17T02:25:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.722+0000 7f424aa00640 10 client.4650 ms_handle_connect on v2:172.21.15.169:6832/911178485 2024-08-17T02:25:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f424aa00640 1 -- 172.21.15.45:0/445581793 <== mds.0 v2:172.21.15.169:6832/911178485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x557db50613c0 con 0x557db541e6b0 2024-08-17T02:25:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f424aa00640 10 client.4650 handle_command_reply: tid=0 2024-08-17T02:25:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f42735ea740 1 client.4650 shutdown 2024-08-17T02:25:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f42735ea740 1 -- 172.21.15.45:0/445581793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 msgr2=0x557db53faf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f42735ea740 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db53faf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4258053810 tx=0x7f4258080210 comp rx=0 tx=0).stop 2024-08-17T02:25:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f42735ea740 1 -- 172.21.15.45:0/445581793 shutdown_connections 2024-08-17T02:25:32.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f42735ea740 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:6832/911178485,v1:172.21.15.169:6834/911178485] conn(0x557db541e6b0 0x557db5426a10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f42735ea740 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db543fb10 0x557db53fb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f42735ea740 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db53faf30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f42735ea740 1 --2- 172.21.15.45:0/445581793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db53fd0a0 0x557db5428850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f42735ea740 1 -- 172.21.15.45:0/445581793 >> 172.21.15.45:0/445581793 conn(0x557db5395030 msgr2=0x557db53fa570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f424aa00640 0 client.4650 ms_handle_reset on v2:172.21.15.169:6832/911178485 2024-08-17T02:25:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.723+0000 7f42735ea740 1 -- 172.21.15.45:0/445581793 shutdown_connections 2024-08-17T02:25:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.724+0000 7f42735ea740 1 -- 172.21.15.45:0/445581793 wait complete. 2024-08-17T02:25:32.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.724+0000 7f42735ea740 20 client.4650 trim_cache size 0 max 16384 2024-08-17T02:25:32.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.739+0000 7f42735ea740 1 Processor -- start 2024-08-17T02:25:32.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.739+0000 7f42735ea740 1 -- start start 2024-08-17T02:25:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.740+0000 7f42735ea740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db53fd0a0 0x557db5443900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.740+0000 7f42735ea740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db5443e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.740+0000 7f42735ea740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db543fb10 0x557db54a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.740+0000 7f42735ea740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557db50d4f20 con 0x557db5421a30 2024-08-17T02:25:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.740+0000 7f42735ea740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x557db53fcb90 con 0x557db543fb10 2024-08-17T02:25:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.740+0000 7f42735ea740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x557db53f8880 con 0x557db53fd0a0 2024-08-17T02:25:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.740+0000 7f4269400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db5443e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.740+0000 7f4269400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db5443e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47932/0 (socket says 172.21.15.45:47932) 2024-08-17T02:25:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.740+0000 7f4269400640 1 -- 172.21.15.45:0/995482585 learned_addr learned my addr 172.21.15.45:0/995482585 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.740+0000 7f4269e00640 1 --2- 172.21.15.45:0/995482585 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db53fd0a0 0x557db5443900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.740+0000 7f426a800640 1 --2- 172.21.15.45:0/995482585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db543fb10 0x557db54a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f4269400640 1 -- 172.21.15.45:0/995482585 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db53fd0a0 msgr2=0x557db5443900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f4269400640 1 --2- 172.21.15.45:0/995482585 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db53fd0a0 0x557db5443900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f4269400640 1 -- 172.21.15.45:0/995482585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db543fb10 msgr2=0x557db54a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f4269400640 1 --2- 172.21.15.45:0/995482585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db543fb10 0x557db54a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f4269400640 1 -- 172.21.15.45:0/995482585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557db5327490 con 0x557db5421a30 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f426a800640 1 --2- 172.21.15.45:0/995482585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db543fb10 0x557db54a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f4269400640 1 --2- 172.21.15.45:0/995482585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db5443e40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4258053cd0 tx=0x7f425806d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19b27353bed7fee server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f4256a00640 1 -- 172.21.15.45:0/995482585 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258004ea0 con 0x557db5421a30 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f4256a00640 1 -- 172.21.15.45:0/995482585 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425800e040 con 0x557db5421a30 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f4256a00640 1 -- 172.21.15.45:0/995482585 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258053650 con 0x557db5421a30 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f42735ea740 1 -- 172.21.15.45:0/995482585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 msgr2=0x557db5443e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.741+0000 7f42735ea740 1 --2- 172.21.15.45:0/995482585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db5443e40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4258053cd0 tx=0x7f425806d000 comp rx=0 tx=0).stop 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.742+0000 7f42735ea740 1 -- 172.21.15.45:0/995482585 shutdown_connections 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.742+0000 7f42735ea740 1 --2- 172.21.15.45:0/995482585 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db543fb10 0x557db54a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.742+0000 7f42735ea740 1 --2- 172.21.15.45:0/995482585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db5421a30 0x557db5443e40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.742+0000 7f42735ea740 1 --2- 172.21.15.45:0/995482585 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db53fd0a0 0x557db5443900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.742+0000 7f42735ea740 1 -- 172.21.15.45:0/995482585 >> 172.21.15.45:0/995482585 conn(0x557db5395030 msgr2=0x557db53f1580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.742+0000 7f42735ea740 1 -- 172.21.15.45:0/995482585 shutdown_connections 2024-08-17T02:25:32.745 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.742+0000 7f42735ea740 1 -- 172.21.15.45:0/995482585 wait complete. 2024-08-17T02:25:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.742+0000 7f42735ea740 1 -- start start 2024-08-17T02:25:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.742+0000 7f42735ea740 1 Processor -- start 2024-08-17T02:25:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.743+0000 7f42735ea740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db53fd0a0 0x557db54a0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.743+0000 7f42735ea740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db5421a30 0x557db5440440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.743+0000 7f42735ea740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db5440980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.743+0000 7f42735ea740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557db54401c0 con 0x557db543fb10 2024-08-17T02:25:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.743+0000 7f42735ea740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x557db54a7c20 con 0x557db5421a30 2024-08-17T02:25:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.743+0000 7f42735ea740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x557db54410f0 con 0x557db53fd0a0 2024-08-17T02:25:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.743+0000 7f42735ea740 10 client.0 _ll_register_callbacks cb 0x7f42580538e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:25:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f426a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db5440980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f426a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db5440980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47944/0 (socket says 172.21.15.45:47944) 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f426a800640 1 -- 172.21.15.45:0/140532045 learned_addr learned my addr 172.21.15.45:0/140532045 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f4269400640 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db5421a30 0x557db5440440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f426a800640 1 -- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db53fd0a0 msgr2=0x557db54a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f4269e00640 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db53fd0a0 0x557db54a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f426a800640 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db53fd0a0 0x557db54a0310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f426a800640 1 -- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db5421a30 msgr2=0x557db5440440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f426a800640 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db5421a30 0x557db5440440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f426a800640 1 -- 172.21.15.45:0/140532045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557db5323ab0 con 0x557db543fb10 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f4269400640 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db5421a30 0x557db5440440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f426a800640 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db5440980 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x557db53fd510 tx=0x7f426403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a6da2d4de26dab server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.744+0000 7f424aa00640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-08-17T02:25:32.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f424aa00640 1 -- 172.21.15.45:0/140532045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264033410 con 0x557db543fb10 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f424aa00640 1 -- 172.21.15.45:0/140532045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4264055b00 con 0x557db543fb10 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f42735ea740 1 -- 172.21.15.45:0/140532045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557db50726c0 con 0x557db543fb10 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f424aa00640 1 -- 172.21.15.45:0/140532045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f426403f450 con 0x557db543fb10 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f42735ea740 10 client.4656 fetch_fsmap learned FSMap version 8 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f42735ea740 1 -- 172.21.15.45:0/140532045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x557db53271e0 con 0x557db543fb10 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f424aa00640 1 -- 172.21.15.45:0/140532045 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557db50726c0 con 0x557db543fb10 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f424aa00640 1 -- 172.21.15.45:0/140532045 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f426403f9d0 con 0x557db543fb10 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f42735ea740 10 client.4656 fetch_fsmap finished waiting for FSMap version 8 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f42735ea740 10 client.4656 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f42735ea740 20 client.4656 populate_metadata read hostname 'smithi045' 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f42735ea740 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:6832/911178485,v1:172.21.15.169:6834/911178485] conn(0x557db541fd60 0x557db5420130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f42735ea740 4 client.4656 mds_command: new command op to 4291 tid=0[{"prefix": "status"}] 2024-08-17T02:25:32.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.745+0000 7f42735ea740 1 -- 172.21.15.45:0/140532045 --> [v2:172.21.15.169:6832/911178485,v1:172.21.15.169:6834/911178485] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557db50c5d10 con 0x557db541fd60 2024-08-17T02:25:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.746+0000 7f4269e00640 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:6832/911178485,v1:172.21.15.169:6834/911178485] conn(0x557db541fd60 0x557db5420130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.747+0000 7f4269e00640 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:6832/911178485,v1:172.21.15.169:6834/911178485] conn(0x557db541fd60 0x557db5420130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fede15afd14f2c71 server_cookie=71f8ec14d2c4ba39 in_seq=0 out_seq=0 2024-08-17T02:25:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.747+0000 7f424aa00640 10 client.4656 ms_handle_connect on v2:172.21.15.169:6832/911178485 2024-08-17T02:25:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.747+0000 7f424aa00640 1 -- 172.21.15.45:0/140532045 <== mds.0 v2:172.21.15.169:6832/911178485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x557db50c5d10 con 0x557db541fd60 2024-08-17T02:25:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.747+0000 7f424aa00640 10 client.4656 handle_command_reply: tid=0 2024-08-17T02:25:32.751 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.747+0000 7f42735ea740 1 client.4656 shutdown 2024-08-17T02:25:32.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.747+0000 7f42735ea740 1 -- 172.21.15.45:0/140532045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 msgr2=0x557db5440980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.747+0000 7f42735ea740 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db5440980 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x557db53fd510 tx=0x7f426403f000 comp rx=0 tx=0).stop 2024-08-17T02:25:32.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f42735ea740 1 -- 172.21.15.45:0/140532045 shutdown_connections 2024-08-17T02:25:32.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f42735ea740 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:6832/911178485,v1:172.21.15.169:6834/911178485] conn(0x557db541fd60 0x557db5420130 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f42735ea740 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557db543fb10 0x557db5440980 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f42735ea740 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x557db5421a30 0x557db5440440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.752 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f424aa00640 0 client.4656 ms_handle_reset on v2:172.21.15.169:6832/911178485 2024-08-17T02:25:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f42735ea740 1 --2- 172.21.15.45:0/140532045 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x557db53fd0a0 0x557db54a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f42735ea740 1 -- 172.21.15.45:0/140532045 >> 172.21.15.45:0/140532045 conn(0x557db5395030 msgr2=0x557db54281b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f42735ea740 1 -- 172.21.15.45:0/140532045 shutdown_connections 2024-08-17T02:25:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f42735ea740 1 -- 172.21.15.45:0/140532045 wait complete. 2024-08-17T02:25:32.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f42735ea740 20 client.4656 trim_cache size 0 max 16384 2024-08-17T02:25:32.753 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-08-17T02:25:32.753 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "2ec357bb-2069-43d1-ab40-d29098820580", 2024-08-17T02:25:32.753 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2024-08-17T02:25:32.753 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4291, 2024-08-17T02:25:32.754 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-08-17T02:25:32.754 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-08-17T02:25:32.754 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-08-17T02:25:32.754 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 18.077969660000001, 2024-08-17T02:25:32.754 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 8, 2024-08-17T02:25:32.754 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 20, 2024-08-17T02:25:32.754 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 20, 2024-08-17T02:25:32.754 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 23.100288984999999 2024-08-17T02:25:32.754 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-08-17T02:25:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f4271000640 1 -- 172.21.15.45:0/3898931155 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f424c065150 msgr2=0x7f424c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f4271000640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f424c065150 0x7f424c067600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f425c009cf0 tx=0x7f425c008040 comp rx=0 tx=0).stop 2024-08-17T02:25:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f4271000640 1 -- 172.21.15.45:0/3898931155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f426c0d08d0 msgr2=0x7f426c14e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.748+0000 7f4271000640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f426c0d08d0 0x7f426c14e220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f425800c4e0 tx=0x7f4258007ee0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.749+0000 7f4271000640 1 -- 172.21.15.45:0/3898931155 shutdown_connections 2024-08-17T02:25:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.749+0000 7f4271000640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f426c158ce0 0x7f426c0c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.749+0000 7f4271000640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f426c0d08d0 0x7f426c14e220 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.749+0000 7f4271000640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f424c065150 0x7f424c067600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.749+0000 7f4271000640 1 --2- 172.21.15.45:0/3898931155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f426c0cb340 0x7f426c150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:32.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.749+0000 7f4271000640 1 -- 172.21.15.45:0/3898931155 >> 172.21.15.45:0/3898931155 conn(0x7f426c0cfdc0 msgr2=0x7f426c0c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:32.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.749+0000 7f4271000640 1 -- 172.21.15.45:0/3898931155 shutdown_connections 2024-08-17T02:25:32.756 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:32.749+0000 7f4271000640 1 -- 172.21.15.45:0/3898931155 wait complete. 2024-08-17T02:25:32.764 INFO:teuthology.run_tasks:Running task kclient... 2024-08-17T02:25:32.789 INFO:tasks.kclient:Mounting kernel clients... 2024-08-17T02:25:32.789 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-08-17T02:25:32.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:32.789 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-08-17T02:25:32.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:32.825 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2024-08-17T02:25:32.925 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2024-08-17T02:25:32.928 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:32.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:32.928 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-08-17T02:25:32.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:32.964 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2024-08-17T02:25:33.062 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2024-08-17T02:25:33.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:33.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:33.066 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-08-17T02:25:33.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:33.106 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link delete ceph-brx 2024-08-17T02:25:33.210 INFO:teuthology.orchestra.run.smithi169.stderr:Cannot find device "ceph-brx" 2024-08-17T02:25:33.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:33.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:33.213 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-08-17T02:25:33.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:33.251 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link delete ceph-brx 2024-08-17T02:25:33.348 INFO:teuthology.orchestra.run.smithi169.stderr:Cannot find device "ceph-brx" 2024-08-17T02:25:33.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:25:33.351 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-08-17T02:25:33.351 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:33.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.505+0000 7fc69c400640 1 Processor -- start 2024-08-17T02:25:33.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.505+0000 7fc69c400640 1 -- start start 2024-08-17T02:25:33.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.505+0000 7fc69c400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc6940aa8f0 0x7fc69406be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.505+0000 7fc69c400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc69415c600 0x7fc694066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.505+0000 7fc69c400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc69406b9d0 con 0x7fc69415c230 2024-08-17T02:25:33.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.505+0000 7fc69c400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc69406ebf0 con 0x7fc6940aa8f0 2024-08-17T02:25:33.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.505+0000 7fc69c400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6940aad80 con 0x7fc69415c600 2024-08-17T02:25:33.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.505+0000 7fc69a400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc69415c600 0x7fc694066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.505+0000 7fc699000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc6940aa8f0 0x7fc69406be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.505+0000 7fc699a00640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fc69415c230 0x7fc69406e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:43836/0 (socket says 172.21.15.45:43836) 2024-08-17T02:25:33.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.505+0000 7fc699a00640 1 -- 172.21.15.45:0/1956560200 learned_addr learned my addr 172.21.15.45:0/1956560200 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:33.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.506+0000 7fc699000640 1 -- 172.21.15.45:0/1956560200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc69415c600 msgr2=0x7fc694066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:33.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.506+0000 7fc699000640 1 --2- 172.21.15.45:0/1956560200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc69415c600 0x7fc694066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.506+0000 7fc699000640 1 -- 172.21.15.45:0/1956560200 >> v1:172.21.15.169:6789/0 conn(0x7fc69415c230 legacy=0x7fc69406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.506+0000 7fc699000640 1 -- 172.21.15.45:0/1956560200 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6940ab060 con 0x7fc6940aa8f0 2024-08-17T02:25:33.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.506+0000 7fc693e00640 1 -- 172.21.15.45:0/1956560200 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743033673 0 0) 0x7fc69406b9d0 con 0x7fc69415c230 2024-08-17T02:25:33.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.507+0000 7fc699000640 1 --2- 172.21.15.45:0/1956560200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6940aa8f0 0x7fc69406be60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc680009850 tx=0x7fc6800090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3115e9f7e7103f56 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.507+0000 7fc693e00640 1 -- 172.21.15.45:0/1956560200 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68002ad90 con 0x7fc6940aa8f0 2024-08-17T02:25:33.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.507+0000 7fc693e00640 1 -- 172.21.15.45:0/1956560200 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc680032440 con 0x7fc6940aa8f0 2024-08-17T02:25:33.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.507+0000 7fc693e00640 1 -- 172.21.15.45:0/1956560200 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6800327e0 con 0x7fc6940aa8f0 2024-08-17T02:25:33.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.508+0000 7fc69c400640 1 -- 172.21.15.45:0/1956560200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6940aa8f0 msgr2=0x7fc69406be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.508+0000 7fc69c400640 1 --2- 172.21.15.45:0/1956560200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6940aa8f0 0x7fc69406be60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc680009850 tx=0x7fc6800090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.508+0000 7fc69c400640 1 -- 172.21.15.45:0/1956560200 shutdown_connections 2024-08-17T02:25:33.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.508+0000 7fc69c400640 1 --2- 172.21.15.45:0/1956560200 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc69415c600 0x7fc694066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.508+0000 7fc69c400640 1 --2- 172.21.15.45:0/1956560200 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6940aa8f0 0x7fc69406be60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.508+0000 7fc69c400640 1 -- 172.21.15.45:0/1956560200 >> 172.21.15.45:0/1956560200 conn(0x7fc69406d8f0 msgr2=0x7fc69406dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.508+0000 7fc69c400640 1 -- 172.21.15.45:0/1956560200 shutdown_connections 2024-08-17T02:25:33.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.508+0000 7fc69c400640 1 -- 172.21.15.45:0/1956560200 wait complete. 2024-08-17T02:25:33.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.509+0000 7fc69c400640 1 Processor -- start 2024-08-17T02:25:33.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.510+0000 7fc69c400640 1 -- start start 2024-08-17T02:25:33.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.510+0000 7fc69c400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6940aa8f0 0x7fc694169230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.510+0000 7fc69c400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc69415c230 0x7fc6940c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc69c400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc69415c600 0x7fc694157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc69c400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6940c7d90 con 0x7fc69415c230 2024-08-17T02:25:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc69c400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc69416ca00 con 0x7fc69415c600 2024-08-17T02:25:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc69c400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc69416c0d0 con 0x7fc6940aa8f0 2024-08-17T02:25:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc699000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc69415c230 0x7fc6940c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc699000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc69415c230 0x7fc6940c72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47958/0 (socket says 172.21.15.45:47958) 2024-08-17T02:25:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc699000640 1 -- 172.21.15.45:0/2980702727 learned_addr learned my addr 172.21.15.45:0/2980702727 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc69a400640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc69415c600 0x7fc694157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc699a00640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6940aa8f0 0x7fc694169230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc699000640 1 -- 172.21.15.45:0/2980702727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6940aa8f0 msgr2=0x7fc694169230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc699000640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6940aa8f0 0x7fc694169230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc699000640 1 -- 172.21.15.45:0/2980702727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc69415c600 msgr2=0x7fc694157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc699000640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc69415c600 0x7fc694157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc699000640 1 -- 172.21.15.45:0/2980702727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc680009390 con 0x7fc69415c230 2024-08-17T02:25:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.511+0000 7fc699000640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc69415c230 0x7fc6940c72f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc680009850 tx=0x7fc680032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.512+0000 7fc690c00640 1 -- 172.21.15.45:0/2980702727 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc680000d10 con 0x7fc69415c230 2024-08-17T02:25:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.512+0000 7fc690c00640 1 -- 172.21.15.45:0/2980702727 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc680031e00 con 0x7fc69415c230 2024-08-17T02:25:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.512+0000 7fc690c00640 1 -- 172.21.15.45:0/2980702727 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68003d670 con 0x7fc69415c230 2024-08-17T02:25:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.512+0000 7fc69c400640 1 -- 172.21.15.45:0/2980702727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc69416c3b0 con 0x7fc69415c230 2024-08-17T02:25:33.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.512+0000 7fc69c400640 1 -- 172.21.15.45:0/2980702727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc694169770 con 0x7fc69415c230 2024-08-17T02:25:33.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.513+0000 7fc69c400640 1 -- 172.21.15.45:0/2980702727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6941699c0 con 0x7fc69415c230 2024-08-17T02:25:33.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.514+0000 7fc690c00640 1 -- 172.21.15.45:0/2980702727 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc680039040 con 0x7fc69415c230 2024-08-17T02:25:33.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.514+0000 7fc690c00640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc674065150 0x7fc674067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:33.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.515+0000 7fc690c00640 1 -- 172.21.15.45:0/2980702727 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6800a2430 con 0x7fc69415c230 2024-08-17T02:25:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.515+0000 7fc699a00640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc674065150 0x7fc674067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:33.517 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.515+0000 7fc699a00640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc674065150 0x7fc674067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6880011e0 tx=0x7fc688007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:33.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.519+0000 7fc690c00640 1 -- 172.21.15.45:0/2980702727 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc6941699c0 con 0x7fc69415c230 2024-08-17T02:25:33.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.739+0000 7fc69c400640 1 -- 172.21.15.45:0/2980702727 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc69416c210 con 0x7fc69415c230 2024-08-17T02:25:33.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.740+0000 7fc690c00640 1 -- 172.21.15.45:0/2980702727 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc69416c210 con 0x7fc69415c230 2024-08-17T02:25:33.741 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:33.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 -- 172.21.15.45:0/2980702727 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc674065150 msgr2=0x7fc674067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc674065150 0x7fc674067600 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc6880011e0 tx=0x7fc688007ca0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 -- 172.21.15.45:0/2980702727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc69415c230 msgr2=0x7fc6940c72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:33.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc69415c230 0x7fc6940c72f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc680009850 tx=0x7fc680032000 comp rx=0 tx=0).stop 2024-08-17T02:25:33.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 -- 172.21.15.45:0/2980702727 shutdown_connections 2024-08-17T02:25:33.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc69415c600 0x7fc694157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc69415c230 0x7fc6940c72f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc674065150 0x7fc674067600 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 --2- 172.21.15.45:0/2980702727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6940aa8f0 0x7fc694169230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:33.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 -- 172.21.15.45:0/2980702727 >> 172.21.15.45:0/2980702727 conn(0x7fc69406d8f0 msgr2=0x7fc6940b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:33.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 -- 172.21.15.45:0/2980702727 shutdown_connections 2024-08-17T02:25:33.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:33.743+0000 7fc69c400640 1 -- 172.21.15.45:0/2980702727 wait complete. 2024-08-17T02:25:33.758 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:25:33.758 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:33.758 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2024-08-17T02:25:33.758 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:25:33.759 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:33.759 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:25:33.759 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:25:33.759 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:33.759 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:25:33.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:33.759 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2024-08-17T02:25:33.795 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:33.795 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:33.796 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2024-08-17T02:25:33.797 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:25:33.797 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42656sec preferred_lft 42656sec 2024-08-17T02:25:33.797 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2024-08-17T02:25:33.797 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:33.797 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:33.797 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:33.797 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2024-08-17T02:25:33.797 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:25:33.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:33.798 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-08-17T02:25:33.798 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-08-17T02:25:33.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:25:33.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2024-08-17T02:25:33.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2024-08-17T02:25:33.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:25:33.798 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-08-17T02:25:34.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:34.172 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:34.230 INFO:teuthology.orchestra.run.smithi045.stdout:1 2024-08-17T02:25:34.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:34.233 DEBUG:teuthology.orchestra.run.smithi045:> route 2024-08-17T02:25:34.285 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2024-08-17T02:25:34.285 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:34.285 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:25:34.286 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:25:34.286 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:34.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:34.286 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-08-17T02:25:34.286 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-08-17T02:25:34.286 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:25:34.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:25:34.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:25:34.287 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-08-17T02:25:34.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:34.827 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-08-17T02:25:34.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:34.863 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2024-08-17T02:25:34.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:34.939 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-08-17T02:25:34.939 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-08-17T02:25:34.939 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:25:34.939 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-17T02:25:34.939 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-08-17T02:25:35.067 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-17T02:25:35.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:35.068 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-08-17T02:25:35.068 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-08-17T02:25:35.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-17T02:25:35.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:25:35.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-17T02:25:35.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-17T02:25:35.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-17T02:25:35.068 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-08-17T02:25:35.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:35.254 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-08-17T02:25:35.255 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-08-17T02:25:35.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2024-08-17T02:25:35.255 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:25:35.255 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-08-17T02:25:35.369 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:35.370 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:35.405 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:25:35.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:35.406 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:35.480 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:25:35.481 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:35.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:35.614 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:35.614 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:36.224 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:36.224 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:36.224 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.169:3300,172.21.15.169:3301" 2024-08-17T02:25:36.224 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@2ec357bb-2069-43d1-ab40-d29098820580.cephfs=/ 2024-08-17T02:25:36.224 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.169:3300/172.21.15.169:3301" will pass to kernel 2024-08-17T02:25:36.225 INFO:teuthology.orchestra.run.smithi045.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:25:36.225 INFO:teuthology.orchestra.run.smithi045.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:25:36.225 INFO:teuthology.orchestra.run.smithi045.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:25:36.225 INFO:teuthology.orchestra.run.smithi045.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:25:36.225 INFO:teuthology.orchestra.run.smithi045.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:25:36.228 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:25:36.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:36.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:25:36.286 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-08-17T02:25:36.286 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.437+0000 7f5ae6e00640 1 Processor -- start 2024-08-17T02:25:36.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.437+0000 7f5ae6e00640 1 -- start start 2024-08-17T02:25:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.438+0000 7f5ae6e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5ae0155a20 0x7f5ae00adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.438+0000 7f5ae6e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ae006df00 0x7f5ae00ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.438+0000 7f5ae6e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae0156670 con 0x7f5ae0155df0 2024-08-17T02:25:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.438+0000 7f5ae6e00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae00b0350 con 0x7f5ae0155a20 2024-08-17T02:25:36.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.438+0000 7f5ae6e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae006e5e0 con 0x7f5ae006df00 2024-08-17T02:25:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.439+0000 7f5adf400640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f5ae0155df0 0x7f5ae006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:43838/0 (socket says 172.21.15.45:43838) 2024-08-17T02:25:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.439+0000 7f5ae4e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ae006df00 0x7f5ae00ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.439+0000 7f5adf400640 1 -- 172.21.15.45:0/1617887312 learned_addr learned my addr 172.21.15.45:0/1617887312 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:36.439 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.439+0000 7f5adfe00640 1 --2- 172.21.15.45:0/1617887312 >> v2:172.21.15.169:3300/0 conn(0x7f5ae0155a20 0x7f5ae00adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.439+0000 7f5adea00640 1 -- 172.21.15.45:0/1617887312 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 863004496 0 0) 0x7f5ae0156670 con 0x7f5ae0155df0 2024-08-17T02:25:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.439+0000 7f5adea00640 1 -- 172.21.15.45:0/1617887312 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac40034e0 con 0x7f5ae0155df0 2024-08-17T02:25:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.439+0000 7f5adfe00640 1 -- 172.21.15.45:0/1617887312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ae006df00 msgr2=0x7f5ae00ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.440+0000 7f5adfe00640 1 --2- 172.21.15.45:0/1617887312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ae006df00 0x7f5ae00ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.440+0000 7f5adfe00640 1 -- 172.21.15.45:0/1617887312 >> v1:172.21.15.169:6789/0 conn(0x7f5ae0155df0 legacy=0x7f5ae006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.440+0000 7f5adfe00640 1 -- 172.21.15.45:0/1617887312 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae006e8c0 con 0x7f5ae0155a20 2024-08-17T02:25:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.440+0000 7f5ae4e00640 1 --2- 172.21.15.45:0/1617887312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ae006df00 0x7f5ae00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:36.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.441+0000 7f5adfe00640 1 --2- 172.21.15.45:0/1617887312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae0155a20 0x7f5ae00adf10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0009850 tx=0x7f5ad00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e30bb5369f2a3ba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.441+0000 7f5adea00640 1 -- 172.21.15.45:0/1617887312 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0031510 con 0x7f5ae0155a20 2024-08-17T02:25:36.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.441+0000 7f5adea00640 1 -- 172.21.15.45:0/1617887312 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad002f050 con 0x7f5ae0155a20 2024-08-17T02:25:36.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.441+0000 7f5adea00640 1 -- 172.21.15.45:0/1617887312 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00318e0 con 0x7f5ae0155a20 2024-08-17T02:25:36.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.441+0000 7f5ae6e00640 1 -- 172.21.15.45:0/1617887312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae0155a20 msgr2=0x7f5ae00adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.441+0000 7f5ae6e00640 1 --2- 172.21.15.45:0/1617887312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae0155a20 0x7f5ae00adf10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0009850 tx=0x7f5ad00090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.441+0000 7f5ae6e00640 1 -- 172.21.15.45:0/1617887312 shutdown_connections 2024-08-17T02:25:36.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.441+0000 7f5ae6e00640 1 --2- 172.21.15.45:0/1617887312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ae006df00 0x7f5ae00ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.441+0000 7f5ae6e00640 1 --2- 172.21.15.45:0/1617887312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae0155a20 0x7f5ae00adf10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.441+0000 7f5ae6e00640 1 -- 172.21.15.45:0/1617887312 >> 172.21.15.45:0/1617887312 conn(0x7f5ae00cb9b0 msgr2=0x7f5ae00cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:36.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.442+0000 7f5ae6e00640 1 -- 172.21.15.45:0/1617887312 shutdown_connections 2024-08-17T02:25:36.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.442+0000 7f5ae6e00640 1 -- 172.21.15.45:0/1617887312 wait complete. 2024-08-17T02:25:36.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.443+0000 7f5ae6e00640 1 Processor -- start 2024-08-17T02:25:36.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.443+0000 7f5ae6e00640 1 -- start start 2024-08-17T02:25:36.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.444+0000 7f5ae6e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ae006df00 0x7f5ae00a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.444+0000 7f5ae6e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae0155a20 0x7f5ae014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.444+0000 7f5ae6e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ae0155df0 0x7f5ae00ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.444+0000 7f5ae6e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01508b0 con 0x7f5ae006df00 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.444+0000 7f5ae6e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00a9fe0 con 0x7f5ae0155a20 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.444+0000 7f5ae6e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae0153f60 con 0x7f5ae0155df0 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.444+0000 7f5adfe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ae006df00 0x7f5ae00a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.445+0000 7f5adfe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ae006df00 0x7f5ae00a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47962/0 (socket says 172.21.15.45:47962) 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.445+0000 7f5adfe00640 1 -- 172.21.15.45:0/3991245138 learned_addr learned my addr 172.21.15.45:0/3991245138 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.445+0000 7f5adf400640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae0155a20 0x7f5ae014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.445+0000 7f5ae4e00640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ae0155df0 0x7f5ae00ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.445+0000 7f5adfe00640 1 -- 172.21.15.45:0/3991245138 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ae0155df0 msgr2=0x7f5ae00ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.445+0000 7f5adfe00640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ae0155df0 0x7f5ae00ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.445+0000 7f5adfe00640 1 -- 172.21.15.45:0/3991245138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae0155a20 msgr2=0x7f5ae014fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.445+0000 7f5adfe00640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae0155a20 0x7f5ae014fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.445+0000 7f5adfe00640 1 -- 172.21.15.45:0/3991245138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8009a20 con 0x7f5ae006df00 2024-08-17T02:25:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.445+0000 7f5adfe00640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ae006df00 0x7f5ae00a98e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00098b0 tx=0x7f5ad0037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.446+0000 7f5ad7400640 1 -- 172.21.15.45:0/3991245138 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0033860 con 0x7f5ae006df00 2024-08-17T02:25:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.446+0000 7f5ad7400640 1 -- 172.21.15.45:0/3991245138 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad00339c0 con 0x7f5ae006df00 2024-08-17T02:25:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.446+0000 7f5ad7400640 1 -- 172.21.15.45:0/3991245138 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0033d80 con 0x7f5ae006df00 2024-08-17T02:25:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.446+0000 7f5ae6e00640 1 -- 172.21.15.45:0/3991245138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad0009390 con 0x7f5ae006df00 2024-08-17T02:25:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.446+0000 7f5ae6e00640 1 -- 172.21.15.45:0/3991245138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae0159a30 con 0x7f5ae006df00 2024-08-17T02:25:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.447+0000 7f5ae6e00640 1 -- 172.21.15.45:0/3991245138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae0064db0 con 0x7f5ae006df00 2024-08-17T02:25:36.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.448+0000 7f5ad7400640 1 -- 172.21.15.45:0/3991245138 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5ad003d650 con 0x7f5ae006df00 2024-08-17T02:25:36.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.448+0000 7f5ad7400640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5ac0065180 0x7f5ac0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:36.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.449+0000 7f5ad7400640 1 -- 172.21.15.45:0/3991245138 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ad00a31c0 con 0x7f5ae006df00 2024-08-17T02:25:36.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.449+0000 7f5adf400640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5ac0065180 0x7f5ac0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:36.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.449+0000 7f5adf400640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5ac0065180 0x7f5ac0067630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0069e40 tx=0x7f5acc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:36.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.453+0000 7f5ad7400640 1 -- 172.21.15.45:0/3991245138 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5ad0071330 con 0x7f5ae006df00 2024-08-17T02:25:36.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.672+0000 7f5ae6e00640 1 -- 172.21.15.45:0/3991245138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5ae0069b90 con 0x7f5ae006df00 2024-08-17T02:25:36.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.673+0000 7f5ad7400640 1 -- 172.21.15.45:0/3991245138 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5ad0074950 con 0x7f5ae006df00 2024-08-17T02:25:36.673 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 -- 172.21.15.45:0/3991245138 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5ac0065180 msgr2=0x7f5ac0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5ac0065180 0x7f5ac0067630 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5ae0069e40 tx=0x7f5acc009040 comp rx=0 tx=0).stop 2024-08-17T02:25:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 -- 172.21.15.45:0/3991245138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ae006df00 msgr2=0x7f5ae00a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ae006df00 0x7f5ae00a98e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00098b0 tx=0x7f5ad0037000 comp rx=0 tx=0).stop 2024-08-17T02:25:36.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 -- 172.21.15.45:0/3991245138 shutdown_connections 2024-08-17T02:25:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5ac0065180 0x7f5ac0067630 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ae0155df0 0x7f5ae00ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ae0155a20 0x7f5ae014fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 --2- 172.21.15.45:0/3991245138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ae006df00 0x7f5ae00a98e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 -- 172.21.15.45:0/3991245138 >> 172.21.15.45:0/3991245138 conn(0x7f5ae00cb9b0 msgr2=0x7f5ae006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 -- 172.21.15.45:0/3991245138 shutdown_connections 2024-08-17T02:25:36.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:36.675+0000 7f5ae6e00640 1 -- 172.21.15.45:0/3991245138 wait complete. 2024-08-17T02:25:36.689 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:25:36.689 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:36.689 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2024-08-17T02:25:36.689 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-08-17T02:25:36.689 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-08-17T02:25:36.690 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:25:36.690 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:25:36.690 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:36.690 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:25:36.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:36.690 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2024-08-17T02:25:36.725 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:25:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42653sec preferred_lft 42653sec 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 86:ab:1b:d3:74:94 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::581f:69ff:fec3:c521/64 scope link 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 86:ab:1b:d3:74:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:25:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::84ab:1bff:fed3:7494/64 scope link tentative 2024-08-17T02:25:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:36.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:36.729 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:36.822 INFO:teuthology.orchestra.run.smithi045.stdout:1 2024-08-17T02:25:36.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:36.826 DEBUG:teuthology.orchestra.run.smithi045:> route 2024-08-17T02:25:36.862 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2024-08-17T02:25:36.862 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:36.862 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:25:36.862 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:25:36.862 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:36.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:36.863 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-08-17T02:25:36.863 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-08-17T02:25:36.863 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:25:36.863 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:25:36.863 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:25:36.863 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-08-17T02:25:37.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:37.008 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-08-17T02:25:37.043 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:25:37.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:37.044 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2024-08-17T02:25:37.119 INFO:teuthology.orchestra.run.smithi045.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-08-17T02:25:37.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:37.120 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-08-17T02:25:37.120 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-08-17T02:25:37.120 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:25:37.120 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-08-17T02:25:37.121 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-08-17T02:25:37.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:37.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:25:37.300 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:37.300 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:37.300 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:37.300 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:37.300 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:37.300 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:37.300 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:37.300 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ca:84:cd:15:46:36 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:25:37.300 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:25:37.301 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:37.301 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c884:cdff:fe15:4636/64 scope link 2024-08-17T02:25:37.301 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:37.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:37.303 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ca:84:cd:15:46:36 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::c884:cdff:fe15:4636/64 scope link 2024-08-17T02:25:37.359 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:37.361 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-08-17T02:25:37.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:37.362 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-08-17T02:25:37.362 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-08-17T02:25:37.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-08-17T02:25:37.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:25:37.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-08-17T02:25:37.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-08-17T02:25:37.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-08-17T02:25:37.362 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-08-17T02:25:37.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:37.529 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-08-17T02:25:37.529 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-08-17T02:25:37.529 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.1 up 2024-08-17T02:25:37.529 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:25:37.529 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-08-17T02:25:37.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:37.645 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-08-17T02:25:37.680 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:37.680 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:25:37.757 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-08-17T02:25:37.757 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:37.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:37.880 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:37.880 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:37.907 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:37.907 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:37.908 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.169:3300,172.21.15.169:3301" 2024-08-17T02:25:37.908 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 2@2ec357bb-2069-43d1-ab40-d29098820580.cephfs=/ 2024-08-17T02:25:37.908 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.45:3300/172.21.15.169:3300/172.21.15.169:3301" will pass to kernel 2024-08-17T02:25:37.909 INFO:teuthology.orchestra.run.smithi045.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-08-17T02:25:37.909 INFO:teuthology.orchestra.run.smithi045.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:25:37.909 INFO:teuthology.orchestra.run.smithi045.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:25:37.909 INFO:teuthology.orchestra.run.smithi045.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:25:37.909 INFO:teuthology.orchestra.run.smithi045.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:25:37.912 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:25:37.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:37.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-08-17T02:25:37.968 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-08-17T02:25:37.969 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:38.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.120+0000 7f195be00640 1 Processor -- start 2024-08-17T02:25:38.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.120+0000 7f195be00640 1 -- start start 2024-08-17T02:25:38.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.121+0000 7f195be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f195415c230 0x7f195406be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.121 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.121+0000 7f195be00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f195415c600 0x7f195406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.121+0000 7f195be00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f195406b9d0 con 0x7f1954066cd0 2024-08-17T02:25:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.121+0000 7f195be00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540aad80 con 0x7f195415c230 2024-08-17T02:25:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.121+0000 7f195be00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19540ab060 con 0x7f195415c600 2024-08-17T02:25:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.122+0000 7f1959400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f195415c230 0x7f195406be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.122+0000 7f1959400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f195415c230 0x7f195406be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47976/0 (socket says 172.21.15.45:47976) 2024-08-17T02:25:38.122 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.122+0000 7f1959400640 1 -- 172.21.15.45:0/1089898904 learned_addr learned my addr 172.21.15.45:0/1089898904 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:38.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.122+0000 7f1958a00640 1 --2- 172.21.15.45:0/1089898904 >> v2:172.21.15.169:3300/0 conn(0x7f195415c600 0x7f195406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.122+0000 7f1959400640 1 -- 172.21.15.45:0/1089898904 >> v2:172.21.15.169:3300/0 conn(0x7f195415c600 msgr2=0x7f195406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.122+0000 7f1959400640 1 --2- 172.21.15.45:0/1089898904 >> v2:172.21.15.169:3300/0 conn(0x7f195415c600 0x7f195406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.122+0000 7f1959400640 1 -- 172.21.15.45:0/1089898904 >> v1:172.21.15.169:6789/0 conn(0x7f1954066cd0 legacy=0x7f19540670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.122+0000 7f1959400640 1 -- 172.21.15.45:0/1089898904 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f195406b380 con 0x7f195415c230 2024-08-17T02:25:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.122+0000 7f1958a00640 1 --2- 172.21.15.45:0/1089898904 >> v2:172.21.15.169:3300/0 conn(0x7f195415c600 0x7f195406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.123+0000 7f1959400640 1 --2- 172.21.15.45:0/1089898904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195415c230 0x7f195406be60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19540693b0 tx=0x7f19480091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87eef48992376339 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.123+0000 7f1953e00640 1 -- 172.21.15.45:0/1089898904 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194802add0 con 0x7f195415c230 2024-08-17T02:25:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.123+0000 7f1953e00640 1 -- 172.21.15.45:0/1089898904 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1948032440 con 0x7f195415c230 2024-08-17T02:25:38.124 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.123+0000 7f1953e00640 1 -- 172.21.15.45:0/1089898904 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1948032820 con 0x7f195415c230 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.124+0000 7f195be00640 1 -- 172.21.15.45:0/1089898904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195415c230 msgr2=0x7f195406be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.124+0000 7f195be00640 1 --2- 172.21.15.45:0/1089898904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195415c230 0x7f195406be60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f19540693b0 tx=0x7f19480091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.124+0000 7f195be00640 1 -- 172.21.15.45:0/1089898904 shutdown_connections 2024-08-17T02:25:38.125 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.124+0000 7f195be00640 1 --2- 172.21.15.45:0/1089898904 >> v2:172.21.15.169:3300/0 conn(0x7f195415c600 0x7f195406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.124+0000 7f195be00640 1 --2- 172.21.15.45:0/1089898904 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195415c230 0x7f195406be60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.124+0000 7f195be00640 1 -- 172.21.15.45:0/1089898904 >> 172.21.15.45:0/1089898904 conn(0x7f195406d8f0 msgr2=0x7f195406dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.124+0000 7f195be00640 1 -- 172.21.15.45:0/1089898904 shutdown_connections 2024-08-17T02:25:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.124+0000 7f195be00640 1 -- 172.21.15.45:0/1089898904 wait complete. 2024-08-17T02:25:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.125+0000 7f195be00640 1 Processor -- start 2024-08-17T02:25:38.126 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.126+0000 7f195be00640 1 -- start start 2024-08-17T02:25:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.126+0000 7f195be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1954066cd0 0x7f1954168cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.126+0000 7f195be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195415c230 0x7f1954158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f195be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f195415c600 0x7f1954155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f195be00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f195415f9b0 con 0x7f195415c230 2024-08-17T02:25:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f195be00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19540ca6d0 con 0x7f1954066cd0 2024-08-17T02:25:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f195be00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19540ca9b0 con 0x7f195415c600 2024-08-17T02:25:38.128 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f1958a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195415c230 0x7f1954158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f1958a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195415c230 0x7f1954158780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47990/0 (socket says 172.21.15.45:47990) 2024-08-17T02:25:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f1958a00640 1 -- 172.21.15.45:0/2159773587 learned_addr learned my addr 172.21.15.45:0/2159773587 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f1959400640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1954066cd0 0x7f1954168cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f1959e00640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f195415c600 0x7f1954155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f1958a00640 1 -- 172.21.15.45:0/2159773587 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f195415c600 msgr2=0x7f1954155700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f1958a00640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f195415c600 0x7f1954155700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f1958a00640 1 -- 172.21.15.45:0/2159773587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1954066cd0 msgr2=0x7f1954168cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f1958a00640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1954066cd0 0x7f1954168cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.127+0000 7f1958a00640 1 -- 172.21.15.45:0/2159773587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1948009450 con 0x7f195415c230 2024-08-17T02:25:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.128+0000 7f1958a00640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195415c230 0x7f1954158780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f194000c880 tx=0x7f1940008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.128+0000 7f1950c00640 1 -- 172.21.15.45:0/2159773587 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194000ce10 con 0x7f195415c230 2024-08-17T02:25:38.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.128+0000 7f1950c00640 1 -- 172.21.15.45:0/2159773587 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1940007830 con 0x7f195415c230 2024-08-17T02:25:38.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.128+0000 7f1950c00640 1 -- 172.21.15.45:0/2159773587 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940007c10 con 0x7f195415c230 2024-08-17T02:25:38.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.128+0000 7f195be00640 1 -- 172.21.15.45:0/2159773587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19540cac90 con 0x7f195415c230 2024-08-17T02:25:38.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.128+0000 7f195be00640 1 -- 172.21.15.45:0/2159773587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19541691f0 con 0x7f195415c230 2024-08-17T02:25:38.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.129+0000 7f195be00640 1 -- 172.21.15.45:0/2159773587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1954064db0 con 0x7f195415c230 2024-08-17T02:25:38.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.130+0000 7f1950c00640 1 -- 172.21.15.45:0/2159773587 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1940011600 con 0x7f195415c230 2024-08-17T02:25:38.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.131+0000 7f1950c00640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1934065180 0x7f1934067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:38.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.131+0000 7f1950c00640 1 -- 172.21.15.45:0/2159773587 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19400823d0 con 0x7f195415c230 2024-08-17T02:25:38.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.131+0000 7f1959400640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1934065180 0x7f1934067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:38.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.131+0000 7f1959400640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1934065180 0x7f1934067630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1948034000 tx=0x7f1948032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:38.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.134+0000 7f1950c00640 1 -- 172.21.15.45:0/2159773587 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f19400504a0 con 0x7f195415c230 2024-08-17T02:25:38.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.355+0000 7f195be00640 1 -- 172.21.15.45:0/2159773587 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f195406ad30 con 0x7f195415c230 2024-08-17T02:25:38.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.356+0000 7f1950c00640 1 -- 172.21.15.45:0/2159773587 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1940053ac0 con 0x7f195415c230 2024-08-17T02:25:38.356 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:38.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 -- 172.21.15.45:0/2159773587 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1934065180 msgr2=0x7f1934067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1934065180 0x7f1934067630 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1948034000 tx=0x7f1948032000 comp rx=0 tx=0).stop 2024-08-17T02:25:38.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 -- 172.21.15.45:0/2159773587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195415c230 msgr2=0x7f1954158780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195415c230 0x7f1954158780 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f194000c880 tx=0x7f1940008040 comp rx=0 tx=0).stop 2024-08-17T02:25:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 -- 172.21.15.45:0/2159773587 shutdown_connections 2024-08-17T02:25:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1934065180 0x7f1934067630 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f195415c600 0x7f1954155700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f195415c230 0x7f1954158780 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 --2- 172.21.15.45:0/2159773587 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1954066cd0 0x7f1954168cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 -- 172.21.15.45:0/2159773587 >> 172.21.15.45:0/2159773587 conn(0x7f195406d8f0 msgr2=0x7f19540b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 -- 172.21.15.45:0/2159773587 shutdown_connections 2024-08-17T02:25:38.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:38.358+0000 7f195be00640 1 -- 172.21.15.45:0/2159773587 wait complete. 2024-08-17T02:25:38.372 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:25:38.373 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:38.373 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi169.front.sepia.ceph.com 2024-08-17T02:25:38.373 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:25:38.373 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:38.373 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:25:38.373 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:25:38.373 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:38.373 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:25:38.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:38.373 DEBUG:teuthology.orchestra.run.smithi169:> ip addr 2024-08-17T02:25:38.414 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:38.414 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:38.415 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:38.415 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:38.415 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:38.415 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:38.415 INFO:teuthology.orchestra.run.smithi169.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:38.415 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:38.415 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f0 2024-08-17T02:25:38.415 INFO:teuthology.orchestra.run.smithi169.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:38.415 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:38.415 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f1 2024-08-17T02:25:38.415 INFO:teuthology.orchestra.run.smithi169.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:38.416 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:38.416 INFO:teuthology.orchestra.run.smithi169.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:38.416 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:38.416 INFO:teuthology.orchestra.run.smithi169.stdout: inet 172.21.15.169/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:25:38.416 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft 42642sec preferred_lft 42642sec 2024-08-17T02:25:38.416 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::ec4:7aff:fe88:7f4d/64 scope link 2024-08-17T02:25:38.416 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:38.416 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-17T02:25:38.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:38.417 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-08-17T02:25:38.417 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-08-17T02:25:38.417 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add name ceph-brx type bridge 2024-08-17T02:25:38.417 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip addr flush dev ceph-brx 2024-08-17T02:25:38.417 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set ceph-brx up 2024-08-17T02:25:38.417 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-17T02:25:38.417 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-08-17T02:25:38.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:38.807 DEBUG:teuthology.orchestra.run.smithi169:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:38.865 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-08-17T02:25:38.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:38.870 DEBUG:teuthology.orchestra.run.smithi169:> route 2024-08-17T02:25:38.919 INFO:teuthology.orchestra.run.smithi169.stdout:Kernel IP routing table 2024-08-17T02:25:38.920 INFO:teuthology.orchestra.run.smithi169.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:38.920 INFO:teuthology.orchestra.run.smithi169.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:25:38.920 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:25:38.920 INFO:teuthology.orchestra.run.smithi169.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:38.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:38.920 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-08-17T02:25:38.920 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-08-17T02:25:38.920 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:25:38.921 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:25:38.921 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:25:38.921 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-08-17T02:25:39.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.459 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-08-17T02:25:39.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.497 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list-id 2024-08-17T02:25:39.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.577 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-08-17T02:25:39.577 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-08-17T02:25:39.577 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:25:39.577 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-08-17T02:25:39.577 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-08-17T02:25:39.707 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-08-17T02:25:39.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.707 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-08-17T02:25:39.707 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-08-17T02:25:39.707 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-08-17T02:25:39.707 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-17T02:25:39.707 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-08-17T02:25:39.707 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-08-17T02:25:39.708 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-08-17T02:25:39.708 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-08-17T02:25:39.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:39.902 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-08-17T02:25:39.902 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-08-17T02:25:39.902 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set brx.0 up 2024-08-17T02:25:39.902 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set dev brx.0 master ceph-brx 2024-08-17T02:25:39.902 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-08-17T02:25:40.017 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:40.017 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:40.053 INFO:teuthology.orchestra.run.smithi169.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:25:40.053 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:40.053 DEBUG:teuthology.orchestra.run.smithi169:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:40.127 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:25:40.127 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:40.128 DEBUG:teuthology.orchestra.run.smithi169:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:40.264 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:40.264 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:40.874 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:40.875 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:40.875 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.169:3300,172.21.15.169:3301" 2024-08-17T02:25:40.875 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: trying mount with new device syntax: 1@2ec357bb-2069-43d1-ab40-d29098820580.cephfs=/ 2024-08-17T02:25:40.875 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.169:3300/172.21.15.169:3301" will pass to kernel 2024-08-17T02:25:40.875 INFO:teuthology.orchestra.run.smithi169.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:25:40.876 INFO:teuthology.orchestra.run.smithi169.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:25:40.876 INFO:teuthology.orchestra.run.smithi169.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:25:40.876 INFO:teuthology.orchestra.run.smithi169.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:25:40.876 INFO:teuthology.orchestra.run.smithi169.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:25:40.879 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:25:40.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:40.879 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:25:40.936 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-08-17T02:25:40.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:25:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.097+0000 7fa09cc00640 1 Processor -- start 2024-08-17T02:25:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.097+0000 7fa09cc00640 1 -- start start 2024-08-17T02:25:41.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.098+0000 7fa09cc00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0981401b0 0x7fa0980caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.099 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.098+0000 7fa09cc00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0980b1440 0x7fa0980c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.098+0000 7fa09cc00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0980caa80 con 0x7fa098140580 2024-08-17T02:25:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.098+0000 7fa09cc00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0980cb450 con 0x7fa0981401b0 2024-08-17T02:25:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.098+0000 7fa09cc00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980c9e70 con 0x7fa0980b1440 2024-08-17T02:25:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.099+0000 7fa095e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0981401b0 0x7fa0980caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.099+0000 7fa095e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0981401b0 0x7fa0980caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48002/0 (socket says 172.21.15.45:48002) 2024-08-17T02:25:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.099+0000 7fa095e00640 1 -- 172.21.15.45:0/439731727 learned_addr learned my addr 172.21.15.45:0/439731727 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.099+0000 7fa096800640 1 --2- 172.21.15.45:0/439731727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0980b1440 0x7fa0980c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.099+0000 7fa095e00640 1 -- 172.21.15.45:0/439731727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0980b1440 msgr2=0x7fa0980c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.099+0000 7fa095e00640 1 --2- 172.21.15.45:0/439731727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0980b1440 0x7fa0980c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.099+0000 7fa095e00640 1 -- 172.21.15.45:0/439731727 >> v1:172.21.15.45:6789/0 conn(0x7fa098140580 legacy=0x7fa0980b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.099+0000 7fa094a00640 1 -- 172.21.15.45:0/439731727 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488506909 0 0) 0x7fa0980caa80 con 0x7fa098140580 2024-08-17T02:25:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.099+0000 7fa095e00640 1 -- 172.21.15.45:0/439731727 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0980ca150 con 0x7fa0981401b0 2024-08-17T02:25:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.100+0000 7fa095e00640 1 --2- 172.21.15.45:0/439731727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0981401b0 0x7fa0980caf10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa088009910 tx=0x7fa0880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc9689a02c1c8f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.100+0000 7fa094a00640 1 -- 172.21.15.45:0/439731727 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08802adb0 con 0x7fa0981401b0 2024-08-17T02:25:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.101+0000 7fa094a00640 1 -- 172.21.15.45:0/439731727 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa088032440 con 0x7fa0981401b0 2024-08-17T02:25:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.101+0000 7fa094a00640 1 -- 172.21.15.45:0/439731727 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0880327e0 con 0x7fa0981401b0 2024-08-17T02:25:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.101+0000 7fa09cc00640 1 -- 172.21.15.45:0/439731727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0981401b0 msgr2=0x7fa0980caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.101+0000 7fa09cc00640 1 --2- 172.21.15.45:0/439731727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0981401b0 0x7fa0980caf10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa088009910 tx=0x7fa0880091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.101+0000 7fa09cc00640 1 -- 172.21.15.45:0/439731727 shutdown_connections 2024-08-17T02:25:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.101+0000 7fa09cc00640 1 --2- 172.21.15.45:0/439731727 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0980b1440 0x7fa0980c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.101+0000 7fa09cc00640 1 --2- 172.21.15.45:0/439731727 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0981401b0 0x7fa0980caf10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.101+0000 7fa09cc00640 1 -- 172.21.15.45:0/439731727 >> 172.21.15.45:0/439731727 conn(0x7fa0980cb9b0 msgr2=0x7fa0980cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.101+0000 7fa09cc00640 1 -- 172.21.15.45:0/439731727 shutdown_connections 2024-08-17T02:25:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.101+0000 7fa09cc00640 1 -- 172.21.15.45:0/439731727 wait complete. 2024-08-17T02:25:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.102+0000 7fa09cc00640 1 Processor -- start 2024-08-17T02:25:41.103 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.103+0000 7fa09cc00640 1 -- start start 2024-08-17T02:25:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.103+0000 7fa09cc00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0980b1440 0x7fa09813cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.103+0000 7fa09cc00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0981401b0 0x7fa098069330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.103+0000 7fa09cc00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa098140580 0x7fa098069870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa09cc00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980ab130 con 0x7fa0981401b0 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa09cc00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0980c0ab0 con 0x7fa098140580 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa09cc00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa098168da0 con 0x7fa0980b1440 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa095400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0981401b0 0x7fa098069330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa095400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0981401b0 0x7fa098069330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48014/0 (socket says 172.21.15.45:48014) 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa095400640 1 -- 172.21.15.45:0/1558174324 learned_addr learned my addr 172.21.15.45:0/1558174324 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa095e00640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0980b1440 0x7fa09813cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa096800640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa098140580 0x7fa098069870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa095400640 1 -- 172.21.15.45:0/1558174324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0980b1440 msgr2=0x7fa09813cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.106 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa095400640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0980b1440 0x7fa09813cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa095400640 1 -- 172.21.15.45:0/1558174324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa098140580 msgr2=0x7fa098069870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa095400640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa098140580 0x7fa098069870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.104+0000 7fa095400640 1 -- 172.21.15.45:0/1558174324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa088009450 con 0x7fa0981401b0 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.105+0000 7fa095400640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0981401b0 0x7fa098069330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa08400c4e0 tx=0x7fa084007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.105+0000 7fa08d600640 1 -- 172.21.15.45:0/1558174324 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084012630 con 0x7fa0981401b0 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.105+0000 7fa08d600640 1 -- 172.21.15.45:0/1558174324 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0840127b0 con 0x7fa0981401b0 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.105+0000 7fa08d600640 1 -- 172.21.15.45:0/1558174324 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084012bb0 con 0x7fa0981401b0 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.105+0000 7fa09cc00640 1 -- 172.21.15.45:0/1558174324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0980b0110 con 0x7fa0981401b0 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.105+0000 7fa09cc00640 1 -- 172.21.15.45:0/1558174324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0980b0750 con 0x7fa0981401b0 2024-08-17T02:25:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.106+0000 7fa09cc00640 1 -- 172.21.15.45:0/1558174324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa098168fc0 con 0x7fa0981401b0 2024-08-17T02:25:41.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.107+0000 7fa08d600640 1 -- 172.21.15.45:0/1558174324 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa08401b400 con 0x7fa0981401b0 2024-08-17T02:25:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.109+0000 7fa08d600640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa078065150 0x7fa078067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.109+0000 7fa08d600640 1 -- 172.21.15.45:0/1558174324 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa084081f50 con 0x7fa0981401b0 2024-08-17T02:25:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.109+0000 7fa095e00640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa078065150 0x7fa078067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:41.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.110+0000 7fa095e00640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa078065150 0x7fa078067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa088034000 tx=0x7fa088032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:41.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.113+0000 7fa08d600640 1 -- 172.21.15.45:0/1558174324 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa098168fc0 con 0x7fa0981401b0 2024-08-17T02:25:41.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.336+0000 7fa09cc00640 1 -- 172.21.15.45:0/1558174324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa098168f60 con 0x7fa0981401b0 2024-08-17T02:25:41.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.336+0000 7fa08d600640 1 -- 172.21.15.45:0/1558174324 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa084050020 con 0x7fa0981401b0 2024-08-17T02:25:41.337 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:25:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.338+0000 7fa09cc00640 1 -- 172.21.15.45:0/1558174324 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa078065150 msgr2=0x7fa078067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.338+0000 7fa09cc00640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa078065150 0x7fa078067600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa088034000 tx=0x7fa088032000 comp rx=0 tx=0).stop 2024-08-17T02:25:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.338+0000 7fa09cc00640 1 -- 172.21.15.45:0/1558174324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0981401b0 msgr2=0x7fa098069330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:41.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.338+0000 7fa09cc00640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0981401b0 0x7fa098069330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa08400c4e0 tx=0x7fa084007ef0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.338+0000 7fa09cc00640 1 -- 172.21.15.45:0/1558174324 shutdown_connections 2024-08-17T02:25:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.338+0000 7fa09cc00640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa098140580 0x7fa098069870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.338+0000 7fa09cc00640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0981401b0 0x7fa098069330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.338+0000 7fa09cc00640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa078065150 0x7fa078067600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.338+0000 7fa09cc00640 1 --2- 172.21.15.45:0/1558174324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa0980b1440 0x7fa09813cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.338+0000 7fa09cc00640 1 -- 172.21.15.45:0/1558174324 >> 172.21.15.45:0/1558174324 conn(0x7fa0980cb9b0 msgr2=0x7fa09806e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.339+0000 7fa09cc00640 1 -- 172.21.15.45:0/1558174324 shutdown_connections 2024-08-17T02:25:41.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:41.339+0000 7fa09cc00640 1 -- 172.21.15.45:0/1558174324 wait complete. 2024-08-17T02:25:41.354 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-17T02:25:41.355 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:25:41.355 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi169.front.sepia.ceph.com 2024-08-17T02:25:41.355 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-08-17T02:25:41.355 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-08-17T02:25:41.355 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-17T02:25:41.355 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-17T02:25:41.355 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:25:41.355 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:25:41.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:41.355 DEBUG:teuthology.orchestra.run.smithi169:> ip addr 2024-08-17T02:25:41.392 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:41.392 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:41.392 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:41.392 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:41.392 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:41.392 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:41.392 INFO:teuthology.orchestra.run.smithi169.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:41.392 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:41.392 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f0 2024-08-17T02:25:41.392 INFO:teuthology.orchestra.run.smithi169.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:41.392 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f1 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: inet 172.21.15.169/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft 42639sec preferred_lft 42639sec 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::ec4:7aff:fe88:7f4d/64 scope link 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 5e:81:a3:d7:90:2f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::ec33:acff:fed8:71f9/64 scope link 2024-08-17T02:25:41.393 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:41.394 INFO:teuthology.orchestra.run.smithi169.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:25:41.394 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 5e:81:a3:d7:90:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:25:41.394 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::5c81:a3ff:fed7:902f/64 scope link tentative 2024-08-17T02:25:41.394 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:41.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:41.395 DEBUG:teuthology.orchestra.run.smithi169:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:25:41.488 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-08-17T02:25:41.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:41.492 DEBUG:teuthology.orchestra.run.smithi169:> route 2024-08-17T02:25:41.528 INFO:teuthology.orchestra.run.smithi169.stdout:Kernel IP routing table 2024-08-17T02:25:41.528 INFO:teuthology.orchestra.run.smithi169.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:25:41.528 INFO:teuthology.orchestra.run.smithi169.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:25:41.528 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:25:41.528 INFO:teuthology.orchestra.run.smithi169.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:25:41.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:41.529 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-08-17T02:25:41.529 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-08-17T02:25:41.529 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:25:41.529 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:25:41.529 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:25:41.529 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-08-17T02:25:41.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:41.675 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-08-17T02:25:41.710 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:25:41.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:41.711 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list-id 2024-08-17T02:25:41.787 INFO:teuthology.orchestra.run.smithi169.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-08-17T02:25:41.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:41.787 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-08-17T02:25:41.788 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-08-17T02:25:41.788 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:25:41.788 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-08-17T02:25:41.788 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-08-17T02:25:41.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:41.914 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:25:41.969 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:41.969 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:41.970 INFO:teuthology.orchestra.run.smithi169.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 7e:bb:69:92:3d:14 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:25:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:25:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::7cbb:69ff:fe92:3d14/64 scope link tentative 2024-08-17T02:25:41.970 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:41.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:41.972 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-08-17T02:25:42.028 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:25:42.028 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:25:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:25:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-08-17T02:25:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:42.029 INFO:teuthology.orchestra.run.smithi169.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:25:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 7e:bb:69:92:3d:14 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-08-17T02:25:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-08-17T02:25:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::7cbb:69ff:fe92:3d14/64 scope link 2024-08-17T02:25:42.029 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:25:42.031 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-08-17T02:25:42.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:42.031 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-08-17T02:25:42.032 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-08-17T02:25:42.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-08-17T02:25:42.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-08-17T02:25:42.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-08-17T02:25:42.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-08-17T02:25:42.032 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-08-17T02:25:42.032 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-08-17T02:25:42.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:42.200 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-08-17T02:25:42.200 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-08-17T02:25:42.200 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set brx.1 up 2024-08-17T02:25:42.200 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set dev brx.1 master ceph-brx 2024-08-17T02:25:42.201 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-08-17T02:25:42.315 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:42.316 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-08-17T02:25:42.351 INFO:teuthology.orchestra.run.smithi169.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-08-17T02:25:42.351 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:25:42.351 DEBUG:teuthology.orchestra.run.smithi169:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:25:42.425 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-08-17T02:25:42.425 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:25:42.425 DEBUG:teuthology.orchestra.run.smithi169:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:42.546 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:42.546 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:42.572 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:25:42.573 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:25:42.573 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.169:3300,172.21.15.169:3301" 2024-08-17T02:25:42.573 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: trying mount with new device syntax: 3@2ec357bb-2069-43d1-ab40-d29098820580.cephfs=/ 2024-08-17T02:25:42.573 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.45:3300/172.21.15.169:3300/172.21.15.169:3301" will pass to kernel 2024-08-17T02:25:42.574 INFO:teuthology.orchestra.run.smithi169.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-08-17T02:25:42.574 INFO:teuthology.orchestra.run.smithi169.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:25:42.574 INFO:teuthology.orchestra.run.smithi169.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:25:42.574 INFO:teuthology.orchestra.run.smithi169.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:25:42.574 INFO:teuthology.orchestra.run.smithi169.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:25:42.577 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:25:42.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:42.577 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-08-17T02:25:42.633 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-08-17T02:25:42.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:42.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.811+0000 7f9517c00640 1 Processor -- start 2024-08-17T02:25:42.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.811+0000 7f9517c00640 1 -- start start 2024-08-17T02:25:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.812+0000 7f9517c00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9510158b10 0x7f95100c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.813+0000 7f9517c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95100aaa40 con 0x7f95100a98e0 2024-08-17T02:25:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.813+0000 7f9517c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95100c8d80 con 0x7f95100ad070 2024-08-17T02:25:42.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.813+0000 7f9517c00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95100a9e30 con 0x7f9510158b10 2024-08-17T02:25:42.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.813+0000 7f9515c00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95100a98e0 0x7f9510068c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46300/0 (socket says 172.21.15.45:46300) 2024-08-17T02:25:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.813+0000 7f9515c00640 1 -- 172.21.15.45:0/1194289215 learned_addr learned my addr 172.21.15.45:0/1194289215 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.813+0000 7f9515200640 1 --2- 172.21.15.45:0/1194289215 >> v2:172.21.15.169:3300/0 conn(0x7f9510158b10 0x7f95100c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.813+0000 7f950f400640 1 -- 172.21.15.45:0/1194289215 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059848787 0 0) 0x7f95100aaa40 con 0x7f95100a98e0 2024-08-17T02:25:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.813+0000 7f950f400640 1 -- 172.21.15.45:0/1194289215 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94f80034e0 con 0x7f95100a98e0 2024-08-17T02:25:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.814+0000 7f950f400640 1 -- 172.21.15.45:0/1194289215 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455268239 0 0) 0x7f95100c8d80 con 0x7f95100ad070 2024-08-17T02:25:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.814+0000 7f9515200640 1 -- 172.21.15.45:0/1194289215 >> v1:172.21.15.169:6789/0 conn(0x7f95100ad070 legacy=0x7f95100aaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.814+0000 7f9515200640 1 -- 172.21.15.45:0/1194289215 >> v1:172.21.15.45:6789/0 conn(0x7f95100a98e0 legacy=0x7f9510068c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.814+0000 7f9515200640 1 -- 172.21.15.45:0/1194289215 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95100aa110 con 0x7f9510158b10 2024-08-17T02:25:42.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.815+0000 7f9515200640 1 --2- 172.21.15.45:0/1194289215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510158b10 0x7f95100c8840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9504009850 tx=0x7f95040090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c93fb2d7c514fce server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.815+0000 7f950f400640 1 -- 172.21.15.45:0/1194289215 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950402ad90 con 0x7f9510158b10 2024-08-17T02:25:42.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.815+0000 7f950f400640 1 -- 172.21.15.45:0/1194289215 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9504032440 con 0x7f9510158b10 2024-08-17T02:25:42.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.815+0000 7f950f400640 1 -- 172.21.15.45:0/1194289215 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95040327e0 con 0x7f9510158b10 2024-08-17T02:25:42.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.816+0000 7f9517c00640 1 -- 172.21.15.45:0/1194289215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510158b10 msgr2=0x7f95100c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.816+0000 7f9517c00640 1 --2- 172.21.15.45:0/1194289215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510158b10 0x7f95100c8840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9504009850 tx=0x7f95040090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.816+0000 7f9517c00640 1 -- 172.21.15.45:0/1194289215 shutdown_connections 2024-08-17T02:25:42.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.816+0000 7f9517c00640 1 --2- 172.21.15.45:0/1194289215 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510158b10 0x7f95100c8840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.816+0000 7f9517c00640 1 -- 172.21.15.45:0/1194289215 >> 172.21.15.45:0/1194289215 conn(0x7f9510066cd0 msgr2=0x7f95100670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:42.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.816+0000 7f9517c00640 1 -- 172.21.15.45:0/1194289215 shutdown_connections 2024-08-17T02:25:42.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.816+0000 7f9517c00640 1 -- 172.21.15.45:0/1194289215 wait complete. 2024-08-17T02:25:42.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.817+0000 7f9517c00640 1 Processor -- start 2024-08-17T02:25:42.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.817+0000 7f9517c00640 1 -- start start 2024-08-17T02:25:42.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.818+0000 7f9517c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95100a98e0 0x7f95100aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.818+0000 7f9517c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95100ad070 0x7f951014bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.818+0000 7f9517c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510158b10 0x7f951014e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.818+0000 7f9517c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95101533e0 con 0x7f95100a98e0 2024-08-17T02:25:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.818+0000 7f9517c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95100af4c0 con 0x7f9510158b10 2024-08-17T02:25:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.818+0000 7f9517c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95100af7a0 con 0x7f95100ad070 2024-08-17T02:25:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.818+0000 7f9515200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95100a98e0 0x7f95100aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.818+0000 7f9515200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95100a98e0 0x7f95100aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46944/0 (socket says 172.21.15.45:46944) 2024-08-17T02:25:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.818+0000 7f9515200640 1 -- 172.21.15.45:0/3351140465 learned_addr learned my addr 172.21.15.45:0/3351140465 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.818+0000 7f9515c00640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510158b10 0x7f951014e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.818+0000 7f950fe00640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95100ad070 0x7f951014bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.819+0000 7f9515200640 1 -- 172.21.15.45:0/3351140465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95100ad070 msgr2=0x7f951014bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.819+0000 7f9515200640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95100ad070 0x7f951014bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.819+0000 7f9515200640 1 -- 172.21.15.45:0/3351140465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510158b10 msgr2=0x7f951014e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:42.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.819+0000 7f9515200640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510158b10 0x7f951014e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.819+0000 7f9515200640 1 -- 172.21.15.45:0/3351140465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9504009390 con 0x7f95100a98e0 2024-08-17T02:25:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.819+0000 7f9515200640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95100a98e0 0x7f95100aee30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9504009850 tx=0x7f9504032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.819+0000 7f9503e00640 1 -- 172.21.15.45:0/3351140465 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9504031a60 con 0x7f95100a98e0 2024-08-17T02:25:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.819+0000 7f9503e00640 1 -- 172.21.15.45:0/3351140465 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9504031bc0 con 0x7f95100a98e0 2024-08-17T02:25:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.819+0000 7f9503e00640 1 -- 172.21.15.45:0/3351140465 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950403d420 con 0x7f95100a98e0 2024-08-17T02:25:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.820+0000 7f9517c00640 1 -- 172.21.15.45:0/3351140465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95100afa80 con 0x7f95100a98e0 2024-08-17T02:25:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.820+0000 7f9517c00640 1 -- 172.21.15.45:0/3351140465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95100b0040 con 0x7f95100a98e0 2024-08-17T02:25:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.821+0000 7f9517c00640 1 -- 172.21.15.45:0/3351140465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95100b0260 con 0x7f95100a98e0 2024-08-17T02:25:42.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.821+0000 7f9503e00640 1 -- 172.21.15.45:0/3351140465 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9504039040 con 0x7f95100a98e0 2024-08-17T02:25:42.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.822+0000 7f9503e00640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f94f0065150 0x7f94f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:42.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.822+0000 7f9503e00640 1 -- 172.21.15.45:0/3351140465 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95040a1ff0 con 0x7f95100a98e0 2024-08-17T02:25:42.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.822+0000 7f950fe00640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f94f0065150 0x7f94f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:42.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.823+0000 7f950fe00640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f94f0065150 0x7f94f0067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f951016ca00 tx=0x7f94fc007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:42.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:42.826+0000 7f9503e00640 1 -- 172.21.15.45:0/3351140465 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f95040d3e40 con 0x7f95100a98e0 2024-08-17T02:25:43.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.009+0000 7f9517c00640 1 -- 172.21.15.45:0/3351140465 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9510064db0 con 0x7f95100a98e0 2024-08-17T02:25:43.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.010+0000 7f9503e00640 1 -- 172.21.15.45:0/3351140465 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f9504070100 con 0x7f95100a98e0 2024-08-17T02:25:43.011 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:43.011 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:43.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 -- 172.21.15.45:0/3351140465 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f94f0065150 msgr2=0x7f94f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f94f0065150 0x7f94f0067600 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f951016ca00 tx=0x7f94fc007ca0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 -- 172.21.15.45:0/3351140465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95100a98e0 msgr2=0x7f95100aee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95100a98e0 0x7f95100aee30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9504009850 tx=0x7f9504032000 comp rx=0 tx=0).stop 2024-08-17T02:25:43.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 -- 172.21.15.45:0/3351140465 shutdown_connections 2024-08-17T02:25:43.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9510158b10 0x7f951014e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f94f0065150 0x7f94f0067600 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f95100ad070 0x7f951014bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 --2- 172.21.15.45:0/3351140465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95100a98e0 0x7f95100aee30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 -- 172.21.15.45:0/3351140465 >> 172.21.15.45:0/3351140465 conn(0x7f9510066cd0 msgr2=0x7f95100c91f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 -- 172.21.15.45:0/3351140465 shutdown_connections 2024-08-17T02:25:43.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.012+0000 7f9517c00640 1 -- 172.21.15.45:0/3351140465 wait complete. 2024-08-17T02:25:43.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:12.166249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:13.072271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:43.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:43.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.182+0000 7f81ab200640 1 Processor -- start 2024-08-17T02:25:43.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.182+0000 7f81ab200640 1 -- start start 2024-08-17T02:25:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.183+0000 7f81ab200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f81ac158c20 0x7f81ac0ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.183+0000 7f81ab200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ac0aeca0 con 0x7f81ac0696e0 2024-08-17T02:25:43.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.183+0000 7f81ab200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81ac0ac9d0 con 0x7f81ac0ac580 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.183+0000 7f81ab200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81ac069b20 con 0x7f81ac158c20 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.183+0000 7f81a9e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f81ac158c20 0x7f81ac0ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.183+0000 7f81a9e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f81ac158c20 0x7f81ac0ac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46946/0 (socket says 172.21.15.45:46946) 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.183+0000 7f81aa800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f81ac0696e0 0x7f81ac0af130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46310/0 (socket says 172.21.15.45:46310) 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.183+0000 7f81a9e00640 1 -- 172.21.15.45:0/1533143068 learned_addr learned my addr 172.21.15.45:0/1533143068 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.184+0000 7f81a9e00640 1 -- 172.21.15.45:0/1533143068 >> v1:172.21.15.169:6789/0 conn(0x7f81ac0ac580 legacy=0x7f81ac068fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.184+0000 7f81a9e00640 1 -- 172.21.15.45:0/1533143068 >> v1:172.21.15.45:6789/0 conn(0x7f81ac0696e0 legacy=0x7f81ac0af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.184+0000 7f81a9e00640 1 -- 172.21.15.45:0/1533143068 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac0ae3e0 con 0x7f81ac158c20 2024-08-17T02:25:43.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.184+0000 7f81a9400640 1 -- 172.21.15.45:0/1533143068 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1721237246 0 0) 0x7f81ac0aeca0 con 0x7f81ac0696e0 2024-08-17T02:25:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.185+0000 7f81a9e00640 1 --2- 172.21.15.45:0/1533143068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81ac158c20 0x7f81ac0ac040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f819c009910 tx=0x7f819c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116c2ce4e43e7cb8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.185+0000 7f81a9400640 1 -- 172.21.15.45:0/1533143068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c02ae60 con 0x7f81ac158c20 2024-08-17T02:25:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.185+0000 7f81a9400640 1 -- 172.21.15.45:0/1533143068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819c032440 con 0x7f81ac158c20 2024-08-17T02:25:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.185+0000 7f81a9400640 1 -- 172.21.15.45:0/1533143068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819c0327e0 con 0x7f81ac158c20 2024-08-17T02:25:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.186+0000 7f81ab200640 1 -- 172.21.15.45:0/1533143068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81ac158c20 msgr2=0x7f81ac0ac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.186+0000 7f81ab200640 1 --2- 172.21.15.45:0/1533143068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81ac158c20 0x7f81ac0ac040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f819c009910 tx=0x7f819c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.186+0000 7f81ab200640 1 -- 172.21.15.45:0/1533143068 shutdown_connections 2024-08-17T02:25:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.186+0000 7f81ab200640 1 --2- 172.21.15.45:0/1533143068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81ac158c20 0x7f81ac0ac040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.186+0000 7f81ab200640 1 -- 172.21.15.45:0/1533143068 >> 172.21.15.45:0/1533143068 conn(0x7f81ac096a70 msgr2=0x7f81ac096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.186+0000 7f81ab200640 1 -- 172.21.15.45:0/1533143068 shutdown_connections 2024-08-17T02:25:43.187 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.186+0000 7f81ab200640 1 -- 172.21.15.45:0/1533143068 wait complete. 2024-08-17T02:25:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.187+0000 7f81ab200640 1 Processor -- start 2024-08-17T02:25:43.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.187+0000 7f81ab200640 1 -- start start 2024-08-17T02:25:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.188+0000 7f81ab200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81ac0696e0 0x7f81ac0b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.188+0000 7f81ab200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81ac0ac580 0x7f81ac0b2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.188+0000 7f81ab200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81ac158c20 0x7f81ac168de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.188+0000 7f81ab200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac0b3180 con 0x7f81ac0ac580 2024-08-17T02:25:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.188+0000 7f81ab200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac099910 con 0x7f81ac0696e0 2024-08-17T02:25:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.188+0000 7f81ab200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81ac099bf0 con 0x7f81ac158c20 2024-08-17T02:25:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.188+0000 7f81a3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81ac0ac580 0x7f81ac0b2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.188+0000 7f81a3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81ac0ac580 0x7f81ac0b2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46956/0 (socket says 172.21.15.45:46956) 2024-08-17T02:25:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.188+0000 7f81a3e00640 1 -- 172.21.15.45:0/2815712957 learned_addr learned my addr 172.21.15.45:0/2815712957 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:43.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81a9e00640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81ac0696e0 0x7f81ac0b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81aa800640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81ac158c20 0x7f81ac168de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81a3e00640 1 -- 172.21.15.45:0/2815712957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81ac158c20 msgr2=0x7f81ac168de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81a3e00640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81ac158c20 0x7f81ac168de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81a3e00640 1 -- 172.21.15.45:0/2815712957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81ac0696e0 msgr2=0x7f81ac0b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81a3e00640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81ac0696e0 0x7f81ac0b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81a3e00640 1 -- 172.21.15.45:0/2815712957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c009450 con 0x7f81ac0ac580 2024-08-17T02:25:43.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81a3e00640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81ac0ac580 0x7f81ac0b2940 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f819400c560 tx=0x7f8194007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81a1600640 1 -- 172.21.15.45:0/2815712957 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194011590 con 0x7f81ac0ac580 2024-08-17T02:25:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81a1600640 1 -- 172.21.15.45:0/2815712957 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8194011710 con 0x7f81ac0ac580 2024-08-17T02:25:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81a1600640 1 -- 172.21.15.45:0/2815712957 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8194011ad0 con 0x7f81ac0ac580 2024-08-17T02:25:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.189+0000 7f81ab200640 1 -- 172.21.15.45:0/2815712957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81ac099ed0 con 0x7f81ac0ac580 2024-08-17T02:25:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.190+0000 7f81ab200640 1 -- 172.21.15.45:0/2815712957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81ac0995c0 con 0x7f81ac0ac580 2024-08-17T02:25:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.191+0000 7f81ab200640 1 -- 172.21.15.45:0/2815712957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81ac09a0c0 con 0x7f81ac0ac580 2024-08-17T02:25:43.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.191+0000 7f81a1600640 1 -- 172.21.15.45:0/2815712957 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f819401b3b0 con 0x7f81ac0ac580 2024-08-17T02:25:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.192+0000 7f81a1600640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8188065150 0x7f8188067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.192+0000 7f81a1600640 1 -- 172.21.15.45:0/2815712957 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f81940819e0 con 0x7f81ac0ac580 2024-08-17T02:25:43.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.192+0000 7f81a9e00640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8188065150 0x7f8188067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.193+0000 7f81a9e00640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8188065150 0x7f8188067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f819c034000 tx=0x7f819c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.196+0000 7f81a1600640 1 -- 172.21.15.45:0/2815712957 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f819404fab0 con 0x7f81ac0ac580 2024-08-17T02:25:43.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.380+0000 7f81ab200640 1 -- 172.21.15.45:0/2815712957 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81ac071050 con 0x7f81ac0ac580 2024-08-17T02:25:43.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.380+0000 7f81a1600640 1 -- 172.21.15.45:0/2815712957 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8194017070 con 0x7f81ac0ac580 2024-08-17T02:25:43.381 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 -- 172.21.15.45:0/2815712957 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8188065150 msgr2=0x7f8188067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8188065150 0x7f8188067600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f819c034000 tx=0x7f819c032000 comp rx=0 tx=0).stop 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 -- 172.21.15.45:0/2815712957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81ac0ac580 msgr2=0x7f81ac0b2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81ac0ac580 0x7f81ac0b2940 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f819400c560 tx=0x7f8194007ef0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 -- 172.21.15.45:0/2815712957 shutdown_connections 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8188065150 0x7f8188067600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f81ac158c20 0x7f81ac168de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81ac0ac580 0x7f81ac0b2940 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 --2- 172.21.15.45:0/2815712957 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f81ac0696e0 0x7f81ac0b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 -- 172.21.15.45:0/2815712957 >> 172.21.15.45:0/2815712957 conn(0x7f81ac096a70 msgr2=0x7f81ac06b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 -- 172.21.15.45:0/2815712957 shutdown_connections 2024-08-17T02:25:43.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.383+0000 7f81ab200640 1 -- 172.21.15.45:0/2815712957 wait complete. 2024-08-17T02:25:43.399 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:43.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.554+0000 7fbf69600640 1 Processor -- start 2024-08-17T02:25:43.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.554+0000 7fbf69600640 1 -- start start 2024-08-17T02:25:43.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.555+0000 7fbf69600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf640c4950 0x7fbf640ce620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.555+0000 7fbf69600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf640cb980 0x7fbf64158730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.555+0000 7fbf69600640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf640c5a40 con 0x7fbf640ce250 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.555+0000 7fbf69600640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf640c4e30 con 0x7fbf640c4950 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.555+0000 7fbf69600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640c5110 con 0x7fbf640cb980 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.555+0000 7fbf5b400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf640c4950 0x7fbf640ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.555+0000 7fbf5b400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbf640c4950 0x7fbf640ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46972/0 (socket says 172.21.15.45:46972) 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.555+0000 7fbf5b400640 1 -- 172.21.15.45:0/3048529665 learned_addr learned my addr 172.21.15.45:0/3048529665 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.556+0000 7fbf68c00640 1 --2- 172.21.15.45:0/3048529665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf640cb980 0x7fbf64158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.556+0000 7fbf5b400640 1 -- 172.21.15.45:0/3048529665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf640cb980 msgr2=0x7fbf64158730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:43.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.556+0000 7fbf5b400640 1 --2- 172.21.15.45:0/3048529665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf640cb980 0x7fbf64158730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.556+0000 7fbf5b400640 1 -- 172.21.15.45:0/3048529665 >> v1:172.21.15.169:6789/0 conn(0x7fbf640ce250 legacy=0x7fbf640b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:43.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.556+0000 7fbf5b400640 1 -- 172.21.15.45:0/3048529665 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf640c53f0 con 0x7fbf640c4950 2024-08-17T02:25:43.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.556+0000 7fbf68c00640 1 --2- 172.21.15.45:0/3048529665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf640cb980 0x7fbf64158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.557+0000 7fbf5b400640 1 --2- 172.21.15.45:0/3048529665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf640c4950 0x7fbf640ce620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009910 tx=0x7fbf4c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77b265b8e3db8f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.557+0000 7fbf63400640 1 -- 172.21.15.45:0/3048529665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c02ad40 con 0x7fbf640c4950 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.557+0000 7fbf63400640 1 -- 172.21.15.45:0/3048529665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4c032440 con 0x7fbf640c4950 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.557+0000 7fbf63400640 1 -- 172.21.15.45:0/3048529665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c02aea0 con 0x7fbf640c4950 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.557+0000 7fbf69600640 1 -- 172.21.15.45:0/3048529665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf640c4950 msgr2=0x7fbf640ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.557+0000 7fbf69600640 1 --2- 172.21.15.45:0/3048529665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf640c4950 0x7fbf640ce620 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009910 tx=0x7fbf4c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.558+0000 7fbf69600640 1 -- 172.21.15.45:0/3048529665 shutdown_connections 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.558+0000 7fbf69600640 1 --2- 172.21.15.45:0/3048529665 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf640cb980 0x7fbf64158730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.558+0000 7fbf69600640 1 --2- 172.21.15.45:0/3048529665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf640c4950 0x7fbf640ce620 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.558+0000 7fbf69600640 1 -- 172.21.15.45:0/3048529665 >> 172.21.15.45:0/3048529665 conn(0x7fbf64098e30 msgr2=0x7fbf6406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.558+0000 7fbf69600640 1 -- 172.21.15.45:0/3048529665 shutdown_connections 2024-08-17T02:25:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.558+0000 7fbf69600640 1 -- 172.21.15.45:0/3048529665 wait complete. 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.559+0000 7fbf69600640 1 Processor -- start 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.559+0000 7fbf69600640 1 -- start start 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.560+0000 7fbf69600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf640c4950 0x7fbf640c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.560+0000 7fbf69600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf640cb980 0x7fbf640c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.560+0000 7fbf69600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf640ce250 0x7fbf640c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.560+0000 7fbf69600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6409c970 con 0x7fbf640c4950 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.560+0000 7fbf69600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf640c9d90 con 0x7fbf640ce250 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.560+0000 7fbf69600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf6409bac0 con 0x7fbf640cb980 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.560+0000 7fbf63e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf640c4950 0x7fbf640c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.560+0000 7fbf63e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf640c4950 0x7fbf640c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46978/0 (socket says 172.21.15.45:46978) 2024-08-17T02:25:43.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.560+0000 7fbf63e00640 1 -- 172.21.15.45:0/2646196075 learned_addr learned my addr 172.21.15.45:0/2646196075 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf68c00640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf640ce250 0x7fbf640c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf5b400640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf640cb980 0x7fbf640c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf63e00640 1 -- 172.21.15.45:0/2646196075 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf640cb980 msgr2=0x7fbf640c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf63e00640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf640cb980 0x7fbf640c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf63e00640 1 -- 172.21.15.45:0/2646196075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf640ce250 msgr2=0x7fbf640c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf63e00640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf640ce250 0x7fbf640c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf63e00640 1 -- 172.21.15.45:0/2646196075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c009450 con 0x7fbf640c4950 2024-08-17T02:25:43.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf63e00640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf640c4950 0x7fbf640c9850 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400b520 tx=0x7fbf540090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf5be00640 1 -- 172.21.15.45:0/2646196075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400f510 con 0x7fbf640c4950 2024-08-17T02:25:43.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf5be00640 1 -- 172.21.15.45:0/2646196075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5400f670 con 0x7fbf640c4950 2024-08-17T02:25:43.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf5be00640 1 -- 172.21.15.45:0/2646196075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400fa30 con 0x7fbf640c4950 2024-08-17T02:25:43.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.561+0000 7fbf69600640 1 -- 172.21.15.45:0/2646196075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6409bd60 con 0x7fbf640c4950 2024-08-17T02:25:43.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.562+0000 7fbf69600640 1 -- 172.21.15.45:0/2646196075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6409c320 con 0x7fbf640c4950 2024-08-17T02:25:43.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.563+0000 7fbf69600640 1 -- 172.21.15.45:0/2646196075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf64071050 con 0x7fbf640c4950 2024-08-17T02:25:43.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.563+0000 7fbf5be00640 1 -- 172.21.15.45:0/2646196075 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbf5401a400 con 0x7fbf640c4950 2024-08-17T02:25:43.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.564+0000 7fbf5be00640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbf40065150 0x7fbf40067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.564+0000 7fbf5be00640 1 -- 172.21.15.45:0/2646196075 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf54081e90 con 0x7fbf640c4950 2024-08-17T02:25:43.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.564+0000 7fbf5b400640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbf40065150 0x7fbf40067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.565+0000 7fbf5b400640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbf40065150 0x7fbf40067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c034000 tx=0x7fbf4c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.568+0000 7fbf5be00640 1 -- 172.21.15.45:0/2646196075 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbf5404ffe0 con 0x7fbf640c4950 2024-08-17T02:25:43.754 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.753+0000 7fbf69600640 1 -- 172.21.15.45:0/2646196075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbf640cc320 con 0x7fbf640c4950 2024-08-17T02:25:43.755 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.754+0000 7fbf5be00640 1 -- 172.21.15.45:0/2646196075 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbf54053600 con 0x7fbf640c4950 2024-08-17T02:25:43.755 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:25:43.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 -- 172.21.15.45:0/2646196075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbf40065150 msgr2=0x7fbf40067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.757 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbf40065150 0x7fbf40067600 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c034000 tx=0x7fbf4c032000 comp rx=0 tx=0).stop 2024-08-17T02:25:43.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 -- 172.21.15.45:0/2646196075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf640c4950 msgr2=0x7fbf640c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf640c4950 0x7fbf640c9850 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbf5400b520 tx=0x7fbf540090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 -- 172.21.15.45:0/2646196075 shutdown_connections 2024-08-17T02:25:43.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbf640ce250 0x7fbf640c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbf40065150 0x7fbf40067600 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbf640cb980 0x7fbf640c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 --2- 172.21.15.45:0/2646196075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf640c4950 0x7fbf640c9850 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 -- 172.21.15.45:0/2646196075 >> 172.21.15.45:0/2646196075 conn(0x7fbf64098e30 msgr2=0x7fbf64156e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 -- 172.21.15.45:0/2646196075 shutdown_connections 2024-08-17T02:25:43.758 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.756+0000 7fbf69600640 1 -- 172.21.15.45:0/2646196075 wait complete. 2024-08-17T02:25:43.772 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:43.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.926+0000 7f5e47600640 1 Processor -- start 2024-08-17T02:25:43.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.926+0000 7f5e47600640 1 -- start start 2024-08-17T02:25:43.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.927+0000 7f5e47600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e40158da0 0x7f5e400ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.927+0000 7f5e47600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e400aaf20 0x7f5e400ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.927+0000 7f5e47600640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400681f0 con 0x7f5e40159170 2024-08-17T02:25:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.927+0000 7f5e47600640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e400b08c0 con 0x7f5e40158da0 2024-08-17T02:25:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.927+0000 7f5e47600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400aca00 con 0x7f5e400aaf20 2024-08-17T02:25:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.927+0000 7f5e44c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e40158da0 0x7f5e400ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.927+0000 7f5e44c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e40158da0 0x7f5e400ac3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46982/0 (socket says 172.21.15.45:46982) 2024-08-17T02:25:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.928+0000 7f5e44c00640 1 -- 172.21.15.45:0/1410064753 learned_addr learned my addr 172.21.15.45:0/1410064753 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.928+0000 7f5e45600640 1 --2- 172.21.15.45:0/1410064753 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e400aaf20 0x7f5e400ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.928+0000 7f5e44c00640 1 -- 172.21.15.45:0/1410064753 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e400aaf20 msgr2=0x7f5e400ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.928+0000 7f5e44c00640 1 --2- 172.21.15.45:0/1410064753 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e400aaf20 0x7f5e400ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.928+0000 7f5e44c00640 1 -- 172.21.15.45:0/1410064753 >> v1:172.21.15.169:6789/0 conn(0x7f5e40159170 legacy=0x7f5e400aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:43.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.928+0000 7f5e44c00640 1 -- 172.21.15.45:0/1410064753 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400acce0 con 0x7f5e40158da0 2024-08-17T02:25:43.930 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.928+0000 7f5e45600640 1 --2- 172.21.15.45:0/1410064753 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e400aaf20 0x7f5e400ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.929+0000 7f5e44c00640 1 --2- 172.21.15.45:0/1410064753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e40158da0 0x7f5e400ac3e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009910 tx=0x7f5e340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87579b6ef409e4c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.929+0000 7f5e3f400640 1 -- 172.21.15.45:0/1410064753 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3402ad20 con 0x7f5e40158da0 2024-08-17T02:25:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.929+0000 7f5e3f400640 1 -- 172.21.15.45:0/1410064753 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3402ae80 con 0x7f5e40158da0 2024-08-17T02:25:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.929+0000 7f5e3f400640 1 -- 172.21.15.45:0/1410064753 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34032670 con 0x7f5e40158da0 2024-08-17T02:25:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.930+0000 7f5e47600640 1 -- 172.21.15.45:0/1410064753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e40158da0 msgr2=0x7f5e400ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.930+0000 7f5e47600640 1 --2- 172.21.15.45:0/1410064753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e40158da0 0x7f5e400ac3e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5e34009910 tx=0x7f5e340091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.930+0000 7f5e47600640 1 -- 172.21.15.45:0/1410064753 shutdown_connections 2024-08-17T02:25:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.930+0000 7f5e47600640 1 --2- 172.21.15.45:0/1410064753 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e400aaf20 0x7f5e400ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.930+0000 7f5e47600640 1 --2- 172.21.15.45:0/1410064753 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e40158da0 0x7f5e400ac3e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.930+0000 7f5e47600640 1 -- 172.21.15.45:0/1410064753 >> 172.21.15.45:0/1410064753 conn(0x7f5e40096a70 msgr2=0x7f5e40096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:43.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.930+0000 7f5e47600640 1 -- 172.21.15.45:0/1410064753 shutdown_connections 2024-08-17T02:25:43.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.930+0000 7f5e47600640 1 -- 172.21.15.45:0/1410064753 wait complete. 2024-08-17T02:25:43.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.931+0000 7f5e47600640 1 Processor -- start 2024-08-17T02:25:43.932 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.931+0000 7f5e47600640 1 -- start start 2024-08-17T02:25:43.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.932+0000 7f5e47600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e400aaf20 0x7f5e40153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.932+0000 7f5e47600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e40158da0 0x7f5e40159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.932+0000 7f5e47600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e4015b1f0 0x7f5e40169030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.934 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.932+0000 7f5e47600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40159ec0 con 0x7f5e40158da0 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.932+0000 7f5e47600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4015a1a0 con 0x7f5e4015b1f0 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.932+0000 7f5e47600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4015a480 con 0x7f5e400aaf20 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.932+0000 7f5e3fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e40158da0 0x7f5e40159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.933+0000 7f5e3fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e40158da0 0x7f5e40159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46996/0 (socket says 172.21.15.45:46996) 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.933+0000 7f5e3fe00640 1 -- 172.21.15.45:0/919016566 learned_addr learned my addr 172.21.15.45:0/919016566 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.933+0000 7f5e44c00640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e400aaf20 0x7f5e40153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.933+0000 7f5e45600640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e4015b1f0 0x7f5e40169030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.933+0000 7f5e3fe00640 1 -- 172.21.15.45:0/919016566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e400aaf20 msgr2=0x7f5e40153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.933+0000 7f5e3fe00640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e400aaf20 0x7f5e40153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.933+0000 7f5e3fe00640 1 -- 172.21.15.45:0/919016566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e4015b1f0 msgr2=0x7f5e40169030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.933+0000 7f5e3fe00640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e4015b1f0 0x7f5e40169030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.933+0000 7f5e3fe00640 1 -- 172.21.15.45:0/919016566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009450 con 0x7f5e40158da0 2024-08-17T02:25:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.933+0000 7f5e3fe00640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e40158da0 0x7f5e40159550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00b4f0 tx=0x7f5e2c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.933+0000 7f5e33e00640 1 -- 172.21.15.45:0/919016566 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00f510 con 0x7f5e40158da0 2024-08-17T02:25:43.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.934+0000 7f5e33e00640 1 -- 172.21.15.45:0/919016566 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00f670 con 0x7f5e40158da0 2024-08-17T02:25:43.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.934+0000 7f5e33e00640 1 -- 172.21.15.45:0/919016566 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c00fa70 con 0x7f5e40158da0 2024-08-17T02:25:43.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.934+0000 7f5e47600640 1 -- 172.21.15.45:0/919016566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e400b0a90 con 0x7f5e40158da0 2024-08-17T02:25:43.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.934+0000 7f5e47600640 1 -- 172.21.15.45:0/919016566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e401537b0 con 0x7f5e40158da0 2024-08-17T02:25:43.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.935+0000 7f5e47600640 1 -- 172.21.15.45:0/919016566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e400b0f90 con 0x7f5e40158da0 2024-08-17T02:25:43.936 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.936+0000 7f5e33e00640 1 -- 172.21.15.45:0/919016566 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5e2c01a400 con 0x7f5e40158da0 2024-08-17T02:25:43.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.936+0000 7f5e33e00640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e20065150 0x7f5e20067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:43.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.936+0000 7f5e33e00640 1 -- 172.21.15.45:0/919016566 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e2c081e30 con 0x7f5e40158da0 2024-08-17T02:25:43.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.937+0000 7f5e44c00640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e20065150 0x7f5e20067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:43.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.937+0000 7f5e44c00640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e20065150 0x7f5e20067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5e34034000 tx=0x7f5e34032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:43.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:43.941+0000 7f5e33e00640 1 -- 172.21.15.45:0/919016566 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5e2c050020 con 0x7f5e40158da0 2024-08-17T02:25:43.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:43.979 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:25:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.126+0000 7f5e47600640 1 -- 172.21.15.45:0/919016566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e40071050 con 0x7f5e40158da0 2024-08-17T02:25:44.127 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.126+0000 7f5e33e00640 1 -- 172.21.15.45:0/919016566 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e2c053640 con 0x7f5e40158da0 2024-08-17T02:25:44.127 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-08-17T02:25:44.129 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.128+0000 7f5e47600640 1 -- 172.21.15.45:0/919016566 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e20065150 msgr2=0x7f5e20067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.128+0000 7f5e47600640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e20065150 0x7f5e20067600 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f5e34034000 tx=0x7f5e34032000 comp rx=0 tx=0).stop 2024-08-17T02:25:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.129+0000 7f5e47600640 1 -- 172.21.15.45:0/919016566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e40158da0 msgr2=0x7f5e40159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.129+0000 7f5e47600640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e40158da0 0x7f5e40159550 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00b4f0 tx=0x7f5e2c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.129+0000 7f5e47600640 1 -- 172.21.15.45:0/919016566 shutdown_connections 2024-08-17T02:25:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.129+0000 7f5e47600640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e4015b1f0 0x7f5e40169030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.129+0000 7f5e47600640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e40158da0 0x7f5e40159550 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.129+0000 7f5e47600640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e20065150 0x7f5e20067600 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.129+0000 7f5e47600640 1 --2- 172.21.15.45:0/919016566 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e400aaf20 0x7f5e40153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.129+0000 7f5e47600640 1 -- 172.21.15.45:0/919016566 >> 172.21.15.45:0/919016566 conn(0x7f5e40096a70 msgr2=0x7f5e4006c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.129+0000 7f5e47600640 1 -- 172.21.15.45:0/919016566 shutdown_connections 2024-08-17T02:25:44.130 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.129+0000 7f5e47600640 1 -- 172.21.15.45:0/919016566 wait complete. 2024-08-17T02:25:44.145 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:44.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.296+0000 7fcb20400640 1 Processor -- start 2024-08-17T02:25:44.297 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.296+0000 7fcb20400640 1 -- start start 2024-08-17T02:25:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.297+0000 7fcb20400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcb1815a090 0x7fcb180aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.297+0000 7fcb20400640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb180afb50 con 0x7fcb180af6d0 2024-08-17T02:25:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.297+0000 7fcb20400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb180abc80 con 0x7fcb18158cb0 2024-08-17T02:25:44.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.297+0000 7fcb20400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb180aae50 con 0x7fcb1815a090 2024-08-17T02:25:44.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb1d000640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcb180af6d0 0x7fcb180ac820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46324/0 (socket says 172.21.15.45:46324) 2024-08-17T02:25:44.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb1d000640 1 -- 172.21.15.45:0/199681402 learned_addr learned my addr 172.21.15.45:0/199681402 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:44.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb1e400640 1 --2- 172.21.15.45:0/199681402 >> v2:172.21.15.169:3300/0 conn(0x7fcb1815a090 0x7fcb180aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2281367667 0 0) 0x7fcb04001110 con 0x7fcb180af6d0 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb000034e0 con 0x7fcb180af6d0 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4063690688 0 0) 0x7fcb000034e0 con 0x7fcb180af6d0 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 >> v2:172.21.15.169:3300/0 conn(0x7fcb1815a090 msgr2=0x7fcb180aa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb17e00640 1 --2- 172.21.15.45:0/199681402 >> v2:172.21.15.169:3300/0 conn(0x7fcb1815a090 0x7fcb180aa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 >> v1:172.21.15.169:6789/0 conn(0x7fcb18158cb0 legacy=0x7fcb180ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb180ab070 con 0x7fcb180af6d0 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7fcb04001600 con 0x7fcb180af6d0 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 >> v1:172.21.15.45:6789/0 conn(0x7fcb180af6d0 legacy=0x7fcb180ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.298+0000 7fcb17e00640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb000039d0 0x7fcb00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb17e00640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb00004780 0x7fcb00004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb17e00640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb00005130 0x7fcb0000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180aae50 con 0x7fcb00005130 2024-08-17T02:25:44.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0000bfc0 con 0x7fcb000039d0 2024-08-17T02:25:44.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0000c180 con 0x7fcb00004780 2024-08-17T02:25:44.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb1e400640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb00005130 0x7fcb0000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb1da00640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb000039d0 0x7fcb00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb1d000640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb00004780 0x7fcb00004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb1da00640 1 -- 172.21.15.45:0/199681402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb00004780 msgr2=0x7fcb00004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:44.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb1da00640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb00004780 0x7fcb00004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb1da00640 1 -- 172.21.15.45:0/199681402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb00005130 msgr2=0x7fcb0000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:44.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb1da00640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb00005130 0x7fcb0000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb1da00640 1 -- 172.21.15.45:0/199681402 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb000034e0 con 0x7fcb000039d0 2024-08-17T02:25:44.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb1e400640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb00005130 0x7fcb0000b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:44.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.299+0000 7fcb1e400640 1 -- 172.21.15.45:0/199681402 reap_dead start 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.301+0000 7fcb1da00640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb000039d0 0x7fcb00003da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0019e0 tx=0x7fcb0c007ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d8e215c462960cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.301+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c02aa60 con 0x7fcb000039d0 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.301+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c02abe0 con 0x7fcb000039d0 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.301+0000 7fcb17e00640 1 -- 172.21.15.45:0/199681402 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c0323f0 con 0x7fcb000039d0 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.301+0000 7fcb20400640 1 -- 172.21.15.45:0/199681402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb000039d0 msgr2=0x7fcb00003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.301+0000 7fcb20400640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb000039d0 0x7fcb00003da0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c0019e0 tx=0x7fcb0c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.301+0000 7fcb20400640 1 -- 172.21.15.45:0/199681402 shutdown_connections 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.301+0000 7fcb20400640 1 --2- 172.21.15.45:0/199681402 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb000039d0 0x7fcb00003da0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.301+0000 7fcb20400640 1 -- 172.21.15.45:0/199681402 >> 172.21.15.45:0/199681402 conn(0x7fcb18096a70 msgr2=0x7fcb18096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.302+0000 7fcb20400640 1 -- 172.21.15.45:0/199681402 shutdown_connections 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.302+0000 7fcb20400640 1 -- 172.21.15.45:0/199681402 wait complete. 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.303+0000 7fcb20400640 1 Processor -- start 2024-08-17T02:25:44.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.303+0000 7fcb20400640 1 -- start start 2024-08-17T02:25:44.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.304+0000 7fcb20400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb000039d0 0x7fcb180ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.304+0000 7fcb20400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb181549d0 0x7fcb180b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.304+0000 7fcb20400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb18154de0 0x7fcb180b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.304+0000 7fcb20400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180cc6f0 con 0x7fcb000039d0 2024-08-17T02:25:44.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.304+0000 7fcb20400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180cbae0 con 0x7fcb18154de0 2024-08-17T02:25:44.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.304+0000 7fcb20400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb180cbdc0 con 0x7fcb181549d0 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.304+0000 7fcb1da00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb000039d0 0x7fcb180ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.304+0000 7fcb1da00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb000039d0 0x7fcb180ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47016/0 (socket says 172.21.15.45:47016) 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.304+0000 7fcb1da00640 1 -- 172.21.15.45:0/2875396071 learned_addr learned my addr 172.21.15.45:0/2875396071 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.304+0000 7fcb1d000640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb181549d0 0x7fcb180b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.304+0000 7fcb1e400640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb18154de0 0x7fcb180b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.305+0000 7fcb1da00640 1 -- 172.21.15.45:0/2875396071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb181549d0 msgr2=0x7fcb180b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.305+0000 7fcb1da00640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb181549d0 0x7fcb180b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.305+0000 7fcb1da00640 1 -- 172.21.15.45:0/2875396071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb18154de0 msgr2=0x7fcb180b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.305+0000 7fcb1da00640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb18154de0 0x7fcb180b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.305+0000 7fcb1da00640 1 -- 172.21.15.45:0/2875396071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb180cc0a0 con 0x7fcb000039d0 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.305+0000 7fcb1da00640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb000039d0 0x7fcb180ccb80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c02a660 tx=0x7fcb0c003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.305+0000 7fcb14c00640 1 -- 172.21.15.45:0/2875396071 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c040070 con 0x7fcb000039d0 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.305+0000 7fcb14c00640 1 -- 172.21.15.45:0/2875396071 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0c0073f0 con 0x7fcb000039d0 2024-08-17T02:25:44.307 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.305+0000 7fcb20400640 1 -- 172.21.15.45:0/2875396071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb180cc380 con 0x7fcb000039d0 2024-08-17T02:25:44.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.305+0000 7fcb14c00640 1 -- 172.21.15.45:0/2875396071 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c006790 con 0x7fcb000039d0 2024-08-17T02:25:44.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.305+0000 7fcb20400640 1 -- 172.21.15.45:0/2875396071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb180cd0c0 con 0x7fcb000039d0 2024-08-17T02:25:44.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.306+0000 7fcb20400640 1 -- 172.21.15.45:0/2875396071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb18064db0 con 0x7fcb000039d0 2024-08-17T02:25:44.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.307+0000 7fcb14c00640 1 -- 172.21.15.45:0/2875396071 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcb0c006bc0 con 0x7fcb000039d0 2024-08-17T02:25:44.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.308+0000 7fcb14c00640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcaf8065150 0x7fcaf8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.308+0000 7fcb14c00640 1 -- 172.21.15.45:0/2875396071 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb0c0a21d0 con 0x7fcb000039d0 2024-08-17T02:25:44.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.308+0000 7fcb1d000640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcaf8065150 0x7fcaf8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.309+0000 7fcb1d000640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcaf8065150 0x7fcaf8067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcb04001730 tx=0x7fcb04007940 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.312+0000 7fcb14c00640 1 -- 172.21.15.45:0/2875396071 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcb0c0701f0 con 0x7fcb000039d0 2024-08-17T02:25:44.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.497+0000 7fcb20400640 1 -- 172.21.15.45:0/2875396071 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb18064db0 con 0x7fcb000039d0 2024-08-17T02:25:44.499 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.498+0000 7fcb14c00640 1 -- 172.21.15.45:0/2875396071 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fcb0c073810 con 0x7fcb000039d0 2024-08-17T02:25:44.499 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:44.499 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.500+0000 7fcb20400640 1 -- 172.21.15.45:0/2875396071 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcaf8065150 msgr2=0x7fcaf8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.500+0000 7fcb20400640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcaf8065150 0x7fcaf8067600 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fcb04001730 tx=0x7fcb04007940 comp rx=0 tx=0).stop 2024-08-17T02:25:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.500+0000 7fcb20400640 1 -- 172.21.15.45:0/2875396071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb000039d0 msgr2=0x7fcb180ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.500+0000 7fcb20400640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb000039d0 0x7fcb180ccb80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c02a660 tx=0x7fcb0c003000 comp rx=0 tx=0).stop 2024-08-17T02:25:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.501+0000 7fcb20400640 1 -- 172.21.15.45:0/2875396071 shutdown_connections 2024-08-17T02:25:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.501+0000 7fcb20400640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcb18154de0 0x7fcb180b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.501+0000 7fcb20400640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcaf8065150 0x7fcaf8067600 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.501+0000 7fcb20400640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcb181549d0 0x7fcb180b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.501+0000 7fcb20400640 1 --2- 172.21.15.45:0/2875396071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb000039d0 0x7fcb180ccb80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.502 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.501+0000 7fcb20400640 1 -- 172.21.15.45:0/2875396071 >> 172.21.15.45:0/2875396071 conn(0x7fcb18096a70 msgr2=0x7fcb180ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.501+0000 7fcb20400640 1 -- 172.21.15.45:0/2875396071 shutdown_connections 2024-08-17T02:25:44.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.501+0000 7fcb20400640 1 -- 172.21.15.45:0/2875396071 wait complete. 2024-08-17T02:25:44.517 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:12.166249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:13.072271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:44.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:44.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.671+0000 7fb583a00640 1 Processor -- start 2024-08-17T02:25:44.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.671+0000 7fb583a00640 1 -- start start 2024-08-17T02:25:44.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.672+0000 7fb583a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb57c157e10 0x7fb57c0b0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.672+0000 7fb583a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb57c0adec0 0x7fb57c15a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.672+0000 7fb583a00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c157070 con 0x7fb57c0b0a80 2024-08-17T02:25:44.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.672+0000 7fb583a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c0b1390 con 0x7fb57c0adec0 2024-08-17T02:25:44.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.672+0000 7fb583a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c15b410 con 0x7fb57c157e10 2024-08-17T02:25:44.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.672+0000 7fb581a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb57c0adec0 0x7fb57c15a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.672+0000 7fb581a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb57c0adec0 0x7fb57c15a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47024/0 (socket says 172.21.15.45:47024) 2024-08-17T02:25:44.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.672+0000 7fb581a00640 1 -- 172.21.15.45:0/2080574130 learned_addr learned my addr 172.21.15.45:0/2080574130 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:44.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.672+0000 7fb57be00640 1 --2- 172.21.15.45:0/2080574130 >> v2:172.21.15.169:3300/0 conn(0x7fb57c157e10 0x7fb57c0b0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.673+0000 7fb581a00640 1 -- 172.21.15.45:0/2080574130 >> v2:172.21.15.169:3300/0 conn(0x7fb57c157e10 msgr2=0x7fb57c0b0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.673+0000 7fb581a00640 1 --2- 172.21.15.45:0/2080574130 >> v2:172.21.15.169:3300/0 conn(0x7fb57c157e10 0x7fb57c0b0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.673+0000 7fb581a00640 1 -- 172.21.15.45:0/2080574130 >> v1:172.21.15.169:6789/0 conn(0x7fb57c0b0a80 legacy=0x7fb57c0ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.673+0000 7fb581a00640 1 -- 172.21.15.45:0/2080574130 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c157330 con 0x7fb57c0adec0 2024-08-17T02:25:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.673+0000 7fb57be00640 1 --2- 172.21.15.45:0/2080574130 >> v2:172.21.15.169:3300/0 conn(0x7fb57c157e10 0x7fb57c0b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.674+0000 7fb581a00640 1 --2- 172.21.15.45:0/2080574130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb57c0adec0 0x7fb57c15a6e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb57c06c1b0 tx=0x7fb574009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c63a24ef0dd1fac server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.674+0000 7fb57b400640 1 -- 172.21.15.45:0/2080574130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574031400 con 0x7fb57c0adec0 2024-08-17T02:25:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.674+0000 7fb57b400640 1 -- 172.21.15.45:0/2080574130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57402d050 con 0x7fb57c0adec0 2024-08-17T02:25:44.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.674+0000 7fb57b400640 1 -- 172.21.15.45:0/2080574130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740317d0 con 0x7fb57c0adec0 2024-08-17T02:25:44.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.675+0000 7fb583a00640 1 -- 172.21.15.45:0/2080574130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb57c0adec0 msgr2=0x7fb57c15a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.675+0000 7fb583a00640 1 --2- 172.21.15.45:0/2080574130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb57c0adec0 0x7fb57c15a6e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb57c06c1b0 tx=0x7fb574009840 comp rx=0 tx=0).stop 2024-08-17T02:25:44.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.675+0000 7fb583a00640 1 -- 172.21.15.45:0/2080574130 shutdown_connections 2024-08-17T02:25:44.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.675+0000 7fb583a00640 1 --2- 172.21.15.45:0/2080574130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb57c0adec0 0x7fb57c15a6e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.675+0000 7fb583a00640 1 --2- 172.21.15.45:0/2080574130 >> v2:172.21.15.169:3300/0 conn(0x7fb57c157e10 0x7fb57c0b0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.675+0000 7fb583a00640 1 -- 172.21.15.45:0/2080574130 >> 172.21.15.45:0/2080574130 conn(0x7fb57c067750 msgr2=0x7fb57c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.675+0000 7fb583a00640 1 -- 172.21.15.45:0/2080574130 shutdown_connections 2024-08-17T02:25:44.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.675+0000 7fb583a00640 1 -- 172.21.15.45:0/2080574130 wait complete. 2024-08-17T02:25:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.676+0000 7fb583a00640 1 Processor -- start 2024-08-17T02:25:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.676+0000 7fb583a00640 1 -- start start 2024-08-17T02:25:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.677+0000 7fb583a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb57c0adec0 0x7fb57c0ac4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.677+0000 7fb583a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb57c0b0a80 0x7fb57c0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.677+0000 7fb583a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb57c157e10 0x7fb57c0ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.677+0000 7fb583a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c13dc70 con 0x7fb57c0b0a80 2024-08-17T02:25:44.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.677+0000 7fb583a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0aca10 con 0x7fb57c0adec0 2024-08-17T02:25:44.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.677+0000 7fb583a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0aaf90 con 0x7fb57c157e10 2024-08-17T02:25:44.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.677+0000 7fb57be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb57c0b0a80 0x7fb57c0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.677+0000 7fb57be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb57c0b0a80 0x7fb57c0a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47028/0 (socket says 172.21.15.45:47028) 2024-08-17T02:25:44.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.677+0000 7fb57be00640 1 -- 172.21.15.45:0/1202727633 learned_addr learned my addr 172.21.15.45:0/1202727633 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:44.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.678+0000 7fb581000640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb57c0adec0 0x7fb57c0ac4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.678+0000 7fb581a00640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb57c157e10 0x7fb57c0ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.678+0000 7fb57be00640 1 -- 172.21.15.45:0/1202727633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb57c157e10 msgr2=0x7fb57c0ab420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.678+0000 7fb57be00640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb57c157e10 0x7fb57c0ab420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.678+0000 7fb57be00640 1 -- 172.21.15.45:0/1202727633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb57c0adec0 msgr2=0x7fb57c0ac4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.678+0000 7fb57be00640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb57c0adec0 0x7fb57c0ac4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.678+0000 7fb57be00640 1 -- 172.21.15.45:0/1202727633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574009ae0 con 0x7fb57c0b0a80 2024-08-17T02:25:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.678+0000 7fb581000640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb57c0adec0 0x7fb57c0ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.678+0000 7fb57be00640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb57c0b0a80 0x7fb57c0a98e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb56800d890 tx=0x7fb568008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.679+0000 7fb56fe00640 1 -- 172.21.15.45:0/1202727633 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800de80 con 0x7fb57c0b0a80 2024-08-17T02:25:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.679+0000 7fb56fe00640 1 -- 172.21.15.45:0/1202727633 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56800b870 con 0x7fb57c0b0a80 2024-08-17T02:25:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.679+0000 7fb56fe00640 1 -- 172.21.15.45:0/1202727633 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800bc30 con 0x7fb57c0b0a80 2024-08-17T02:25:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.679+0000 7fb583a00640 1 -- 172.21.15.45:0/1202727633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c0aa380 con 0x7fb57c0b0a80 2024-08-17T02:25:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.679+0000 7fb583a00640 1 -- 172.21.15.45:0/1202727633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c0aa940 con 0x7fb57c0b0a80 2024-08-17T02:25:44.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.680+0000 7fb583a00640 1 -- 172.21.15.45:0/1202727633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c064db0 con 0x7fb57c0b0a80 2024-08-17T02:25:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.681+0000 7fb56fe00640 1 -- 172.21.15.45:0/1202727633 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb56801e460 con 0x7fb57c0b0a80 2024-08-17T02:25:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.681+0000 7fb56fe00640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb55c065150 0x7fb55c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.681+0000 7fb56fe00640 1 -- 172.21.15.45:0/1202727633 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb568082ab0 con 0x7fb57c0b0a80 2024-08-17T02:25:44.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.682+0000 7fb581000640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb55c065150 0x7fb55c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:44.683 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.682+0000 7fb581000640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb55c065150 0x7fb55c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb570001820 tx=0x7fb570009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:44.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.685+0000 7fb56fe00640 1 -- 172.21.15.45:0/1202727633 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb568050ad0 con 0x7fb57c0b0a80 2024-08-17T02:25:44.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.871+0000 7fb583a00640 1 -- 172.21.15.45:0/1202727633 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb57c0c8620 con 0x7fb57c0b0a80 2024-08-17T02:25:44.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.872+0000 7fb56fe00640 1 -- 172.21.15.45:0/1202727633 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5680540f0 con 0x7fb57c0b0a80 2024-08-17T02:25:44.873 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:25:44.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.874+0000 7fb583a00640 1 -- 172.21.15.45:0/1202727633 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb55c065150 msgr2=0x7fb55c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.874+0000 7fb583a00640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb55c065150 0x7fb55c067600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb570001820 tx=0x7fb570009040 comp rx=0 tx=0).stop 2024-08-17T02:25:44.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.874+0000 7fb583a00640 1 -- 172.21.15.45:0/1202727633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb57c0b0a80 msgr2=0x7fb57c0a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:44.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.874+0000 7fb583a00640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb57c0b0a80 0x7fb57c0a98e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb56800d890 tx=0x7fb568008040 comp rx=0 tx=0).stop 2024-08-17T02:25:44.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.874+0000 7fb583a00640 1 -- 172.21.15.45:0/1202727633 shutdown_connections 2024-08-17T02:25:44.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.874+0000 7fb583a00640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb55c065150 0x7fb55c067600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.874+0000 7fb583a00640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb57c157e10 0x7fb57c0ab420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.874+0000 7fb583a00640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb57c0b0a80 0x7fb57c0a98e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.874+0000 7fb583a00640 1 --2- 172.21.15.45:0/1202727633 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb57c0adec0 0x7fb57c0ac4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:44.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.874+0000 7fb583a00640 1 -- 172.21.15.45:0/1202727633 >> 172.21.15.45:0/1202727633 conn(0x7fb57c067750 msgr2=0x7fb57c0cb940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:44.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.874+0000 7fb583a00640 1 -- 172.21.15.45:0/1202727633 shutdown_connections 2024-08-17T02:25:44.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:44.875+0000 7fb583a00640 1 -- 172.21.15.45:0/1202727633 wait complete. 2024-08-17T02:25:44.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.047+0000 7f0a7be00640 1 Processor -- start 2024-08-17T02:25:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.047+0000 7f0a7be00640 1 -- start start 2024-08-17T02:25:45.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.048+0000 7f0a7be00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0a741590b0 0x7f0a740c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.048+0000 7f0a7be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a740c9110 0x7f0a740aee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.048+0000 7f0a7be00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a7406d790 con 0x7f0a74158ce0 2024-08-17T02:25:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.048+0000 7f0a7be00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a740c9550 con 0x7f0a741590b0 2024-08-17T02:25:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.048+0000 7f0a7be00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7406cb80 con 0x7f0a740c9110 2024-08-17T02:25:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.048+0000 7f0a79400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0a74158ce0 0x7f0a7406a1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46336/0 (socket says 172.21.15.45:46336) 2024-08-17T02:25:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.048+0000 7f0a79400640 1 -- 172.21.15.45:0/3920033481 learned_addr learned my addr 172.21.15.45:0/3920033481 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a78a00640 1 --2- 172.21.15.45:0/3920033481 >> v2:172.21.15.169:3300/0 conn(0x7f0a741590b0 0x7f0a740c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a79e00640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a740c9110 0x7f0a740aee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10807513 0 0) 0x7f0a7406d790 con 0x7f0a74158ce0 2024-08-17T02:25:45.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a5c0034e0 con 0x7f0a74158ce0 2024-08-17T02:25:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2670032807 0 0) 0x7f0a5c0034e0 con 0x7f0a74158ce0 2024-08-17T02:25:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a740c9110 msgr2=0x7f0a740aee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a740c9110 0x7f0a740aee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 >> v2:172.21.15.169:3300/0 conn(0x7f0a741590b0 msgr2=0x7f0a740c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 --2- 172.21.15.45:0/3920033481 >> v2:172.21.15.169:3300/0 conn(0x7f0a741590b0 0x7f0a740c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7406ce60 con 0x7f0a74158ce0 2024-08-17T02:25:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7f0a68001470 con 0x7f0a74158ce0 2024-08-17T02:25:45.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a78a00640 1 --2- 172.21.15.45:0/3920033481 >> v2:172.21.15.169:3300/0 conn(0x7f0a741590b0 0x7f0a740c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 >> v1:172.21.15.45:6789/0 conn(0x7f0a74158ce0 legacy=0x7f0a7406a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a5c0039d0 0x7f0a5c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a5c004780 0x7f0a5c004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a5c005130 0x7f0a5c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a740c9550 con 0x7f0a5c004780 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a7406cb80 con 0x7f0a5c005130 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.049+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5c00bf10 con 0x7f0a5c0039d0 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.050+0000 7f0a78a00640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a5c004780 0x7f0a5c004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.050+0000 7f0a79400640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a5c0039d0 0x7f0a5c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.050+0000 7f0a79e00640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a5c005130 0x7f0a5c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.050+0000 7f0a78a00640 1 -- 172.21.15.45:0/3920033481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a5c0039d0 msgr2=0x7f0a5c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.050+0000 7f0a78a00640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a5c0039d0 0x7f0a5c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.053 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.050+0000 7f0a78a00640 1 -- 172.21.15.45:0/3920033481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a5c005130 msgr2=0x7f0a5c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.050+0000 7f0a78a00640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a5c005130 0x7f0a5c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.050+0000 7f0a78a00640 1 -- 172.21.15.45:0/3920033481 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5c0034e0 con 0x7f0a5c004780 2024-08-17T02:25:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.051+0000 7f0a78a00640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a5c004780 0x7f0a5c004bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009d60 tx=0x7f0a600090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=434104c2b63c334e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.051+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60031400 con 0x7f0a5c004780 2024-08-17T02:25:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.051+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6002d050 con 0x7f0a5c004780 2024-08-17T02:25:45.054 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.051+0000 7f0a73e00640 1 -- 172.21.15.45:0/3920033481 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60031770 con 0x7f0a5c004780 2024-08-17T02:25:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.052+0000 7f0a7be00640 1 -- 172.21.15.45:0/3920033481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a5c004780 msgr2=0x7f0a5c004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.052+0000 7f0a7be00640 1 --2- 172.21.15.45:0/3920033481 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a5c004780 0x7f0a5c004bf0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009d60 tx=0x7f0a600090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.052+0000 7f0a79e00640 1 -- 172.21.15.45:0/3920033481 reap_dead start 2024-08-17T02:25:45.057 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.052+0000 7f0a7be00640 1 -- 172.21.15.45:0/3920033481 shutdown_connections 2024-08-17T02:25:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.052+0000 7f0a7be00640 1 -- 172.21.15.45:0/3920033481 >> 172.21.15.45:0/3920033481 conn(0x7f0a74067750 msgr2=0x7f0a740c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.052+0000 7f0a7be00640 1 -- 172.21.15.45:0/3920033481 shutdown_connections 2024-08-17T02:25:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.052+0000 7f0a7be00640 1 -- 172.21.15.45:0/3920033481 wait complete. 2024-08-17T02:25:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.054+0000 7f0a7be00640 1 Processor -- start 2024-08-17T02:25:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.054+0000 7f0a7be00640 1 -- start start 2024-08-17T02:25:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a7be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a5c004780 0x7f0a7414c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a7be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a7416a2f0 0x7f0a7415e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a7be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7416a760 0x7f0a7415ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a7be00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74158150 con 0x7f0a7416a2f0 2024-08-17T02:25:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a7be00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74156440 con 0x7f0a5c004780 2024-08-17T02:25:45.058 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a7be00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74155830 con 0x7f0a7416a760 2024-08-17T02:25:45.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a78a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a7416a2f0 0x7f0a7415e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a78a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a7416a2f0 0x7f0a7415e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47040/0 (socket says 172.21.15.45:47040) 2024-08-17T02:25:45.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a78a00640 1 -- 172.21.15.45:0/867371597 learned_addr learned my addr 172.21.15.45:0/867371597 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:45.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a79400640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a5c004780 0x7f0a7414c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a78a00640 1 -- 172.21.15.45:0/867371597 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7416a760 msgr2=0x7f0a7415ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a79e00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7416a760 0x7f0a7415ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a78a00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7416a760 0x7f0a7415ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a78a00640 1 -- 172.21.15.45:0/867371597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a5c004780 msgr2=0x7f0a7414c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a78a00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a5c004780 0x7f0a7414c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.059 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a78a00640 1 -- 172.21.15.45:0/867371597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a74155b10 con 0x7f0a7416a2f0 2024-08-17T02:25:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a79400640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a5c004780 0x7f0a7414c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.055+0000 7f0a79e00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7416a760 0x7f0a7415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.056+0000 7f0a78a00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a7416a2f0 0x7f0a7415e590 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009d60 tx=0x7f0a60035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.056+0000 7f0a70c00640 1 -- 172.21.15.45:0/867371597 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6003c700 con 0x7f0a7416a2f0 2024-08-17T02:25:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.056+0000 7f0a70c00640 1 -- 172.21.15.45:0/867371597 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a6003c860 con 0x7f0a7416a2f0 2024-08-17T02:25:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.056+0000 7f0a70c00640 1 -- 172.21.15.45:0/867371597 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6003cc00 con 0x7f0a7416a2f0 2024-08-17T02:25:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.056+0000 7f0a7be00640 1 -- 172.21.15.45:0/867371597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a74155df0 con 0x7f0a7416a2f0 2024-08-17T02:25:45.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.056+0000 7f0a7be00640 1 -- 172.21.15.45:0/867371597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a741554c0 con 0x7f0a7416a2f0 2024-08-17T02:25:45.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.057+0000 7f0a7be00640 1 -- 172.21.15.45:0/867371597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a74071050 con 0x7f0a7416a2f0 2024-08-17T02:25:45.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.058+0000 7f0a70c00640 1 -- 172.21.15.45:0/867371597 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0a60030420 con 0x7f0a7416a2f0 2024-08-17T02:25:45.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.059+0000 7f0a70c00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0a54065150 0x7f0a54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.059+0000 7f0a70c00640 1 -- 172.21.15.45:0/867371597 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a600a37b0 con 0x7f0a7416a2f0 2024-08-17T02:25:45.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.059+0000 7f0a79400640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0a54065150 0x7f0a54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.060+0000 7f0a79400640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0a54065150 0x7f0a54067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a68001d20 tx=0x7f0a68009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.063+0000 7f0a70c00640 1 -- 172.21.15.45:0/867371597 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0a600717d0 con 0x7f0a7416a2f0 2024-08-17T02:25:45.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.243+0000 7f0a7be00640 1 -- 172.21.15.45:0/867371597 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a74156580 con 0x7f0a7416a2f0 2024-08-17T02:25:45.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.244+0000 7f0a70c00640 1 -- 172.21.15.45:0/867371597 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0a60074df0 con 0x7f0a7416a2f0 2024-08-17T02:25:45.245 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:25:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 -- 172.21.15.45:0/867371597 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0a54065150 msgr2=0x7f0a54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0a54065150 0x7f0a54067600 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0a68001d20 tx=0x7f0a68009040 comp rx=0 tx=0).stop 2024-08-17T02:25:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 -- 172.21.15.45:0/867371597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a7416a2f0 msgr2=0x7f0a7415e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a7416a2f0 0x7f0a7415e590 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009d60 tx=0x7f0a60035000 comp rx=0 tx=0).stop 2024-08-17T02:25:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 -- 172.21.15.45:0/867371597 shutdown_connections 2024-08-17T02:25:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0a54065150 0x7f0a54067600 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0a7416a760 0x7f0a7415ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a7416a2f0 0x7f0a7415e590 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 --2- 172.21.15.45:0/867371597 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0a5c004780 0x7f0a7414c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 -- 172.21.15.45:0/867371597 >> 172.21.15.45:0/867371597 conn(0x7f0a74067750 msgr2=0x7f0a740b06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 -- 172.21.15.45:0/867371597 shutdown_connections 2024-08-17T02:25:45.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.246+0000 7f0a7be00640 1 -- 172.21.15.45:0/867371597 wait complete. 2024-08-17T02:25:45.262 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:45.417 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.417+0000 7f9c8fe00640 1 Processor -- start 2024-08-17T02:25:45.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.417+0000 7f9c8fe00640 1 -- start start 2024-08-17T02:25:45.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.418+0000 7f9c8fe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 0x7f9c90069600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.418+0000 7f9c8fe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9c900aeb60 0x7f9c900aef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.418+0000 7f9c8fe00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c900ae3a0 con 0x7f9c90096e70 2024-08-17T02:25:45.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.418+0000 7f9c8fe00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c900ad010 con 0x7f9c900aeb60 2024-08-17T02:25:45.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.418+0000 7f9c8fe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c900ac770 con 0x7f9c90069230 2024-08-17T02:25:45.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.419+0000 7f9c8ea00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 0x7f9c90069600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.419+0000 7f9c8f400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f9c900aeb60 0x7f9c900aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.419+0000 7f9c8ea00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 0x7f9c90069600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:41194/0 (socket says 172.21.15.45:41194) 2024-08-17T02:25:45.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.419+0000 7f9c8ea00640 1 -- 172.21.15.45:0/99811243 learned_addr learned my addr 172.21.15.45:0/99811243 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:45.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.419+0000 7f9c87e00640 1 --1- 172.21.15.45:0/99811243 >> v1:172.21.15.169:6789/0 conn(0x7f9c90096e70 0x7f9c900abfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:44634/0 (socket says 172.21.15.45:44634) 2024-08-17T02:25:45.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.419+0000 7f9c8ea00640 1 -- 172.21.15.45:0/99811243 >> v2:172.21.15.169:3300/0 conn(0x7f9c900aeb60 msgr2=0x7f9c900aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.419+0000 7f9c8ea00640 1 --2- 172.21.15.45:0/99811243 >> v2:172.21.15.169:3300/0 conn(0x7f9c900aeb60 0x7f9c900aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.419+0000 7f9c8ea00640 1 -- 172.21.15.45:0/99811243 >> v1:172.21.15.169:6789/0 conn(0x7f9c90096e70 legacy=0x7f9c900abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.419+0000 7f9c8ea00640 1 -- 172.21.15.45:0/99811243 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c900aca50 con 0x7f9c90069230 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.420+0000 7f9c8ea00640 1 --2- 172.21.15.45:0/99811243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 0x7f9c90069600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009910 tx=0x7f9c800091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=facf4ed3954718b0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.420+0000 7f9c8e000640 1 -- 172.21.15.45:0/99811243 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8002ad20 con 0x7f9c90069230 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.420+0000 7f9c8e000640 1 -- 172.21.15.45:0/99811243 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8002ae80 con 0x7f9c90069230 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.420+0000 7f9c8e000640 1 -- 172.21.15.45:0/99811243 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80032670 con 0x7f9c90069230 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.421+0000 7f9c8fe00640 1 -- 172.21.15.45:0/99811243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 msgr2=0x7f9c90069600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.421+0000 7f9c8fe00640 1 --2- 172.21.15.45:0/99811243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 0x7f9c90069600 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009910 tx=0x7f9c800091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.421+0000 7f9c8fe00640 1 -- 172.21.15.45:0/99811243 shutdown_connections 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.421+0000 7f9c8fe00640 1 --2- 172.21.15.45:0/99811243 >> v2:172.21.15.169:3300/0 conn(0x7f9c900aeb60 0x7f9c900aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.421+0000 7f9c8fe00640 1 --2- 172.21.15.45:0/99811243 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 0x7f9c90069600 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.421+0000 7f9c8fe00640 1 -- 172.21.15.45:0/99811243 >> 172.21.15.45:0/99811243 conn(0x7f9c90096a70 msgr2=0x7f9c900cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.421+0000 7f9c8fe00640 1 -- 172.21.15.45:0/99811243 shutdown_connections 2024-08-17T02:25:45.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.421+0000 7f9c8fe00640 1 -- 172.21.15.45:0/99811243 wait complete. 2024-08-17T02:25:45.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.422+0000 7f9c8fe00640 1 Processor -- start 2024-08-17T02:25:45.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.423+0000 7f9c8fe00640 1 -- start start 2024-08-17T02:25:45.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.423+0000 7f9c8fe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 0x7f9c900cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.423+0000 7f9c8fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c90096e70 0x7f9c90099ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.423+0000 7f9c8fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c900aeb60 0x7f9c9009a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.423+0000 7f9c8fe00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c900cc930 con 0x7f9c90096e70 2024-08-17T02:25:45.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.423+0000 7f9c8fe00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90149340 con 0x7f9c900aeb60 2024-08-17T02:25:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.423+0000 7f9c8fe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c90149620 con 0x7f9c90069230 2024-08-17T02:25:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c87e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c90096e70 0x7f9c90099ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c87e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c90096e70 0x7f9c90099ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47042/0 (socket says 172.21.15.45:47042) 2024-08-17T02:25:45.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c87e00640 1 -- 172.21.15.45:0/1963854719 learned_addr learned my addr 172.21.15.45:0/1963854719 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c8ea00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 0x7f9c900cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c8f400640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c900aeb60 0x7f9c9009a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c87e00640 1 -- 172.21.15.45:0/1963854719 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 msgr2=0x7f9c900cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c87e00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 0x7f9c900cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c87e00640 1 -- 172.21.15.45:0/1963854719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c900aeb60 msgr2=0x7f9c9009a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c87e00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c900aeb60 0x7f9c9009a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c87e00640 1 -- 172.21.15.45:0/1963854719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80009450 con 0x7f9c90096e70 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c8f400640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c900aeb60 0x7f9c9009a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.424+0000 7f9c87e00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c90096e70 0x7f9c90099ef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800c590 tx=0x7f9c78007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.425+0000 7f9c86000640 1 -- 172.21.15.45:0/1963854719 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78007300 con 0x7f9c90096e70 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.425+0000 7f9c86000640 1 -- 172.21.15.45:0/1963854719 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c780074a0 con 0x7f9c90096e70 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.425+0000 7f9c86000640 1 -- 172.21.15.45:0/1963854719 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780047a0 con 0x7f9c90096e70 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.425+0000 7f9c8fe00640 1 -- 172.21.15.45:0/1963854719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c90149900 con 0x7f9c90096e70 2024-08-17T02:25:45.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.425+0000 7f9c8fe00640 1 -- 172.21.15.45:0/1963854719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c90149ec0 con 0x7f9c90096e70 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.426+0000 7f9c8fe00640 1 -- 172.21.15.45:0/1963854719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c90071050 con 0x7f9c90096e70 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.427+0000 7f9c86000640 1 -- 172.21.15.45:0/1963854719 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9c78004bd0 con 0x7f9c90096e70 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.427+0000 7f9c86000640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9c6c065150 0x7f9c6c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.428+0000 7f9c86000640 1 -- 172.21.15.45:0/1963854719 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9c78081430 con 0x7f9c90096e70 2024-08-17T02:25:45.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.428+0000 7f9c8ea00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9c6c065150 0x7f9c6c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.428+0000 7f9c8ea00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9c6c065150 0x7f9c6c067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c80034000 tx=0x7f9c80032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.431+0000 7f9c86000640 1 -- 172.21.15.45:0/1963854719 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9c7804be40 con 0x7f9c90096e70 2024-08-17T02:25:45.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.617+0000 7f9c8fe00640 1 -- 172.21.15.45:0/1963854719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9c901536b0 con 0x7f9c90096e70 2024-08-17T02:25:45.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.618+0000 7f9c86000640 1 -- 172.21.15.45:0/1963854719 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9c7804f580 con 0x7f9c90096e70 2024-08-17T02:25:45.619 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-08-17T02:25:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 -- 172.21.15.45:0/1963854719 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9c6c065150 msgr2=0x7f9c6c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9c6c065150 0x7f9c6c067600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c80034000 tx=0x7f9c80032000 comp rx=0 tx=0).stop 2024-08-17T02:25:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 -- 172.21.15.45:0/1963854719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c90096e70 msgr2=0x7f9c90099ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c90096e70 0x7f9c90099ef0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9c7800c590 tx=0x7f9c78007ee0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 -- 172.21.15.45:0/1963854719 shutdown_connections 2024-08-17T02:25:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9c900aeb60 0x7f9c9009a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c90096e70 0x7f9c90099ef0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9c6c065150 0x7f9c6c067600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 --2- 172.21.15.45:0/1963854719 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9c90069230 0x7f9c900cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 -- 172.21.15.45:0/1963854719 >> 172.21.15.45:0/1963854719 conn(0x7f9c90096a70 msgr2=0x7f9c900afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 -- 172.21.15.45:0/1963854719 shutdown_connections 2024-08-17T02:25:45.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.620+0000 7f9c8fe00640 1 -- 172.21.15.45:0/1963854719 wait complete. 2024-08-17T02:25:45.636 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:45.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.789+0000 7f3615200640 1 Processor -- start 2024-08-17T02:25:45.790 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.789+0000 7f3615200640 1 -- start start 2024-08-17T02:25:45.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.790+0000 7f3615200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3610158cb0 0x7f36100af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.790+0000 7f3615200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36100aa910 0x7f36100ac110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.791 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.790+0000 7f3615200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f36100ac650 0x7f36100acad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.790+0000 7f3615200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36100abc80 con 0x7f36100aa910 2024-08-17T02:25:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.790+0000 7f3615200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36100ab070 con 0x7f36100ac650 2024-08-17T02:25:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.790+0000 7f3615200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36100ab350 con 0x7f3610158cb0 2024-08-17T02:25:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.790+0000 7f360d400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36100aa910 0x7f36100ac110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.791+0000 7f360d400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f36100aa910 0x7f36100ac110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47058/0 (socket says 172.21.15.45:47058) 2024-08-17T02:25:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.791+0000 7f360d400640 1 -- 172.21.15.45:0/3271231718 learned_addr learned my addr 172.21.15.45:0/3271231718 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.791+0000 7f360e800640 1 --2- 172.21.15.45:0/3271231718 >> v2:172.21.15.169:3300/0 conn(0x7f36100ac650 0x7f36100acad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.792 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.791+0000 7f360de00640 1 --2- 172.21.15.45:0/3271231718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3610158cb0 0x7f36100af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.791+0000 7f360d400640 1 -- 172.21.15.45:0/3271231718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3610158cb0 msgr2=0x7f36100af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.791+0000 7f360d400640 1 --2- 172.21.15.45:0/3271231718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3610158cb0 0x7f36100af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.791+0000 7f360d400640 1 -- 172.21.15.45:0/3271231718 >> v2:172.21.15.169:3300/0 conn(0x7f36100ac650 msgr2=0x7f36100acad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.791+0000 7f360d400640 1 --2- 172.21.15.45:0/3271231718 >> v2:172.21.15.169:3300/0 conn(0x7f36100ac650 0x7f36100acad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.791+0000 7f360d400640 1 -- 172.21.15.45:0/3271231718 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100ab630 con 0x7f36100aa910 2024-08-17T02:25:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.791+0000 7f360e800640 1 --2- 172.21.15.45:0/3271231718 >> v2:172.21.15.169:3300/0 conn(0x7f36100ac650 0x7f36100acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:45.793 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.792+0000 7f360d400640 1 --2- 172.21.15.45:0/3271231718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36100aa910 0x7f36100ac110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f36100ad4b0 tx=0x7f35fc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926915ee989bc42a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.792+0000 7f360ca00640 1 -- 172.21.15.45:0/3271231718 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc02add0 con 0x7f36100aa910 2024-08-17T02:25:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.792+0000 7f360ca00640 1 -- 172.21.15.45:0/3271231718 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35fc032440 con 0x7f36100aa910 2024-08-17T02:25:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.792+0000 7f360ca00640 1 -- 172.21.15.45:0/3271231718 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35fc032820 con 0x7f36100aa910 2024-08-17T02:25:45.794 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.793+0000 7f3615200640 1 -- 172.21.15.45:0/3271231718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36100aa910 msgr2=0x7f36100ac110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.793+0000 7f3615200640 1 --2- 172.21.15.45:0/3271231718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36100aa910 0x7f36100ac110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f36100ad4b0 tx=0x7f35fc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.793+0000 7f3615200640 1 -- 172.21.15.45:0/3271231718 shutdown_connections 2024-08-17T02:25:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.793+0000 7f3615200640 1 --2- 172.21.15.45:0/3271231718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36100aa910 0x7f36100ac110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.793+0000 7f3615200640 1 --2- 172.21.15.45:0/3271231718 >> v2:172.21.15.169:3300/0 conn(0x7f36100ac650 0x7f36100acad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.793+0000 7f3615200640 1 --2- 172.21.15.45:0/3271231718 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3610158cb0 0x7f36100af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.793+0000 7f3615200640 1 -- 172.21.15.45:0/3271231718 >> 172.21.15.45:0/3271231718 conn(0x7f3610096a70 msgr2=0x7f3610096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.793+0000 7f3615200640 1 -- 172.21.15.45:0/3271231718 shutdown_connections 2024-08-17T02:25:45.795 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.793+0000 7f3615200640 1 -- 172.21.15.45:0/3271231718 wait complete. 2024-08-17T02:25:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.795+0000 7f3615200640 1 Processor -- start 2024-08-17T02:25:45.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.795+0000 7f3615200640 1 -- start start 2024-08-17T02:25:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f3615200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36100aa910 0x7f36101698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f3615200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36100ac650 0x7f3610098950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f3615200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3610158cb0 0x7f36100c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f3615200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3610169e20 con 0x7f36100aa910 2024-08-17T02:25:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f3615200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3610098e90 con 0x7f3610158cb0 2024-08-17T02:25:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f3615200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36100990c0 con 0x7f36100ac650 2024-08-17T02:25:45.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f360de00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36100aa910 0x7f36101698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f360de00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36100aa910 0x7f36101698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47070/0 (socket says 172.21.15.45:47070) 2024-08-17T02:25:45.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f360de00640 1 -- 172.21.15.45:0/4171150980 learned_addr learned my addr 172.21.15.45:0/4171150980 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:45.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f360d400640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36100ac650 0x7f3610098950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f360e800640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3610158cb0 0x7f36100c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f360de00640 1 -- 172.21.15.45:0/4171150980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36100ac650 msgr2=0x7f3610098950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f360de00640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36100ac650 0x7f3610098950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f360de00640 1 -- 172.21.15.45:0/4171150980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3610158cb0 msgr2=0x7f36100c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f360de00640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3610158cb0 0x7f36100c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.798 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.796+0000 7f360de00640 1 -- 172.21.15.45:0/4171150980 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc009450 con 0x7f36100aa910 2024-08-17T02:25:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.797+0000 7f360de00640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36100aa910 0x7f36101698e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f360000d890 tx=0x7f3600008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.798+0000 7f3605600640 1 -- 172.21.15.45:0/4171150980 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360000de20 con 0x7f36100aa910 2024-08-17T02:25:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.798+0000 7f3615200640 1 -- 172.21.15.45:0/4171150980 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36100993a0 con 0x7f36100aa910 2024-08-17T02:25:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.798+0000 7f3605600640 1 -- 172.21.15.45:0/4171150980 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36000098b0 con 0x7f36100aa910 2024-08-17T02:25:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.798+0000 7f3605600640 1 -- 172.21.15.45:0/4171150980 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3600009c50 con 0x7f36100aa910 2024-08-17T02:25:45.799 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.798+0000 7f3615200640 1 -- 172.21.15.45:0/4171150980 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3610099960 con 0x7f36100aa910 2024-08-17T02:25:45.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.799+0000 7f3615200640 1 -- 172.21.15.45:0/4171150980 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3610064db0 con 0x7f36100aa910 2024-08-17T02:25:45.800 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.800+0000 7f3605600640 1 -- 172.21.15.45:0/4171150980 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3600014410 con 0x7f36100aa910 2024-08-17T02:25:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.801+0000 7f3605600640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f35f0065150 0x7f35f0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.801+0000 7f3605600640 1 -- 172.21.15.45:0/4171150980 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3600082c80 con 0x7f36100aa910 2024-08-17T02:25:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.801+0000 7f360d400640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f35f0065150 0x7f35f0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:45.802 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.802+0000 7f360d400640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f35f0065150 0x7f35f0067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35fc034000 tx=0x7f35fc032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:45.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.805+0000 7f3605600640 1 -- 172.21.15.45:0/4171150980 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3600050ca0 con 0x7f36100aa910 2024-08-17T02:25:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.989+0000 7f3615200640 1 -- 172.21.15.45:0/4171150980 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f361006c840 con 0x7f36100aa910 2024-08-17T02:25:45.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.989+0000 7f3605600640 1 -- 172.21.15.45:0/4171150980 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f36000542c0 con 0x7f36100aa910 2024-08-17T02:25:45.990 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:45.991 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.991+0000 7f3615200640 1 -- 172.21.15.45:0/4171150980 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f35f0065150 msgr2=0x7f35f0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.991+0000 7f3615200640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f35f0065150 0x7f35f0067600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35fc034000 tx=0x7f35fc032000 comp rx=0 tx=0).stop 2024-08-17T02:25:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.991+0000 7f3615200640 1 -- 172.21.15.45:0/4171150980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36100aa910 msgr2=0x7f36101698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.991+0000 7f3615200640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36100aa910 0x7f36101698e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f360000d890 tx=0x7f3600008040 comp rx=0 tx=0).stop 2024-08-17T02:25:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.992+0000 7f3615200640 1 -- 172.21.15.45:0/4171150980 shutdown_connections 2024-08-17T02:25:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.992+0000 7f3615200640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3610158cb0 0x7f36100c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.992+0000 7f3615200640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f35f0065150 0x7f35f0067600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.992+0000 7f3615200640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f36100ac650 0x7f3610098950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.992+0000 7f3615200640 1 --2- 172.21.15.45:0/4171150980 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f36100aa910 0x7f36101698e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.992+0000 7f3615200640 1 -- 172.21.15.45:0/4171150980 >> 172.21.15.45:0/4171150980 conn(0x7f3610096a70 msgr2=0x7f36100ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:45.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.992+0000 7f3615200640 1 -- 172.21.15.45:0/4171150980 shutdown_connections 2024-08-17T02:25:45.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:45.992+0000 7f3615200640 1 -- 172.21.15.45:0/4171150980 wait complete. 2024-08-17T02:25:46.008 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:12.166249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:13.072271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:46.009 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.162+0000 7f29dec00640 1 Processor -- start 2024-08-17T02:25:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.162+0000 7f29dec00640 1 -- start start 2024-08-17T02:25:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.163+0000 7f29dec00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f29d80cc5f0 0x7f29d806d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.163+0000 7f29dec00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d80ac390 con 0x7f29d8158b90 2024-08-17T02:25:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.163+0000 7f29dec00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d80ab4a0 con 0x7f29d8158f60 2024-08-17T02:25:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.163+0000 7f29dec00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d80ab780 con 0x7f29d80cc5f0 2024-08-17T02:25:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.163+0000 7f29d7e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f29d8158b90 0x7f29d80aea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46340/0 (socket says 172.21.15.45:46340) 2024-08-17T02:25:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.163+0000 7f29d7e00640 1 -- 172.21.15.45:0/953209959 learned_addr learned my addr 172.21.15.45:0/953209959 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.164+0000 7f29dcc00640 1 --2- 172.21.15.45:0/953209959 >> v2:172.21.15.169:3300/0 conn(0x7f29d80cc5f0 0x7f29d806d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.164+0000 7f29d6a00640 1 -- 172.21.15.45:0/953209959 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 103199403 0 0) 0x7f29d80ac390 con 0x7f29d8158b90 2024-08-17T02:25:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.164+0000 7f29d6a00640 1 -- 172.21.15.45:0/953209959 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29bc0034e0 con 0x7f29d8158b90 2024-08-17T02:25:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.164+0000 7f29dcc00640 1 -- 172.21.15.45:0/953209959 >> v1:172.21.15.169:6789/0 conn(0x7f29d8158f60 legacy=0x7f29d80ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.164+0000 7f29dcc00640 1 -- 172.21.15.45:0/953209959 >> v1:172.21.15.45:6789/0 conn(0x7f29d8158b90 legacy=0x7f29d80aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.164+0000 7f29dcc00640 1 -- 172.21.15.45:0/953209959 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d80aba60 con 0x7f29d80cc5f0 2024-08-17T02:25:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.165+0000 7f29dcc00640 1 --2- 172.21.15.45:0/953209959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d80cc5f0 0x7f29d806d7b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009e60 tx=0x7f29d0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3070cc3bb946f6d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.165+0000 7f29d6a00640 1 -- 172.21.15.45:0/953209959 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d0007550 con 0x7f29d80cc5f0 2024-08-17T02:25:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.166+0000 7f29d6a00640 1 -- 172.21.15.45:0/953209959 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29d002d050 con 0x7f29d80cc5f0 2024-08-17T02:25:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.166+0000 7f29d6a00640 1 -- 172.21.15.45:0/953209959 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29d00078c0 con 0x7f29d80cc5f0 2024-08-17T02:25:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.166+0000 7f29dec00640 1 -- 172.21.15.45:0/953209959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d80cc5f0 msgr2=0x7f29d806d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.166+0000 7f29dec00640 1 --2- 172.21.15.45:0/953209959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d80cc5f0 0x7f29d806d7b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f29d0009e60 tx=0x7f29d0009780 comp rx=0 tx=0).stop 2024-08-17T02:25:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.166+0000 7f29dec00640 1 -- 172.21.15.45:0/953209959 shutdown_connections 2024-08-17T02:25:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.166+0000 7f29dec00640 1 --2- 172.21.15.45:0/953209959 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d80cc5f0 0x7f29d806d7b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.166+0000 7f29dec00640 1 -- 172.21.15.45:0/953209959 >> 172.21.15.45:0/953209959 conn(0x7f29d8067750 msgr2=0x7f29d80cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.166+0000 7f29dec00640 1 -- 172.21.15.45:0/953209959 shutdown_connections 2024-08-17T02:25:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.166+0000 7f29dec00640 1 -- 172.21.15.45:0/953209959 wait complete. 2024-08-17T02:25:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.168+0000 7f29dec00640 1 Processor -- start 2024-08-17T02:25:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.168+0000 7f29dec00640 1 -- start start 2024-08-17T02:25:46.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29dec00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d80cc5f0 0x7f29d8168ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29dec00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d8158b90 0x7f29d816ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29dec00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29d8158f60 0x7f29d816bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29dec00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8169410 con 0x7f29d80cc5f0 2024-08-17T02:25:46.170 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29dec00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d8155bc0 con 0x7f29d8158b90 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29dec00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d816d360 con 0x7f29d8158f60 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29d7e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d80cc5f0 0x7f29d8168ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29d7e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d80cc5f0 0x7f29d8168ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47078/0 (socket says 172.21.15.45:47078) 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29d7e00640 1 -- 172.21.15.45:0/2300933748 learned_addr learned my addr 172.21.15.45:0/2300933748 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29dcc00640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29d8158f60 0x7f29d816bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29d7400640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d8158b90 0x7f29d816ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29d7e00640 1 -- 172.21.15.45:0/2300933748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29d8158f60 msgr2=0x7f29d816bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29d7e00640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29d8158f60 0x7f29d816bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29d7e00640 1 -- 172.21.15.45:0/2300933748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d8158b90 msgr2=0x7f29d816ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29d7e00640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d8158b90 0x7f29d816ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.169+0000 7f29d7e00640 1 -- 172.21.15.45:0/2300933748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d0009a20 con 0x7f29d80cc5f0 2024-08-17T02:25:46.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.170+0000 7f29d7e00640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d80cc5f0 0x7f29d8168ed0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29c800c5b0 tx=0x7f29c8007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.170+0000 7f29cf400640 1 -- 172.21.15.45:0/2300933748 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8005aa0 con 0x7f29d80cc5f0 2024-08-17T02:25:46.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.170+0000 7f29cf400640 1 -- 172.21.15.45:0/2300933748 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c8005c00 con 0x7f29d80cc5f0 2024-08-17T02:25:46.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.170+0000 7f29cf400640 1 -- 172.21.15.45:0/2300933748 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c80070f0 con 0x7f29d80cc5f0 2024-08-17T02:25:46.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.170+0000 7f29dec00640 1 -- 172.21.15.45:0/2300933748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29d8154fb0 con 0x7f29d80cc5f0 2024-08-17T02:25:46.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.170+0000 7f29dec00640 1 -- 172.21.15.45:0/2300933748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d8155570 con 0x7f29d80cc5f0 2024-08-17T02:25:46.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.171+0000 7f29dec00640 1 -- 172.21.15.45:0/2300933748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d8064db0 con 0x7f29d80cc5f0 2024-08-17T02:25:46.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.172+0000 7f29cf400640 1 -- 172.21.15.45:0/2300933748 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f29c8007520 con 0x7f29d80cc5f0 2024-08-17T02:25:46.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.173+0000 7f29cf400640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f29b8065150 0x7f29b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.173+0000 7f29cf400640 1 -- 172.21.15.45:0/2300933748 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f29c8081f90 con 0x7f29d80cc5f0 2024-08-17T02:25:46.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.173+0000 7f29d7400640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f29b8065150 0x7f29b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.174+0000 7f29d7400640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f29b8065150 0x7f29b8067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f29d80ca1f0 tx=0x7f29c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.177+0000 7f29cf400640 1 -- 172.21.15.45:0/2300933748 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f29c8050030 con 0x7f29d80cc5f0 2024-08-17T02:25:46.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.357+0000 7f29dec00640 1 -- 172.21.15.45:0/2300933748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f29d816c1c0 con 0x7f29d80cc5f0 2024-08-17T02:25:46.358 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.357+0000 7f29cf400640 1 -- 172.21.15.45:0/2300933748 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f29c8053650 con 0x7f29d80cc5f0 2024-08-17T02:25:46.359 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:25:46.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.359+0000 7f29dec00640 1 -- 172.21.15.45:0/2300933748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f29b8065150 msgr2=0x7f29b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.359+0000 7f29dec00640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f29b8065150 0x7f29b8067600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f29d80ca1f0 tx=0x7f29c4009040 comp rx=0 tx=0).stop 2024-08-17T02:25:46.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.359+0000 7f29dec00640 1 -- 172.21.15.45:0/2300933748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d80cc5f0 msgr2=0x7f29d8168ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.359+0000 7f29dec00640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d80cc5f0 0x7f29d8168ed0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29c800c5b0 tx=0x7f29c8007d70 comp rx=0 tx=0).stop 2024-08-17T02:25:46.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.360+0000 7f29dec00640 1 -- 172.21.15.45:0/2300933748 shutdown_connections 2024-08-17T02:25:46.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.360+0000 7f29dec00640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f29b8065150 0x7f29b8067600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.360+0000 7f29dec00640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29d8158f60 0x7f29d816bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.360+0000 7f29dec00640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f29d8158b90 0x7f29d816ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.360+0000 7f29dec00640 1 --2- 172.21.15.45:0/2300933748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f29d80cc5f0 0x7f29d8168ed0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.360+0000 7f29dec00640 1 -- 172.21.15.45:0/2300933748 >> 172.21.15.45:0/2300933748 conn(0x7f29d8067750 msgr2=0x7f29d806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.360+0000 7f29dec00640 1 -- 172.21.15.45:0/2300933748 shutdown_connections 2024-08-17T02:25:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.360+0000 7f29dec00640 1 -- 172.21.15.45:0/2300933748 wait complete. 2024-08-17T02:25:46.375 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:46.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.528+0000 7f6446400640 1 Processor -- start 2024-08-17T02:25:46.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.529+0000 7f6446400640 1 -- start start 2024-08-17T02:25:46.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.530+0000 7f6446400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400abef0 0x7f64400accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.530+0000 7f6446400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f64400ad210 0x7f644006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.530+0000 7f6446400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6440156e60 con 0x7f644006d930 2024-08-17T02:25:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.530+0000 7f6446400640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64400c95e0 con 0x7f64400ad210 2024-08-17T02:25:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.530+0000 7f6446400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64400ad660 con 0x7f64400abef0 2024-08-17T02:25:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.530+0000 7f643fe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f64400ad210 0x7f644006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.530+0000 7f643fe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f64400ad210 0x7f644006d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47082/0 (socket says 172.21.15.45:47082) 2024-08-17T02:25:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.530+0000 7f643fe00640 1 -- 172.21.15.45:0/1975646672 learned_addr learned my addr 172.21.15.45:0/1975646672 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.530+0000 7f6445000640 1 --2- 172.21.15.45:0/1975646672 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400abef0 0x7f64400accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.531+0000 7f643fe00640 1 -- 172.21.15.45:0/1975646672 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400abef0 msgr2=0x7f64400accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.531+0000 7f643fe00640 1 --2- 172.21.15.45:0/1975646672 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400abef0 0x7f64400accd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.531+0000 7f643fe00640 1 -- 172.21.15.45:0/1975646672 >> v1:172.21.15.169:6789/0 conn(0x7f644006d930 legacy=0x7f644015a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.531+0000 7f643fe00640 1 -- 172.21.15.45:0/1975646672 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64400ac2c0 con 0x7f64400ad210 2024-08-17T02:25:46.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.531+0000 7f6445000640 1 --2- 172.21.15.45:0/1975646672 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400abef0 0x7f64400accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.532+0000 7f643fe00640 1 --2- 172.21.15.45:0/1975646672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64400ad210 0x7f644006d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f642c009910 tx=0x7f642c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466d99a7f150b167 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.532+0000 7f643f400640 1 -- 172.21.15.45:0/1975646672 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c02adb0 con 0x7f64400ad210 2024-08-17T02:25:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.532+0000 7f643f400640 1 -- 172.21.15.45:0/1975646672 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c032440 con 0x7f64400ad210 2024-08-17T02:25:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.532+0000 7f643f400640 1 -- 172.21.15.45:0/1975646672 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c032820 con 0x7f64400ad210 2024-08-17T02:25:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.532+0000 7f6446400640 1 -- 172.21.15.45:0/1975646672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64400ad210 msgr2=0x7f644006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.532+0000 7f6446400640 1 --2- 172.21.15.45:0/1975646672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64400ad210 0x7f644006d3f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f642c009910 tx=0x7f642c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.532+0000 7f6446400640 1 -- 172.21.15.45:0/1975646672 shutdown_connections 2024-08-17T02:25:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.533+0000 7f6446400640 1 --2- 172.21.15.45:0/1975646672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64400ad210 0x7f644006d3f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.533+0000 7f6446400640 1 --2- 172.21.15.45:0/1975646672 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400abef0 0x7f64400accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.533+0000 7f6446400640 1 -- 172.21.15.45:0/1975646672 >> 172.21.15.45:0/1975646672 conn(0x7f6440066cd0 msgr2=0x7f64400670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.533+0000 7f6446400640 1 -- 172.21.15.45:0/1975646672 shutdown_connections 2024-08-17T02:25:46.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.533+0000 7f6446400640 1 -- 172.21.15.45:0/1975646672 wait complete. 2024-08-17T02:25:46.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.534+0000 7f6446400640 1 Processor -- start 2024-08-17T02:25:46.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.534+0000 7f6446400640 1 -- start start 2024-08-17T02:25:46.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.535+0000 7f6446400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f644006d930 0x7f644014f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.535+0000 7f6446400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64400abef0 0x7f644014d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.535+0000 7f6446400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400ad210 0x7f644014dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.535+0000 7f6446400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6440153670 con 0x7f64400abef0 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.535+0000 7f6446400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64400af260 con 0x7f644006d930 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.535+0000 7f6446400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64400afde0 con 0x7f64400ad210 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.535+0000 7f643fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64400abef0 0x7f644014d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.535+0000 7f643fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64400abef0 0x7f644014d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47086/0 (socket says 172.21.15.45:47086) 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.535+0000 7f643fe00640 1 -- 172.21.15.45:0/4022857860 learned_addr learned my addr 172.21.15.45:0/4022857860 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f6445000640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f644006d930 0x7f644014f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f643fe00640 1 -- 172.21.15.45:0/4022857860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400ad210 msgr2=0x7f644014dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f6445a00640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400ad210 0x7f644014dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f643fe00640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400ad210 0x7f644014dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f643fe00640 1 -- 172.21.15.45:0/4022857860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f644006d930 msgr2=0x7f644014f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f643fe00640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f644006d930 0x7f644014f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f643fe00640 1 -- 172.21.15.45:0/4022857860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c009450 con 0x7f64400abef0 2024-08-17T02:25:46.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f6445a00640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400ad210 0x7f644014dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:46.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f643fe00640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64400abef0 0x7f644014d690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f642c009970 tx=0x7f642c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f6433e00640 1 -- 172.21.15.45:0/4022857860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c031de0 con 0x7f64400abef0 2024-08-17T02:25:46.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f6433e00640 1 -- 172.21.15.45:0/4022857860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c03d420 con 0x7f64400abef0 2024-08-17T02:25:46.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f6446400640 1 -- 172.21.15.45:0/4022857860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64400af4b0 con 0x7f64400abef0 2024-08-17T02:25:46.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.536+0000 7f6433e00640 1 -- 172.21.15.45:0/4022857860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c03d7e0 con 0x7f64400abef0 2024-08-17T02:25:46.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.537+0000 7f6446400640 1 -- 172.21.15.45:0/4022857860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64400afa70 con 0x7f64400abef0 2024-08-17T02:25:46.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.538+0000 7f6446400640 1 -- 172.21.15.45:0/4022857860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6440071050 con 0x7f64400abef0 2024-08-17T02:25:46.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.538+0000 7f6433e00640 1 -- 172.21.15.45:0/4022857860 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f642c039040 con 0x7f64400abef0 2024-08-17T02:25:46.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.539+0000 7f6433e00640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6420065220 0x7f64200676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.539+0000 7f6433e00640 1 -- 172.21.15.45:0/4022857860 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f642c0a2780 con 0x7f64400abef0 2024-08-17T02:25:46.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.539+0000 7f6445000640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6420065220 0x7f64200676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.540+0000 7f6445000640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6420065220 0x7f64200676d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f643400ab30 tx=0x7f6434008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.543+0000 7f6433e00640 1 -- 172.21.15.45:0/4022857860 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f642c0708c0 con 0x7f64400abef0 2024-08-17T02:25:46.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.727+0000 7f6446400640 1 -- 172.21.15.45:0/4022857860 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64400aff20 con 0x7f64400abef0 2024-08-17T02:25:46.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.728+0000 7f6433e00640 1 -- 172.21.15.45:0/4022857860 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f642c042020 con 0x7f64400abef0 2024-08-17T02:25:46.729 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:25:46.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 -- 172.21.15.45:0/4022857860 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6420065220 msgr2=0x7f64200676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6420065220 0x7f64200676d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f643400ab30 tx=0x7f6434008040 comp rx=0 tx=0).stop 2024-08-17T02:25:46.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 -- 172.21.15.45:0/4022857860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64400abef0 msgr2=0x7f644014d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.733 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64400abef0 0x7f644014d690 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f642c009970 tx=0x7f642c032000 comp rx=0 tx=0).stop 2024-08-17T02:25:46.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 -- 172.21.15.45:0/4022857860 shutdown_connections 2024-08-17T02:25:46.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6420065220 0x7f64200676d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64400ad210 0x7f644014dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64400abef0 0x7f644014d690 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 --2- 172.21.15.45:0/4022857860 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f644006d930 0x7f644014f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 -- 172.21.15.45:0/4022857860 >> 172.21.15.45:0/4022857860 conn(0x7f6440066cd0 msgr2=0x7f6440153840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 -- 172.21.15.45:0/4022857860 shutdown_connections 2024-08-17T02:25:46.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.730+0000 7f6446400640 1 -- 172.21.15.45:0/4022857860 wait complete. 2024-08-17T02:25:46.745 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:46.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.899+0000 7f7e7be00640 1 Processor -- start 2024-08-17T02:25:46.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.899+0000 7f7e7be00640 1 -- start start 2024-08-17T02:25:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.900+0000 7f7e7be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e74097180 0x7f7e740ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.900+0000 7f7e7be00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7e7415c5c0 0x7f7e740abae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.900+0000 7f7e7be00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e740ad290 con 0x7f7e7415c1f0 2024-08-17T02:25:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.900+0000 7f7e7be00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e740b0e20 con 0x7f7e74097180 2024-08-17T02:25:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.900+0000 7f7e7be00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e740ac370 con 0x7f7e7415c5c0 2024-08-17T02:25:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.901+0000 7f7e78a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e74097180 0x7f7e740ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.901+0000 7f7e78a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7e74097180 0x7f7e740ab5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47092/0 (socket says 172.21.15.45:47092) 2024-08-17T02:25:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.901+0000 7f7e78a00640 1 -- 172.21.15.45:0/2840961211 learned_addr learned my addr 172.21.15.45:0/2840961211 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.901+0000 7f7e79e00640 1 --2- 172.21.15.45:0/2840961211 >> v2:172.21.15.169:3300/0 conn(0x7f7e7415c5c0 0x7f7e740abae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.901+0000 7f7e78a00640 1 -- 172.21.15.45:0/2840961211 >> v2:172.21.15.169:3300/0 conn(0x7f7e7415c5c0 msgr2=0x7f7e740abae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.901+0000 7f7e78a00640 1 --2- 172.21.15.45:0/2840961211 >> v2:172.21.15.169:3300/0 conn(0x7f7e7415c5c0 0x7f7e740abae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.901+0000 7f7e78a00640 1 -- 172.21.15.45:0/2840961211 >> v1:172.21.15.169:6789/0 conn(0x7f7e7415c1f0 legacy=0x7f7e74096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.901+0000 7f7e78a00640 1 -- 172.21.15.45:0/2840961211 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e740ac650 con 0x7f7e74097180 2024-08-17T02:25:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.902+0000 7f7e78a00640 1 --2- 172.21.15.45:0/2840961211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e74097180 0x7f7e740ab5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e74064680 tx=0x7f7e600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f8c0cd6290e900d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.902+0000 7f7e73e00640 1 -- 172.21.15.45:0/2840961211 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e6002ae80 con 0x7f7e74097180 2024-08-17T02:25:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.902+0000 7f7e73e00640 1 -- 172.21.15.45:0/2840961211 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e60032440 con 0x7f7e74097180 2024-08-17T02:25:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.902+0000 7f7e73e00640 1 -- 172.21.15.45:0/2840961211 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60032800 con 0x7f7e74097180 2024-08-17T02:25:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.903+0000 7f7e7be00640 1 -- 172.21.15.45:0/2840961211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e74097180 msgr2=0x7f7e740ab5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.903+0000 7f7e7be00640 1 --2- 172.21.15.45:0/2840961211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e74097180 0x7f7e740ab5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e74064680 tx=0x7f7e600091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.903+0000 7f7e7be00640 1 -- 172.21.15.45:0/2840961211 shutdown_connections 2024-08-17T02:25:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.903+0000 7f7e7be00640 1 --2- 172.21.15.45:0/2840961211 >> v2:172.21.15.169:3300/0 conn(0x7f7e7415c5c0 0x7f7e740abae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.903+0000 7f7e7be00640 1 --2- 172.21.15.45:0/2840961211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e74097180 0x7f7e740ab5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.903+0000 7f7e7be00640 1 -- 172.21.15.45:0/2840961211 >> 172.21.15.45:0/2840961211 conn(0x7f7e740b2fd0 msgr2=0x7f7e740b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.903+0000 7f7e7be00640 1 -- 172.21.15.45:0/2840961211 shutdown_connections 2024-08-17T02:25:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.903+0000 7f7e7be00640 1 -- 172.21.15.45:0/2840961211 wait complete. 2024-08-17T02:25:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.904+0000 7f7e7be00640 1 Processor -- start 2024-08-17T02:25:46.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.905+0000 7f7e7be00640 1 -- start start 2024-08-17T02:25:46.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.905+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e74097180 0x7f7e741528d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7415c1f0 0x7f7e741444e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e7be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7415c5c0 0x7f7e74154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e7be00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e74152e10 con 0x7f7e74097180 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e7be00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740af6e0 con 0x7f7e7415c5c0 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e7be00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740af9c0 con 0x7f7e7415c1f0 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e79400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e74097180 0x7f7e741528d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e79400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e74097180 0x7f7e741528d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47100/0 (socket says 172.21.15.45:47100) 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e79400640 1 -- 172.21.15.45:0/292925797 learned_addr learned my addr 172.21.15.45:0/292925797 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e78a00640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7415c1f0 0x7f7e741444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e79e00640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7415c5c0 0x7f7e74154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e79400640 1 -- 172.21.15.45:0/292925797 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7415c1f0 msgr2=0x7f7e741444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e79400640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7415c1f0 0x7f7e741444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e79400640 1 -- 172.21.15.45:0/292925797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7415c5c0 msgr2=0x7f7e74154430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e79400640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7415c5c0 0x7f7e74154430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.906+0000 7f7e79400640 1 -- 172.21.15.45:0/292925797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60009450 con 0x7f7e74097180 2024-08-17T02:25:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.907+0000 7f7e79400640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e74097180 0x7f7e741528d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c560 tx=0x7f7e68007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.907+0000 7f7e70c00640 1 -- 172.21.15.45:0/292925797 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68011590 con 0x7f7e74097180 2024-08-17T02:25:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.907+0000 7f7e70c00640 1 -- 172.21.15.45:0/292925797 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e68011710 con 0x7f7e74097180 2024-08-17T02:25:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.907+0000 7f7e70c00640 1 -- 172.21.15.45:0/292925797 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68011ad0 con 0x7f7e74097180 2024-08-17T02:25:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.907+0000 7f7e7be00640 1 -- 172.21.15.45:0/292925797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e740afca0 con 0x7f7e74097180 2024-08-17T02:25:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.907+0000 7f7e7be00640 1 -- 172.21.15.45:0/292925797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e74144a20 con 0x7f7e74097180 2024-08-17T02:25:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.908+0000 7f7e7be00640 1 -- 172.21.15.45:0/292925797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e74071050 con 0x7f7e74097180 2024-08-17T02:25:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.909+0000 7f7e70c00640 1 -- 172.21.15.45:0/292925797 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7e6801b3b0 con 0x7f7e74097180 2024-08-17T02:25:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.910+0000 7f7e70c00640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7e54065150 0x7f7e54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.910+0000 7f7e70c00640 1 -- 172.21.15.45:0/292925797 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e680819e0 con 0x7f7e74097180 2024-08-17T02:25:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.910+0000 7f7e78a00640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7e54065150 0x7f7e54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.911+0000 7f7e78a00640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7e54065150 0x7f7e54067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7e60034000 tx=0x7f7e60032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:46.913+0000 7f7e70c00640 1 -- 172.21.15.45:0/292925797 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7e6804fab0 con 0x7f7e74097180 2024-08-17T02:25:47.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.094+0000 7f7e7be00640 1 -- 172.21.15.45:0/292925797 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e7414f9a0 con 0x7f7e74097180 2024-08-17T02:25:47.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.094+0000 7f7e70c00640 1 -- 172.21.15.45:0/292925797 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e68017070 con 0x7f7e74097180 2024-08-17T02:25:47.095 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-08-17T02:25:47.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.096+0000 7f7e7be00640 1 -- 172.21.15.45:0/292925797 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7e54065150 msgr2=0x7f7e54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.096+0000 7f7e7be00640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7e54065150 0x7f7e54067600 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7e60034000 tx=0x7f7e60032000 comp rx=0 tx=0).stop 2024-08-17T02:25:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.096+0000 7f7e7be00640 1 -- 172.21.15.45:0/292925797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e74097180 msgr2=0x7f7e741528d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.096+0000 7f7e7be00640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e74097180 0x7f7e741528d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c560 tx=0x7f7e68007ef0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.096+0000 7f7e7be00640 1 -- 172.21.15.45:0/292925797 shutdown_connections 2024-08-17T02:25:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.096+0000 7f7e7be00640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7e7415c5c0 0x7f7e74154430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.096+0000 7f7e7be00640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7e54065150 0x7f7e54067600 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.096+0000 7f7e7be00640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7e7415c1f0 0x7f7e741444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.096+0000 7f7e7be00640 1 --2- 172.21.15.45:0/292925797 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e74097180 0x7f7e741528d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.096+0000 7f7e7be00640 1 -- 172.21.15.45:0/292925797 >> 172.21.15.45:0/292925797 conn(0x7f7e740b2fd0 msgr2=0x7f7e740acb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.097+0000 7f7e7be00640 1 -- 172.21.15.45:0/292925797 shutdown_connections 2024-08-17T02:25:47.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.097+0000 7f7e7be00640 1 -- 172.21.15.45:0/292925797 wait complete. 2024-08-17T02:25:47.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:47.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.262+0000 7fb5e3800640 1 Processor -- start 2024-08-17T02:25:47.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.262+0000 7fb5e3800640 1 -- start start 2024-08-17T02:25:47.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.263+0000 7fb5e3800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb5dc0ad770 0x7fb5dc06e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.263+0000 7fb5e3800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5dc0ac0a0 0x7fb5dc0afb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.263+0000 7fb5e3800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5dc0aa8d0 con 0x7fb5dc1559a0 2024-08-17T02:25:47.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.263+0000 7fb5e3800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5dc0b0090 con 0x7fb5dc0ad770 2024-08-17T02:25:47.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.263+0000 7fb5e3800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc0b0860 con 0x7fb5dc0ac0a0 2024-08-17T02:25:47.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.264+0000 7fb5e0e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb5dc1559a0 0x7fb5dc0ad060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46352/0 (socket says 172.21.15.45:46352) 2024-08-17T02:25:47.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.264+0000 7fb5e0e00640 1 -- 172.21.15.45:0/244196099 learned_addr learned my addr 172.21.15.45:0/244196099 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:47.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.264+0000 7fb5d3e00640 1 --2- 172.21.15.45:0/244196099 >> v2:172.21.15.169:3300/0 conn(0x7fb5dc0ad770 0x7fb5dc06e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.264+0000 7fb5e1800640 1 --2- 172.21.15.45:0/244196099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5dc0ac0a0 0x7fb5dc0afb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.264+0000 7fb5dbe00640 1 -- 172.21.15.45:0/244196099 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284085451 0 0) 0x7fb5dc0aa8d0 con 0x7fb5dc1559a0 2024-08-17T02:25:47.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.264+0000 7fb5dbe00640 1 -- 172.21.15.45:0/244196099 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5c00034e0 con 0x7fb5dc1559a0 2024-08-17T02:25:47.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.264+0000 7fb5d3e00640 1 -- 172.21.15.45:0/244196099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5dc0ac0a0 msgr2=0x7fb5dc0afb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:47.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.264+0000 7fb5d3e00640 1 --2- 172.21.15.45:0/244196099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5dc0ac0a0 0x7fb5dc0afb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.264+0000 7fb5d3e00640 1 -- 172.21.15.45:0/244196099 >> v1:172.21.15.45:6789/0 conn(0x7fb5dc1559a0 legacy=0x7fb5dc0ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.264+0000 7fb5d3e00640 1 -- 172.21.15.45:0/244196099 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc0b02a0 con 0x7fb5dc0ad770 2024-08-17T02:25:47.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.265+0000 7fb5d3e00640 1 --2- 172.21.15.45:0/244196099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5dc0ad770 0x7fb5dc06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009850 tx=0x7fb5c40090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf480fc1cae83930 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:47.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.266+0000 7fb5dbe00640 1 -- 172.21.15.45:0/244196099 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c402ad80 con 0x7fb5dc0ad770 2024-08-17T02:25:47.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.266+0000 7fb5dbe00640 1 -- 172.21.15.45:0/244196099 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c4032440 con 0x7fb5dc0ad770 2024-08-17T02:25:47.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.266+0000 7fb5dbe00640 1 -- 172.21.15.45:0/244196099 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c4032820 con 0x7fb5dc0ad770 2024-08-17T02:25:47.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.266+0000 7fb5e3800640 1 -- 172.21.15.45:0/244196099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5dc0ad770 msgr2=0x7fb5dc06e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.266+0000 7fb5e3800640 1 --2- 172.21.15.45:0/244196099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5dc0ad770 0x7fb5dc06e2f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4009850 tx=0x7fb5c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.266+0000 7fb5e3800640 1 -- 172.21.15.45:0/244196099 shutdown_connections 2024-08-17T02:25:47.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.266+0000 7fb5e3800640 1 --2- 172.21.15.45:0/244196099 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5dc0ac0a0 0x7fb5dc0afb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.266+0000 7fb5e3800640 1 --2- 172.21.15.45:0/244196099 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5dc0ad770 0x7fb5dc06e2f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.266+0000 7fb5e3800640 1 -- 172.21.15.45:0/244196099 >> 172.21.15.45:0/244196099 conn(0x7fb5dc066cd0 msgr2=0x7fb5dc0670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:47.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.266+0000 7fb5e3800640 1 -- 172.21.15.45:0/244196099 shutdown_connections 2024-08-17T02:25:47.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.267+0000 7fb5e3800640 1 -- 172.21.15.45:0/244196099 wait complete. 2024-08-17T02:25:47.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.268+0000 7fb5e3800640 1 Processor -- start 2024-08-17T02:25:47.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.268+0000 7fb5e3800640 1 -- start start 2024-08-17T02:25:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.269+0000 7fb5e3800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5dc0ac0a0 0x7fb5dc14ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.269+0000 7fb5e3800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5dc0ad770 0x7fb5dc14f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.269+0000 7fb5e3800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5dc1559a0 0x7fb5dc15ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.269+0000 7fb5e3800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc15a670 con 0x7fb5dc1559a0 2024-08-17T02:25:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.269+0000 7fb5e3800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc159a60 con 0x7fb5dc0ad770 2024-08-17T02:25:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.269+0000 7fb5e3800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5dc159d40 con 0x7fb5dc0ac0a0 2024-08-17T02:25:47.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.269+0000 7fb5e1800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5dc1559a0 0x7fb5dc15ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.269+0000 7fb5e1800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5dc1559a0 0x7fb5dc15ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47108/0 (socket says 172.21.15.45:47108) 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.269+0000 7fb5e1800640 1 -- 172.21.15.45:0/831553755 learned_addr learned my addr 172.21.15.45:0/831553755 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.269+0000 7fb5d3e00640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5dc0ad770 0x7fb5dc14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.269+0000 7fb5e0e00640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5dc0ac0a0 0x7fb5dc14ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.270+0000 7fb5e1800640 1 -- 172.21.15.45:0/831553755 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5dc0ac0a0 msgr2=0x7fb5dc14ed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.270+0000 7fb5e1800640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5dc0ac0a0 0x7fb5dc14ed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.270+0000 7fb5e1800640 1 -- 172.21.15.45:0/831553755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5dc0ad770 msgr2=0x7fb5dc14f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.270+0000 7fb5e1800640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5dc0ad770 0x7fb5dc14f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.270+0000 7fb5e1800640 1 -- 172.21.15.45:0/831553755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c4009390 con 0x7fb5dc1559a0 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.270+0000 7fb5e1800640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5dc1559a0 0x7fb5dc15ab00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009e90 tx=0x7fb5d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.270+0000 7fb5d8c00640 1 -- 172.21.15.45:0/831553755 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400ce10 con 0x7fb5dc1559a0 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.270+0000 7fb5d8c00640 1 -- 172.21.15.45:0/831553755 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5d400f040 con 0x7fb5dc1559a0 2024-08-17T02:25:47.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.270+0000 7fb5d8c00640 1 -- 172.21.15.45:0/831553755 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5d40146d0 con 0x7fb5dc1559a0 2024-08-17T02:25:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.270+0000 7fb5e3800640 1 -- 172.21.15.45:0/831553755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5dc15a020 con 0x7fb5dc1559a0 2024-08-17T02:25:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.270+0000 7fb5e3800640 1 -- 172.21.15.45:0/831553755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5dc159080 con 0x7fb5dc1559a0 2024-08-17T02:25:47.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.271+0000 7fb5e3800640 1 -- 172.21.15.45:0/831553755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5dc15a7e0 con 0x7fb5dc1559a0 2024-08-17T02:25:47.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.272+0000 7fb5d8c00640 1 -- 172.21.15.45:0/831553755 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb5d4014a80 con 0x7fb5dc1559a0 2024-08-17T02:25:47.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.273+0000 7fb5d8c00640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb5b8065150 0x7fb5b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.273+0000 7fb5d8c00640 1 -- 172.21.15.45:0/831553755 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5d4082f80 con 0x7fb5dc1559a0 2024-08-17T02:25:47.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.273+0000 7fb5e0e00640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb5b8065150 0x7fb5b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.274+0000 7fb5e0e00640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb5b8065150 0x7fb5b8067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0ae240 tx=0x7fb5cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:47.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.277+0000 7fb5d8c00640 1 -- 172.21.15.45:0/831553755 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb5d4054ae0 con 0x7fb5dc1559a0 2024-08-17T02:25:47.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.459+0000 7fb5e3800640 1 -- 172.21.15.45:0/831553755 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb5dc0710c0 con 0x7fb5dc1559a0 2024-08-17T02:25:47.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.460+0000 7fb5d8c00640 1 -- 172.21.15.45:0/831553755 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7fb5d4054670 con 0x7fb5dc1559a0 2024-08-17T02:25:47.461 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:47.461 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:47.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 -- 172.21.15.45:0/831553755 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb5b8065150 msgr2=0x7fb5b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb5b8065150 0x7fb5b8067600 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0ae240 tx=0x7fb5cc009040 comp rx=0 tx=0).stop 2024-08-17T02:25:47.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 -- 172.21.15.45:0/831553755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5dc1559a0 msgr2=0x7fb5dc15ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5dc1559a0 0x7fb5dc15ab00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb5d4009e90 tx=0x7fb5d400b040 comp rx=0 tx=0).stop 2024-08-17T02:25:47.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 -- 172.21.15.45:0/831553755 shutdown_connections 2024-08-17T02:25:47.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5dc1559a0 0x7fb5dc15ab00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb5dc0ad770 0x7fb5dc14f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb5b8065150 0x7fb5b8067600 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 --2- 172.21.15.45:0/831553755 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb5dc0ac0a0 0x7fb5dc14ed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 -- 172.21.15.45:0/831553755 >> 172.21.15.45:0/831553755 conn(0x7fb5dc066cd0 msgr2=0x7fb5dc151d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:47.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 -- 172.21.15.45:0/831553755 shutdown_connections 2024-08-17T02:25:47.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.462+0000 7fb5e3800640 1 -- 172.21.15.45:0/831553755 wait complete. 2024-08-17T02:25:47.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:12.166249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:13.072271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:47.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:47.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.631+0000 7f1d43800640 1 Processor -- start 2024-08-17T02:25:47.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.631+0000 7f1d43800640 1 -- start start 2024-08-17T02:25:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.632+0000 7f1d43800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1d3c0b40d0 0x7f1d3c0b3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.632+0000 7f1d43800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c0b2700 con 0x7f1d3c0b2db0 2024-08-17T02:25:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.632+0000 7f1d43800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c0b1940 con 0x7f1d3c0b5840 2024-08-17T02:25:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.632+0000 7f1d43800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3c0b5cb0 con 0x7f1d3c0b40d0 2024-08-17T02:25:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.632+0000 7f1d40e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1d3c0b2db0 0x7f1d3c0cef30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46356/0 (socket says 172.21.15.45:46356) 2024-08-17T02:25:47.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.632+0000 7f1d40e00640 1 -- 172.21.15.45:0/3225063440 learned_addr learned my addr 172.21.15.45:0/3225063440 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:47.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d41800640 1 --2- 172.21.15.45:0/3225063440 >> v2:172.21.15.169:3300/0 conn(0x7f1d3c0b40d0 0x7f1d3c0b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154086765 0 0) 0x7f1d3c0b2700 con 0x7f1d3c0b2db0 2024-08-17T02:25:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d240034e0 con 0x7f1d3c0b2db0 2024-08-17T02:25:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952910616 0 0) 0x7f1d3c0b1940 con 0x7f1d3c0b5840 2024-08-17T02:25:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d3c0b2700 con 0x7f1d3c0b5840 2024-08-17T02:25:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 553807724 0 0) 0x7f1d240034e0 con 0x7f1d3c0b2db0 2024-08-17T02:25:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 >> v2:172.21.15.169:3300/0 conn(0x7f1d3c0b40d0 msgr2=0x7f1d3c0b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 --2- 172.21.15.45:0/3225063440 >> v2:172.21.15.169:3300/0 conn(0x7f1d3c0b40d0 0x7f1d3c0b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 >> v1:172.21.15.169:6789/0 conn(0x7f1d3c0b5840 legacy=0x7f1d3c0aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0b1c20 con 0x7f1d3c0b2db0 2024-08-17T02:25:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7f1d30001470 con 0x7f1d3c0b2db0 2024-08-17T02:25:47.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 >> v1:172.21.15.45:6789/0 conn(0x7f1d3c0b2db0 legacy=0x7f1d3c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 --2- 172.21.15.45:0/3225063440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d24003b60 0x7f1d24003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 --2- 172.21.15.45:0/3225063440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d24004780 0x7f1d24004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 --2- 172.21.15.45:0/3225063440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d24005130 0x7f1d2400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0b5cb0 con 0x7f1d24005130 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2400c020 con 0x7f1d24004780 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.633+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2400c1e0 con 0x7f1d24003b60 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.634+0000 7f1d41800640 1 --2- 172.21.15.45:0/3225063440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d24005130 0x7f1d2400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.634+0000 7f1d40e00640 1 --2- 172.21.15.45:0/3225063440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d24003b60 0x7f1d24003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.634+0000 7f1d3be00640 1 --2- 172.21.15.45:0/3225063440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d24004780 0x7f1d24004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.634+0000 7f1d41800640 1 -- 172.21.15.45:0/3225063440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d24003b60 msgr2=0x7f1d24003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.634+0000 7f1d41800640 1 --2- 172.21.15.45:0/3225063440 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d24003b60 0x7f1d24003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.634+0000 7f1d41800640 1 -- 172.21.15.45:0/3225063440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d24004780 msgr2=0x7f1d24004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:47.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.634+0000 7f1d41800640 1 --2- 172.21.15.45:0/3225063440 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d24004780 0x7f1d24004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.634+0000 7f1d41800640 1 -- 172.21.15.45:0/3225063440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d240034e0 con 0x7f1d24005130 2024-08-17T02:25:47.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.635+0000 7f1d41800640 1 -- 172.21.15.45:0/3225063440 reap_dead start 2024-08-17T02:25:47.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.635+0000 7f1d41800640 1 --2- 172.21.15.45:0/3225063440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d24005130 0x7f1d2400b9d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400e210 tx=0x7f1d3400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895d1a79d9782c10 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:47.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.635+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3402c040 con 0x7f1d24005130 2024-08-17T02:25:47.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.635+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3400f040 con 0x7f1d24005130 2024-08-17T02:25:47.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.635+0000 7f1d3b400640 1 -- 172.21.15.45:0/3225063440 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34030650 con 0x7f1d24005130 2024-08-17T02:25:47.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.636+0000 7f1d43800640 1 -- 172.21.15.45:0/3225063440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d24005130 msgr2=0x7f1d2400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.636+0000 7f1d43800640 1 --2- 172.21.15.45:0/3225063440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d24005130 0x7f1d2400b9d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1d3400e210 tx=0x7f1d3400b040 comp rx=0 tx=0).stop 2024-08-17T02:25:47.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.636+0000 7f1d43800640 1 -- 172.21.15.45:0/3225063440 shutdown_connections 2024-08-17T02:25:47.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.636+0000 7f1d43800640 1 --2- 172.21.15.45:0/3225063440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d24005130 0x7f1d2400b9d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.636+0000 7f1d43800640 1 -- 172.21.15.45:0/3225063440 >> 172.21.15.45:0/3225063440 conn(0x7f1d3c0cfdc0 msgr2=0x7f1d3c0d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:47.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.636+0000 7f1d43800640 1 -- 172.21.15.45:0/3225063440 shutdown_connections 2024-08-17T02:25:47.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.636+0000 7f1d43800640 1 -- 172.21.15.45:0/3225063440 wait complete. 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.637+0000 7f1d43800640 1 Processor -- start 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.638+0000 7f1d43800640 1 -- start start 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.638+0000 7f1d43800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d24005130 0x7f1d3c14b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.638+0000 7f1d43800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d3c15e790 0x7f1d3c15ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.638+0000 7f1d43800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c0acd70 0x7f1d3c0ad1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.638+0000 7f1d43800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15f140 con 0x7f1d3c15e790 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.638+0000 7f1d43800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15d980 con 0x7f1d24005130 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.638+0000 7f1d43800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c15cd70 con 0x7f1d3c0acd70 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d3be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d3c15e790 0x7f1d3c15ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d3be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d3c15e790 0x7f1d3c15ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47114/0 (socket says 172.21.15.45:47114) 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d3be00640 1 -- 172.21.15.45:0/172045212 learned_addr learned my addr 172.21.15.45:0/172045212 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:47.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d41800640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c0acd70 0x7f1d3c0ad1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d40e00640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d24005130 0x7f1d3c14b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d3be00640 1 -- 172.21.15.45:0/172045212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c0acd70 msgr2=0x7f1d3c0ad1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d3be00640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c0acd70 0x7f1d3c0ad1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d3be00640 1 -- 172.21.15.45:0/172045212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d24005130 msgr2=0x7f1d3c14b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d3be00640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d24005130 0x7f1d3c14b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d3be00640 1 -- 172.21.15.45:0/172045212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c15d050 con 0x7f1d3c15e790 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d41800640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c0acd70 0x7f1d3c0ad1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d40e00640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d24005130 0x7f1d3c14b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.639+0000 7f1d3be00640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d3c15e790 0x7f1d3c15ec00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1d28002b70 tx=0x7f1d28007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.640+0000 7f1d2fe00640 1 -- 172.21.15.45:0/172045212 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28003530 con 0x7f1d3c15e790 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.640+0000 7f1d2fe00640 1 -- 172.21.15.45:0/172045212 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2800faf0 con 0x7f1d3c15e790 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.640+0000 7f1d2fe00640 1 -- 172.21.15.45:0/172045212 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800feb0 con 0x7f1d3c15e790 2024-08-17T02:25:47.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.640+0000 7f1d43800640 1 -- 172.21.15.45:0/172045212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3c15d330 con 0x7f1d3c15e790 2024-08-17T02:25:47.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.640+0000 7f1d43800640 1 -- 172.21.15.45:0/172045212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c0ad720 con 0x7f1d3c15e790 2024-08-17T02:25:47.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.641+0000 7f1d43800640 1 -- 172.21.15.45:0/172045212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c15d7b0 con 0x7f1d3c15e790 2024-08-17T02:25:47.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.642+0000 7f1d2fe00640 1 -- 172.21.15.45:0/172045212 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1d28013600 con 0x7f1d3c15e790 2024-08-17T02:25:47.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.642+0000 7f1d2fe00640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1d1c065180 0x7f1d1c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:47.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.643+0000 7f1d2fe00640 1 -- 172.21.15.45:0/172045212 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1d28082bc0 con 0x7f1d3c15e790 2024-08-17T02:25:47.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.643+0000 7f1d40e00640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1d1c065180 0x7f1d1c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:47.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.643+0000 7f1d40e00640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1d1c065180 0x7f1d1c067630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1d30000e10 tx=0x7f1d30009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:47.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.646+0000 7f1d2fe00640 1 -- 172.21.15.45:0/172045212 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1d28050be0 con 0x7f1d3c15e790 2024-08-17T02:25:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.831+0000 7f1d43800640 1 -- 172.21.15.45:0/172045212 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d3c064db0 con 0x7f1d3c15e790 2024-08-17T02:25:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.831+0000 7f1d2fe00640 1 -- 172.21.15.45:0/172045212 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d28054200 con 0x7f1d3c15e790 2024-08-17T02:25:47.832 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:25:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 -- 172.21.15.45:0/172045212 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1d1c065180 msgr2=0x7f1d1c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1d1c065180 0x7f1d1c067630 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1d30000e10 tx=0x7f1d30009040 comp rx=0 tx=0).stop 2024-08-17T02:25:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 -- 172.21.15.45:0/172045212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d3c15e790 msgr2=0x7f1d3c15ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d3c15e790 0x7f1d3c15ec00 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f1d28002b70 tx=0x7f1d28007ca0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 -- 172.21.15.45:0/172045212 shutdown_connections 2024-08-17T02:25:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1d1c065180 0x7f1d1c067630 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1d3c0acd70 0x7f1d3c0ad1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d3c15e790 0x7f1d3c15ec00 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 --2- 172.21.15.45:0/172045212 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1d24005130 0x7f1d3c14b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 -- 172.21.15.45:0/172045212 >> 172.21.15.45:0/172045212 conn(0x7f1d3c0cfdc0 msgr2=0x7f1d3c068e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:47.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 -- 172.21.15.45:0/172045212 shutdown_connections 2024-08-17T02:25:47.836 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:47.834+0000 7f1d43800640 1 -- 172.21.15.45:0/172045212 wait complete. 2024-08-17T02:25:47.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:48.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.003+0000 7f53f0200640 1 Processor -- start 2024-08-17T02:25:48.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.003+0000 7f53f0200640 1 -- start start 2024-08-17T02:25:48.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.004+0000 7f53f0200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f53e80c92e0 0x7f53e8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.004+0000 7f53f0200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e81598f0 con 0x7f53e8155a80 2024-08-17T02:25:48.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.004+0000 7f53f0200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e8159bd0 con 0x7f53e80c7db0 2024-08-17T02:25:48.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.004+0000 7f53f0200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e8159eb0 con 0x7f53e80c92e0 2024-08-17T02:25:48.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.004+0000 7f53ed800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f53e8155a80 0x7f53e806dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46370/0 (socket says 172.21.15.45:46370) 2024-08-17T02:25:48.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.005+0000 7f53ed800640 1 -- 172.21.15.45:0/989079526 learned_addr learned my addr 172.21.15.45:0/989079526 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:48.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.005+0000 7f53ee200640 1 --2- 172.21.15.45:0/989079526 >> v2:172.21.15.169:3300/0 conn(0x7f53e80c92e0 0x7f53e8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.006 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.005+0000 7f53e7e00640 1 -- 172.21.15.45:0/989079526 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3492915743 0 0) 0x7f53e81598f0 con 0x7f53e8155a80 2024-08-17T02:25:48.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.005+0000 7f53e7e00640 1 -- 172.21.15.45:0/989079526 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53d00034e0 con 0x7f53e8155a80 2024-08-17T02:25:48.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.005+0000 7f53e7e00640 1 -- 172.21.15.45:0/989079526 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1189510839 0 0) 0x7f53d00034e0 con 0x7f53e8155a80 2024-08-17T02:25:48.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.005+0000 7f53ee200640 1 -- 172.21.15.45:0/989079526 >> v1:172.21.15.169:6789/0 conn(0x7f53e80c7db0 legacy=0x7f53e80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.005+0000 7f53ee200640 1 -- 172.21.15.45:0/989079526 >> v1:172.21.15.45:6789/0 conn(0x7f53e8155a80 legacy=0x7f53e806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.005+0000 7f53ee200640 1 -- 172.21.15.45:0/989079526 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e815a190 con 0x7f53e80c92e0 2024-08-17T02:25:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.006+0000 7f53ee200640 1 --2- 172.21.15.45:0/989079526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53e80c92e0 0x7f53e8160b90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009e60 tx=0x7f53e0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6959c357631e427 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.007+0000 7f53e7e00640 1 -- 172.21.15.45:0/989079526 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc001470 con 0x7f53e80c92e0 2024-08-17T02:25:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.007+0000 7f53e7e00640 1 -- 172.21.15.45:0/989079526 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e002d050 con 0x7f53e80c92e0 2024-08-17T02:25:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.007+0000 7f53e7e00640 1 -- 172.21.15.45:0/989079526 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e0031630 con 0x7f53e80c92e0 2024-08-17T02:25:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.007+0000 7f53f0200640 1 -- 172.21.15.45:0/989079526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53e80c92e0 msgr2=0x7f53e8160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.007+0000 7f53f0200640 1 --2- 172.21.15.45:0/989079526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53e80c92e0 0x7f53e8160b90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f53e0009e60 tx=0x7f53e0009780 comp rx=0 tx=0).stop 2024-08-17T02:25:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.007+0000 7f53f0200640 1 -- 172.21.15.45:0/989079526 shutdown_connections 2024-08-17T02:25:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.007+0000 7f53f0200640 1 --2- 172.21.15.45:0/989079526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53e80c92e0 0x7f53e8160b90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.007+0000 7f53f0200640 1 -- 172.21.15.45:0/989079526 >> 172.21.15.45:0/989079526 conn(0x7f53e8067750 msgr2=0x7f53e80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.007+0000 7f53f0200640 1 -- 172.21.15.45:0/989079526 shutdown_connections 2024-08-17T02:25:48.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.007+0000 7f53f0200640 1 -- 172.21.15.45:0/989079526 wait complete. 2024-08-17T02:25:48.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.009+0000 7f53f0200640 1 Processor -- start 2024-08-17T02:25:48.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.009+0000 7f53f0200640 1 -- start start 2024-08-17T02:25:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.010+0000 7f53f0200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53e80c7db0 0x7f53e8155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.010+0000 7f53f0200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53e80c92e0 0x7f53e8150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.010+0000 7f53f0200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53e8155a80 0x7f53e80a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.010+0000 7f53f0200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e81566c0 con 0x7f53e80c92e0 2024-08-17T02:25:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.010+0000 7f53f0200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e813ff80 con 0x7f53e8155a80 2024-08-17T02:25:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.010+0000 7f53f0200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e8157b10 con 0x7f53e80c7db0 2024-08-17T02:25:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.010+0000 7f53ece00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53e80c92e0 0x7f53e8150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.010+0000 7f53ece00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53e80c92e0 0x7f53e8150990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47130/0 (socket says 172.21.15.45:47130) 2024-08-17T02:25:48.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.010+0000 7f53ece00640 1 -- 172.21.15.45:0/3453330234 learned_addr learned my addr 172.21.15.45:0/3453330234 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.010+0000 7f53ee200640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53e8155a80 0x7f53e80a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.010+0000 7f53ed800640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53e80c7db0 0x7f53e8155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.011+0000 7f53ece00640 1 -- 172.21.15.45:0/3453330234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53e80c7db0 msgr2=0x7f53e8155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.011+0000 7f53ece00640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53e80c7db0 0x7f53e8155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.011+0000 7f53ece00640 1 -- 172.21.15.45:0/3453330234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53e8155a80 msgr2=0x7f53e80a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.011+0000 7f53ece00640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53e8155a80 0x7f53e80a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.011+0000 7f53ece00640 1 -- 172.21.15.45:0/3453330234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e0009a20 con 0x7f53e80c92e0 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.011+0000 7f53ece00640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53e80c92e0 0x7f53e8150990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c590 tx=0x7f53d4007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.011+0000 7f53e4c00640 1 -- 172.21.15.45:0/3453330234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4011590 con 0x7f53e80c92e0 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.011+0000 7f53e4c00640 1 -- 172.21.15.45:0/3453330234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d4011710 con 0x7f53e80c92e0 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.011+0000 7f53e4c00640 1 -- 172.21.15.45:0/3453330234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4011ad0 con 0x7f53e80c92e0 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.011+0000 7f53f0200640 1 -- 172.21.15.45:0/3453330234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e8157dd0 con 0x7f53e80c92e0 2024-08-17T02:25:48.013 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.011+0000 7f53f0200640 1 -- 172.21.15.45:0/3453330234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e8158390 con 0x7f53e80c92e0 2024-08-17T02:25:48.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.012+0000 7f53f0200640 1 -- 172.21.15.45:0/3453330234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e8071050 con 0x7f53e80c92e0 2024-08-17T02:25:48.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.013+0000 7f53e4c00640 1 -- 172.21.15.45:0/3453330234 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f53d401b3b0 con 0x7f53e80c92e0 2024-08-17T02:25:48.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.014+0000 7f53e4c00640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f53c8065150 0x7f53c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.014+0000 7f53e4c00640 1 -- 172.21.15.45:0/3453330234 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f53d40819a0 con 0x7f53e80c92e0 2024-08-17T02:25:48.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.014+0000 7f53ed800640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f53c8065150 0x7f53c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.015+0000 7f53ed800640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f53c8065150 0x7f53c8067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f53dc001380 tx=0x7f53dc0011c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.018+0000 7f53e4c00640 1 -- 172.21.15.45:0/3453330234 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f53d404fa70 con 0x7f53e80c92e0 2024-08-17T02:25:48.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.200+0000 7f53f0200640 1 -- 172.21.15.45:0/3453330234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f53e806aa10 con 0x7f53e80c92e0 2024-08-17T02:25:48.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.200+0000 7f53e4c00640 1 -- 172.21.15.45:0/3453330234 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f53d4017020 con 0x7f53e80c92e0 2024-08-17T02:25:48.201 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:25:48.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.202+0000 7f53f0200640 1 -- 172.21.15.45:0/3453330234 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f53c8065150 msgr2=0x7f53c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.202+0000 7f53f0200640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f53c8065150 0x7f53c8067600 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f53dc001380 tx=0x7f53dc0011c0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.202+0000 7f53f0200640 1 -- 172.21.15.45:0/3453330234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53e80c92e0 msgr2=0x7f53e8150990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.202+0000 7f53f0200640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53e80c92e0 0x7f53e8150990 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f53d400c590 tx=0x7f53d4007ec0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.202+0000 7f53f0200640 1 -- 172.21.15.45:0/3453330234 shutdown_connections 2024-08-17T02:25:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.202+0000 7f53f0200640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f53e8155a80 0x7f53e80a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.202+0000 7f53f0200640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53e80c92e0 0x7f53e8150990 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.202+0000 7f53f0200640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f53c8065150 0x7f53c8067600 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.202+0000 7f53f0200640 1 --2- 172.21.15.45:0/3453330234 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f53e80c7db0 0x7f53e8155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.202+0000 7f53f0200640 1 -- 172.21.15.45:0/3453330234 >> 172.21.15.45:0/3453330234 conn(0x7f53e8067750 msgr2=0x7f53e80c9de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.202+0000 7f53f0200640 1 -- 172.21.15.45:0/3453330234 shutdown_connections 2024-08-17T02:25:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.203+0000 7f53f0200640 1 -- 172.21.15.45:0/3453330234 wait complete. 2024-08-17T02:25:48.219 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:48.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.371+0000 7f626b200640 1 Processor -- start 2024-08-17T02:25:48.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.371+0000 7f626b200640 1 -- start start 2024-08-17T02:25:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f626b200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f626c15be50 0x7f626c0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f626b200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f626c0aec90 0x7f626c0aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f626b200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f626c06d4a0 con 0x7f626c0ab3b0 2024-08-17T02:25:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f626b200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f626c0b05b0 con 0x7f626c15be50 2024-08-17T02:25:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f626b200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c06c890 con 0x7f626c0aec90 2024-08-17T02:25:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f6269e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f626c15be50 0x7f626c0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f6269e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f626c15be50 0x7f626c0ae750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47144/0 (socket says 172.21.15.45:47144) 2024-08-17T02:25:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f6269e00640 1 -- 172.21.15.45:0/1553523349 learned_addr learned my addr 172.21.15.45:0/1553523349 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f6263e00640 1 --2- 172.21.15.45:0/1553523349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f626c0aec90 0x7f626c0aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f6269e00640 1 -- 172.21.15.45:0/1553523349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f626c0aec90 msgr2=0x7f626c0aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f6269e00640 1 --2- 172.21.15.45:0/1553523349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f626c0aec90 0x7f626c0aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f6269e00640 1 -- 172.21.15.45:0/1553523349 >> v1:172.21.15.169:6789/0 conn(0x7f626c0ab3b0 legacy=0x7f626c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.373+0000 7f6269e00640 1 -- 172.21.15.45:0/1553523349 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f626c06cb70 con 0x7f626c15be50 2024-08-17T02:25:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.374+0000 7f6269e00640 1 --2- 172.21.15.45:0/1553523349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c15be50 0x7f626c0ae750 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f625c009910 tx=0x7f625c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db5af312f2c6ff1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.375+0000 7f6269400640 1 -- 172.21.15.45:0/1553523349 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c02ae40 con 0x7f626c15be50 2024-08-17T02:25:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.375+0000 7f6269400640 1 -- 172.21.15.45:0/1553523349 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625c032440 con 0x7f626c15be50 2024-08-17T02:25:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.375+0000 7f6269400640 1 -- 172.21.15.45:0/1553523349 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f625c032820 con 0x7f626c15be50 2024-08-17T02:25:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.375+0000 7f626b200640 1 -- 172.21.15.45:0/1553523349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c15be50 msgr2=0x7f626c0ae750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.375+0000 7f626b200640 1 --2- 172.21.15.45:0/1553523349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c15be50 0x7f626c0ae750 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f625c009910 tx=0x7f625c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.375+0000 7f626b200640 1 -- 172.21.15.45:0/1553523349 shutdown_connections 2024-08-17T02:25:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.375+0000 7f626b200640 1 --2- 172.21.15.45:0/1553523349 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f626c0aec90 0x7f626c0aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.375+0000 7f626b200640 1 --2- 172.21.15.45:0/1553523349 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c15be50 0x7f626c0ae750 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.375+0000 7f626b200640 1 -- 172.21.15.45:0/1553523349 >> 172.21.15.45:0/1553523349 conn(0x7f626c066cd0 msgr2=0x7f626c0670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.375+0000 7f626b200640 1 -- 172.21.15.45:0/1553523349 shutdown_connections 2024-08-17T02:25:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.375+0000 7f626b200640 1 -- 172.21.15.45:0/1553523349 wait complete. 2024-08-17T02:25:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.377+0000 7f626b200640 1 Processor -- start 2024-08-17T02:25:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.377+0000 7f626b200640 1 -- start start 2024-08-17T02:25:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626b200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f626c0ab3b0 0x7f626c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626b200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f626c0aec90 0x7f626c153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626b200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c15be50 0x7f626c1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626b200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c1580b0 con 0x7f626c15be50 2024-08-17T02:25:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626b200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f626c153b60 con 0x7f626c0ab3b0 2024-08-17T02:25:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626b200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f626c152f50 con 0x7f626c0aec90 2024-08-17T02:25:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c15be50 0x7f626c1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c15be50 0x7f626c1595d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47160/0 (socket says 172.21.15.45:47160) 2024-08-17T02:25:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626a800640 1 -- 172.21.15.45:0/2892646543 learned_addr learned my addr 172.21.15.45:0/2892646543 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f6263e00640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f626c0aec90 0x7f626c153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f6269e00640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f626c0ab3b0 0x7f626c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626a800640 1 -- 172.21.15.45:0/2892646543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f626c0aec90 msgr2=0x7f626c153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626a800640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f626c0aec90 0x7f626c153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626a800640 1 -- 172.21.15.45:0/2892646543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f626c0ab3b0 msgr2=0x7f626c154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626a800640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f626c0ab3b0 0x7f626c154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.378+0000 7f626a800640 1 -- 172.21.15.45:0/2892646543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c009450 con 0x7f626c15be50 2024-08-17T02:25:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.379+0000 7f626a800640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c15be50 0x7f626c1595d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f626400c860 tx=0x7f6264001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.379+0000 7f6261600640 1 -- 172.21.15.45:0/2892646543 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400ce50 con 0x7f626c15be50 2024-08-17T02:25:48.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.379+0000 7f6261600640 1 -- 172.21.15.45:0/2892646543 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626400a850 con 0x7f626c15be50 2024-08-17T02:25:48.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.379+0000 7f6261600640 1 -- 172.21.15.45:0/2892646543 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400ac10 con 0x7f626c15be50 2024-08-17T02:25:48.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.379+0000 7f626b200640 1 -- 172.21.15.45:0/2892646543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f626c153230 con 0x7f626c15be50 2024-08-17T02:25:48.381 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.379+0000 7f626b200640 1 -- 172.21.15.45:0/2892646543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f626c1537f0 con 0x7f626c15be50 2024-08-17T02:25:48.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.380+0000 7f626b200640 1 -- 172.21.15.45:0/2892646543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f626c153d10 con 0x7f626c15be50 2024-08-17T02:25:48.382 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.381+0000 7f6261600640 1 -- 172.21.15.45:0/2892646543 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6264012420 con 0x7f626c15be50 2024-08-17T02:25:48.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.382+0000 7f6261600640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6248065150 0x7f6248067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.382+0000 7f6261600640 1 -- 172.21.15.45:0/2892646543 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6264082740 con 0x7f626c15be50 2024-08-17T02:25:48.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.382+0000 7f6269e00640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6248065150 0x7f6248067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.383+0000 7f6269e00640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6248065150 0x7f6248067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f625c034000 tx=0x7f625c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.385+0000 7f6261600640 1 -- 172.21.15.45:0/2892646543 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6264050760 con 0x7f626c15be50 2024-08-17T02:25:48.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.565+0000 7f626b200640 1 -- 172.21.15.45:0/2892646543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f626c155050 con 0x7f626c15be50 2024-08-17T02:25:48.566 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.565+0000 7f6261600640 1 -- 172.21.15.45:0/2892646543 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6264053d80 con 0x7f626c15be50 2024-08-17T02:25:48.567 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-08-17T02:25:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 -- 172.21.15.45:0/2892646543 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6248065150 msgr2=0x7f6248067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6248065150 0x7f6248067600 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f625c034000 tx=0x7f625c032000 comp rx=0 tx=0).stop 2024-08-17T02:25:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 -- 172.21.15.45:0/2892646543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c15be50 msgr2=0x7f626c1595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c15be50 0x7f626c1595d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f626400c860 tx=0x7f6264001690 comp rx=0 tx=0).stop 2024-08-17T02:25:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 -- 172.21.15.45:0/2892646543 shutdown_connections 2024-08-17T02:25:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f626c15be50 0x7f626c1595d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6248065150 0x7f6248067600 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f626c0aec90 0x7f626c153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 --2- 172.21.15.45:0/2892646543 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f626c0ab3b0 0x7f626c154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 -- 172.21.15.45:0/2892646543 >> 172.21.15.45:0/2892646543 conn(0x7f626c066cd0 msgr2=0x7f626c0cb5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 -- 172.21.15.45:0/2892646543 shutdown_connections 2024-08-17T02:25:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.568+0000 7f626b200640 1 -- 172.21.15.45:0/2892646543 wait complete. 2024-08-17T02:25:48.651 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2024-08-17T02:25:48.651 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:25:48.651 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.802+0000 7f6c7a000640 1 Processor -- start 2024-08-17T02:25:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.802+0000 7f6c7a000640 1 -- start start 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.803+0000 7f6c7a000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6c741401b0 0x7f6c740caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.803+0000 7f6c7a000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6c74140580 0x7f6c740b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.803+0000 7f6c7a000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c740b1270 0x7f6c740c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.803+0000 7f6c7a000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c740cb450 con 0x7f6c74140580 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.803+0000 7f6c7a000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c740b16d0 con 0x7f6c741401b0 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.803+0000 7f6c7a000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740caa80 con 0x7f6c740b1270 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.803+0000 7f6c6be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6c74140580 0x7f6c740b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.803+0000 7f6c6be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6c74140580 0x7f6c740b0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47172/0 (socket says 172.21.15.45:47172) 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.803+0000 7f6c73400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6c741401b0 0x7f6c740caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.803+0000 7f6c6be00640 1 -- 172.21.15.45:0/82334304 learned_addr learned my addr 172.21.15.45:0/82334304 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.803+0000 7f6c73e00640 1 --2- 172.21.15.45:0/82334304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c740b1270 0x7f6c740c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.804+0000 7f6c6be00640 1 -- 172.21.15.45:0/82334304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c740b1270 msgr2=0x7f6c740c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.804+0000 7f6c6be00640 1 --2- 172.21.15.45:0/82334304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c740b1270 0x7f6c740c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.804+0000 7f6c6be00640 1 -- 172.21.15.45:0/82334304 >> v2:172.21.15.169:3300/0 conn(0x7f6c741401b0 msgr2=0x7f6c740caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.804+0000 7f6c6be00640 1 --2- 172.21.15.45:0/82334304 >> v2:172.21.15.169:3300/0 conn(0x7f6c741401b0 0x7f6c740caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.804+0000 7f6c6be00640 1 -- 172.21.15.45:0/82334304 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c740c9e70 con 0x7f6c74140580 2024-08-17T02:25:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.805+0000 7f6c6be00640 1 --2- 172.21.15.45:0/82334304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c74140580 0x7f6c740b0d30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6c74068650 tx=0x7f6c5c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75702976d7a5a21b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.807+0000 7f6c72a00640 1 -- 172.21.15.45:0/82334304 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c02ad40 con 0x7f6c74140580 2024-08-17T02:25:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.807+0000 7f6c72a00640 1 -- 172.21.15.45:0/82334304 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c032440 con 0x7f6c74140580 2024-08-17T02:25:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.807+0000 7f6c72a00640 1 -- 172.21.15.45:0/82334304 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c02aea0 con 0x7f6c74140580 2024-08-17T02:25:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.807+0000 7f6c7a000640 1 -- 172.21.15.45:0/82334304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c74140580 msgr2=0x7f6c740b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.807+0000 7f6c7a000640 1 --2- 172.21.15.45:0/82334304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c74140580 0x7f6c740b0d30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6c74068650 tx=0x7f6c5c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.808+0000 7f6c7a000640 1 -- 172.21.15.45:0/82334304 shutdown_connections 2024-08-17T02:25:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.808+0000 7f6c7a000640 1 --2- 172.21.15.45:0/82334304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c74140580 0x7f6c740b0d30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.808+0000 7f6c7a000640 1 --2- 172.21.15.45:0/82334304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c740b1270 0x7f6c740c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.808+0000 7f6c7a000640 1 --2- 172.21.15.45:0/82334304 >> v2:172.21.15.169:3300/0 conn(0x7f6c741401b0 0x7f6c740caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.808+0000 7f6c7a000640 1 -- 172.21.15.45:0/82334304 >> 172.21.15.45:0/82334304 conn(0x7f6c740cb9b0 msgr2=0x7f6c740cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.808+0000 7f6c7a000640 1 -- 172.21.15.45:0/82334304 shutdown_connections 2024-08-17T02:25:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.808+0000 7f6c7a000640 1 -- 172.21.15.45:0/82334304 wait complete. 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.809+0000 7f6c7a000640 1 Processor -- start 2024-08-17T02:25:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.809+0000 7f6c7a000640 1 -- start start 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.810+0000 7f6c7a000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c740b1270 0x7f6c740c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.810+0000 7f6c7a000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c741401b0 0x7f6c740c2590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.810+0000 7f6c7a000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c74140580 0x7f6c740ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.810+0000 7f6c7a000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740c3170 con 0x7f6c741401b0 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.810+0000 7f6c7a000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740c1120 con 0x7f6c740b1270 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.810+0000 7f6c7a000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740c2e90 con 0x7f6c74140580 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.810+0000 7f6c6be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c741401b0 0x7f6c740c2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.810+0000 7f6c6be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c741401b0 0x7f6c740c2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47180/0 (socket says 172.21.15.45:47180) 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.810+0000 7f6c6be00640 1 -- 172.21.15.45:0/2077784885 learned_addr learned my addr 172.21.15.45:0/2077784885 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.810+0000 7f6c73400640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c740b1270 0x7f6c740c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.810+0000 7f6c73e00640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c74140580 0x7f6c740ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.811+0000 7f6c6be00640 1 -- 172.21.15.45:0/2077784885 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c74140580 msgr2=0x7f6c740ab350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.811+0000 7f6c6be00640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c74140580 0x7f6c740ab350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.811+0000 7f6c6be00640 1 -- 172.21.15.45:0/2077784885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c740b1270 msgr2=0x7f6c740c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.811+0000 7f6c6be00640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c740b1270 0x7f6c740c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.811+0000 7f6c6be00640 1 -- 172.21.15.45:0/2077784885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5c009450 con 0x7f6c741401b0 2024-08-17T02:25:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.811+0000 7f6c6be00640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c741401b0 0x7f6c740c2590 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c02a740 tx=0x7f6c5c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.811+0000 7f6c6aa00640 1 -- 172.21.15.45:0/2077784885 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0317b0 con 0x7f6c741401b0 2024-08-17T02:25:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.811+0000 7f6c6aa00640 1 -- 172.21.15.45:0/2077784885 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c031910 con 0x7f6c741401b0 2024-08-17T02:25:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.811+0000 7f6c6aa00640 1 -- 172.21.15.45:0/2077784885 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c031d10 con 0x7f6c741401b0 2024-08-17T02:25:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.811+0000 7f6c7a000640 1 -- 172.21.15.45:0/2077784885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c740c0ad0 con 0x7f6c741401b0 2024-08-17T02:25:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.812+0000 7f6c7a000640 1 -- 172.21.15.45:0/2077784885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c740c1af0 con 0x7f6c741401b0 2024-08-17T02:25:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.812+0000 7f6c7a000640 1 -- 172.21.15.45:0/2077784885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c74064db0 con 0x7f6c741401b0 2024-08-17T02:25:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.813+0000 7f6c6aa00640 1 -- 172.21.15.45:0/2077784885 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6c5c03c400 con 0x7f6c741401b0 2024-08-17T02:25:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.814+0000 7f6c6aa00640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6c50065150 0x7f6c50067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.814+0000 7f6c6aa00640 1 -- 172.21.15.45:0/2077784885 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6c5c0a2830 con 0x7f6c741401b0 2024-08-17T02:25:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.814+0000 7f6c73400640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6c50065150 0x7f6c50067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.815+0000 7f6c73400640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6c50065150 0x7f6c50067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009c80 tx=0x7f6c640090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:48.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:48.818+0000 7f6c6aa00640 1 -- 172.21.15.45:0/2077784885 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6c5c0709c0 con 0x7f6c741401b0 2024-08-17T02:25:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.000+0000 7f6c7a000640 1 -- 172.21.15.45:0/2077784885 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c740c7a00 con 0x7f6c741401b0 2024-08-17T02:25:49.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.000+0000 7f6c6aa00640 1 -- 172.21.15.45:0/2077784885 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f6c5c073fe0 con 0x7f6c741401b0 2024-08-17T02:25:49.001 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:49.002 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.002+0000 7f6c7a000640 1 -- 172.21.15.45:0/2077784885 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6c50065150 msgr2=0x7f6c50067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.002+0000 7f6c7a000640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6c50065150 0x7f6c50067600 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009c80 tx=0x7f6c640090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.002+0000 7f6c7a000640 1 -- 172.21.15.45:0/2077784885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c741401b0 msgr2=0x7f6c740c2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.002+0000 7f6c7a000640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c741401b0 0x7f6c740c2590 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c02a740 tx=0x7f6c5c032000 comp rx=0 tx=0).stop 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.003+0000 7f6c7a000640 1 -- 172.21.15.45:0/2077784885 shutdown_connections 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.003+0000 7f6c7a000640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6c50065150 0x7f6c50067600 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.003+0000 7f6c7a000640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6c74140580 0x7f6c740ab350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.003+0000 7f6c7a000640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c741401b0 0x7f6c740c2590 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.003+0000 7f6c7a000640 1 --2- 172.21.15.45:0/2077784885 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6c740b1270 0x7f6c740c15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.003+0000 7f6c7a000640 1 -- 172.21.15.45:0/2077784885 >> 172.21.15.45:0/2077784885 conn(0x7f6c740cb9b0 msgr2=0x7f6c7415b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.003+0000 7f6c7a000640 1 -- 172.21.15.45:0/2077784885 shutdown_connections 2024-08-17T02:25:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.003+0000 7f6c7a000640 1 -- 172.21.15.45:0/2077784885 wait complete. 2024-08-17T02:25:49.018 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:12.166249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:13.072271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:49.019 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:49.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.172+0000 7f9361e00640 1 Processor -- start 2024-08-17T02:25:49.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.172+0000 7f9361e00640 1 -- start start 2024-08-17T02:25:49.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.173+0000 7f9361e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f935c0accf0 0x7f935c0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.173+0000 7f9361e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f935c159610 0x7f935c0af680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.174+0000 7f9361e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935c0b0020 con 0x7f935c0afbc0 2024-08-17T02:25:49.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.174+0000 7f9361e00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935c0ae540 con 0x7f935c159610 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.174+0000 7f9361e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c0ad930 con 0x7f935c0accf0 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.174+0000 7f935b400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f935c0afbc0 0x7f935c156030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46382/0 (socket says 172.21.15.45:46382) 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.174+0000 7f935b400640 1 -- 172.21.15.45:0/688924748 learned_addr learned my addr 172.21.15.45:0/688924748 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.174+0000 7f935aa00640 1 --2- 172.21.15.45:0/688924748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f935c0accf0 0x7f935c0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.174+0000 7f9353e00640 1 --2- 172.21.15.45:0/688924748 >> v2:172.21.15.169:3300/0 conn(0x7f935c159610 0x7f935c0af680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.174+0000 7f935a000640 1 -- 172.21.15.45:0/688924748 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868367471 0 0) 0x7f9354001490 con 0x7f935c0afbc0 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.174+0000 7f935a000640 1 -- 172.21.15.45:0/688924748 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93400034e0 con 0x7f935c0afbc0 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.174+0000 7f9353e00640 1 -- 172.21.15.45:0/688924748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f935c0accf0 msgr2=0x7f935c0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.175+0000 7f9353e00640 1 --2- 172.21.15.45:0/688924748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f935c0accf0 0x7f935c0b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.175+0000 7f9353e00640 1 -- 172.21.15.45:0/688924748 >> v1:172.21.15.45:6789/0 conn(0x7f935c0afbc0 legacy=0x7f935c156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.175+0000 7f9353e00640 1 -- 172.21.15.45:0/688924748 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c0adc10 con 0x7f935c159610 2024-08-17T02:25:49.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.175+0000 7f935aa00640 1 --2- 172.21.15.45:0/688924748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f935c0accf0 0x7f935c0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:49.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.176+0000 7f9353e00640 1 --2- 172.21.15.45:0/688924748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f935c159610 0x7f935c0af680 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9344009850 tx=0x7f93440090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a966c9dd91056d7b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.176+0000 7f935a000640 1 -- 172.21.15.45:0/688924748 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934402ad00 con 0x7f935c159610 2024-08-17T02:25:49.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.176+0000 7f935a000640 1 -- 172.21.15.45:0/688924748 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934402ae60 con 0x7f935c159610 2024-08-17T02:25:49.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.176+0000 7f935a000640 1 -- 172.21.15.45:0/688924748 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9344032650 con 0x7f935c159610 2024-08-17T02:25:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.177+0000 7f9361e00640 1 -- 172.21.15.45:0/688924748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f935c159610 msgr2=0x7f935c0af680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.177+0000 7f9361e00640 1 --2- 172.21.15.45:0/688924748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f935c159610 0x7f935c0af680 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9344009850 tx=0x7f93440090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.177+0000 7f9361e00640 1 -- 172.21.15.45:0/688924748 shutdown_connections 2024-08-17T02:25:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.177+0000 7f9361e00640 1 --2- 172.21.15.45:0/688924748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f935c159610 0x7f935c0af680 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.177+0000 7f9361e00640 1 --2- 172.21.15.45:0/688924748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f935c0accf0 0x7f935c0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.177+0000 7f9361e00640 1 -- 172.21.15.45:0/688924748 >> 172.21.15.45:0/688924748 conn(0x7f935c067750 msgr2=0x7f935c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.177+0000 7f9361e00640 1 -- 172.21.15.45:0/688924748 shutdown_connections 2024-08-17T02:25:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.177+0000 7f9361e00640 1 -- 172.21.15.45:0/688924748 wait complete. 2024-08-17T02:25:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.178+0000 7f9361e00640 1 Processor -- start 2024-08-17T02:25:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.178+0000 7f9361e00640 1 -- start start 2024-08-17T02:25:49.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.179+0000 7f9361e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935c0accf0 0x7f935c15aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.179+0000 7f9361e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f935c0afbc0 0x7f935c0cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.179+0000 7f9361e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f935c159610 0x7f935c154150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.179+0000 7f9361e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c15b400 con 0x7f935c0accf0 2024-08-17T02:25:49.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.179+0000 7f9361e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935c16cd00 con 0x7f935c159610 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.179+0000 7f9361e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f935c16cfe0 con 0x7f935c0afbc0 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.179+0000 7f935aa00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935c0accf0 0x7f935c15aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.179+0000 7f935aa00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935c0accf0 0x7f935c15aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47184/0 (socket says 172.21.15.45:47184) 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.179+0000 7f935aa00640 1 -- 172.21.15.45:0/3585141120 learned_addr learned my addr 172.21.15.45:0/3585141120 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f935b400640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f935c159610 0x7f935c154150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f9353e00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f935c0afbc0 0x7f935c0cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f935aa00640 1 -- 172.21.15.45:0/3585141120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f935c0afbc0 msgr2=0x7f935c0cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f935aa00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f935c0afbc0 0x7f935c0cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f935aa00640 1 -- 172.21.15.45:0/3585141120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f935c159610 msgr2=0x7f935c154150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f935aa00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f935c159610 0x7f935c154150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f935aa00640 1 -- 172.21.15.45:0/3585141120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c009390 con 0x7f935c0accf0 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f935b400640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f935c159610 0x7f935c154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f935aa00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935c0accf0 0x7f935c15aec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f934c00ec80 tx=0x7f934c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f9352000640 1 -- 172.21.15.45:0/3585141120 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c00eec0 con 0x7f935c0accf0 2024-08-17T02:25:49.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f9352000640 1 -- 172.21.15.45:0/3585141120 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c00cbc0 con 0x7f935c0accf0 2024-08-17T02:25:49.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f9361e00640 1 -- 172.21.15.45:0/3585141120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9344009390 con 0x7f935c0accf0 2024-08-17T02:25:49.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.180+0000 7f9352000640 1 -- 172.21.15.45:0/3585141120 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c013470 con 0x7f935c0accf0 2024-08-17T02:25:49.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.181+0000 7f9361e00640 1 -- 172.21.15.45:0/3585141120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935c16d5a0 con 0x7f935c0accf0 2024-08-17T02:25:49.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.182+0000 7f9361e00640 1 -- 172.21.15.45:0/3585141120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935c064db0 con 0x7f935c0accf0 2024-08-17T02:25:49.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.182+0000 7f9352000640 1 -- 172.21.15.45:0/3585141120 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f934c0137e0 con 0x7f935c0accf0 2024-08-17T02:25:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.183+0000 7f9352000640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9338065150 0x7f9338067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.183+0000 7f9352000640 1 -- 172.21.15.45:0/3585141120 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f934c082920 con 0x7f935c0accf0 2024-08-17T02:25:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.183+0000 7f9353e00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9338065150 0x7f9338067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.184+0000 7f9353e00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9338065150 0x7f9338067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9344034000 tx=0x7f9344032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.187+0000 7f9352000640 1 -- 172.21.15.45:0/3585141120 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f934c050940 con 0x7f935c0accf0 2024-08-17T02:25:49.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.367+0000 7f9361e00640 1 -- 172.21.15.45:0/3585141120 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f935c069c50 con 0x7f935c0accf0 2024-08-17T02:25:49.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.368+0000 7f9352000640 1 -- 172.21.15.45:0/3585141120 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f934c0210a0 con 0x7f935c0accf0 2024-08-17T02:25:49.369 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:25:49.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 -- 172.21.15.45:0/3585141120 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9338065150 msgr2=0x7f9338067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9338065150 0x7f9338067600 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9344034000 tx=0x7f9344032000 comp rx=0 tx=0).stop 2024-08-17T02:25:49.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 -- 172.21.15.45:0/3585141120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935c0accf0 msgr2=0x7f935c15aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935c0accf0 0x7f935c15aec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f934c00ec80 tx=0x7f934c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 -- 172.21.15.45:0/3585141120 shutdown_connections 2024-08-17T02:25:49.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f935c159610 0x7f935c154150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9338065150 0x7f9338067600 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f935c0afbc0 0x7f935c0cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 --2- 172.21.15.45:0/3585141120 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f935c0accf0 0x7f935c15aec0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 -- 172.21.15.45:0/3585141120 >> 172.21.15.45:0/3585141120 conn(0x7f935c067750 msgr2=0x7f935c0aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 -- 172.21.15.45:0/3585141120 shutdown_connections 2024-08-17T02:25:49.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.370+0000 7f9361e00640 1 -- 172.21.15.45:0/3585141120 wait complete. 2024-08-17T02:25:49.386 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:49.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.538+0000 7fe7b8e00640 1 Processor -- start 2024-08-17T02:25:49.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.538+0000 7fe7b8e00640 1 -- start start 2024-08-17T02:25:49.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.539+0000 7fe7b8e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b40c3390 0x7fe7b40c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.539+0000 7fe7b8e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b40cb540 con 0x7fe7b40caa20 2024-08-17T02:25:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.539+0000 7fe7b8e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7b40cf7f0 con 0x7fe7b4158e20 2024-08-17T02:25:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.539+0000 7fe7b8e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b40caef0 con 0x7fe7b40c3390 2024-08-17T02:25:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.540+0000 7fe7b1400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe7b40caa20 0x7fe7b40c6e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46386/0 (socket says 172.21.15.45:46386) 2024-08-17T02:25:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.540+0000 7fe7b1400640 1 -- 172.21.15.45:0/1587815221 learned_addr learned my addr 172.21.15.45:0/1587815221 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.540+0000 7fe7b2800640 1 --2- 172.21.15.45:0/1587815221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b40c3390 0x7fe7b40c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.540+0000 7fe7b0a00640 1 -- 172.21.15.45:0/1587815221 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083958775 0 0) 0x7fe7b40cb540 con 0x7fe7b40caa20 2024-08-17T02:25:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.540+0000 7fe7b0a00640 1 -- 172.21.15.45:0/1587815221 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7980034e0 con 0x7fe7b40caa20 2024-08-17T02:25:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.540+0000 7fe7b0a00640 1 -- 172.21.15.45:0/1587815221 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3791998816 0 0) 0x7fe7b40cf7f0 con 0x7fe7b4158e20 2024-08-17T02:25:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.540+0000 7fe7b0a00640 1 -- 172.21.15.45:0/1587815221 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b40cb540 con 0x7fe7b4158e20 2024-08-17T02:25:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.540+0000 7fe7b2800640 1 -- 172.21.15.45:0/1587815221 >> v1:172.21.15.169:6789/0 conn(0x7fe7b4158e20 legacy=0x7fe7b40ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.540+0000 7fe7b2800640 1 -- 172.21.15.45:0/1587815221 >> v1:172.21.15.45:6789/0 conn(0x7fe7b40caa20 legacy=0x7fe7b40c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.540+0000 7fe7b2800640 1 -- 172.21.15.45:0/1587815221 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40cb1d0 con 0x7fe7b40c3390 2024-08-17T02:25:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.542+0000 7fe7b2800640 1 --2- 172.21.15.45:0/1587815221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b40c3390 0x7fe7b40c7520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009e90 tx=0x7fe7ac009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c80a1a1f7e4d0949 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.542+0000 7fe7b0a00640 1 -- 172.21.15.45:0/1587815221 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac007550 con 0x7fe7b40c3390 2024-08-17T02:25:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.542+0000 7fe7b0a00640 1 -- 172.21.15.45:0/1587815221 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7ac02d050 con 0x7fe7b40c3390 2024-08-17T02:25:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.542+0000 7fe7b0a00640 1 -- 172.21.15.45:0/1587815221 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0078c0 con 0x7fe7b40c3390 2024-08-17T02:25:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.542+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1587815221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b40c3390 msgr2=0x7fe7b40c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.542+0000 7fe7b8e00640 1 --2- 172.21.15.45:0/1587815221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b40c3390 0x7fe7b40c7520 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009e90 tx=0x7fe7ac009780 comp rx=0 tx=0).stop 2024-08-17T02:25:49.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.542+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1587815221 shutdown_connections 2024-08-17T02:25:49.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.542+0000 7fe7b8e00640 1 --2- 172.21.15.45:0/1587815221 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b40c3390 0x7fe7b40c7520 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.542+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1587815221 >> 172.21.15.45:0/1587815221 conn(0x7fe7b40cfd70 msgr2=0x7fe7b40d0170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.543+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1587815221 shutdown_connections 2024-08-17T02:25:49.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.543+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1587815221 wait complete. 2024-08-17T02:25:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.544+0000 7fe7b8e00640 1 Processor -- start 2024-08-17T02:25:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.544+0000 7fe7b8e00640 1 -- start start 2024-08-17T02:25:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.545+0000 7fe7b8e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b40c3390 0x7fe7b4156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.545+0000 7fe7b8e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b40caa20 0x7fe7b416a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.545+0000 7fe7b8e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b4158e20 0x7fe7b4157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.545+0000 7fe7b8e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b415c080 con 0x7fe7b40caa20 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.545+0000 7fe7b8e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b415bac0 con 0x7fe7b40c3390 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.545+0000 7fe7b8e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b415bda0 con 0x7fe7b4158e20 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.545+0000 7fe7b1400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b40caa20 0x7fe7b416a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.545+0000 7fe7b1400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b40caa20 0x7fe7b416a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47190/0 (socket says 172.21.15.45:47190) 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.545+0000 7fe7b1400640 1 -- 172.21.15.45:0/1042583051 learned_addr learned my addr 172.21.15.45:0/1042583051 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.545+0000 7fe7b1e00640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b40c3390 0x7fe7b4156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.545+0000 7fe7b2800640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b4158e20 0x7fe7b4157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.546+0000 7fe7b1400640 1 -- 172.21.15.45:0/1042583051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b4158e20 msgr2=0x7fe7b4157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.546+0000 7fe7b1400640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b4158e20 0x7fe7b4157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.546+0000 7fe7b1400640 1 -- 172.21.15.45:0/1042583051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b40c3390 msgr2=0x7fe7b4156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.546+0000 7fe7b1400640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b40c3390 0x7fe7b4156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.546+0000 7fe7b1400640 1 -- 172.21.15.45:0/1042583051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ac009a20 con 0x7fe7b40caa20 2024-08-17T02:25:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.546+0000 7fe7b1400640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b40caa20 0x7fe7b416a240 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0005840 tx=0x7fe7a0007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.546+0000 7fe7a9600640 1 -- 172.21.15.45:0/1042583051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0005aa0 con 0x7fe7b40caa20 2024-08-17T02:25:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.546+0000 7fe7a9600640 1 -- 172.21.15.45:0/1042583051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7a0005c00 con 0x7fe7b40caa20 2024-08-17T02:25:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.546+0000 7fe7a9600640 1 -- 172.21.15.45:0/1042583051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a00070f0 con 0x7fe7b40caa20 2024-08-17T02:25:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.546+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1042583051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b4159390 con 0x7fe7b40caa20 2024-08-17T02:25:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.547+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1042583051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b4157110 con 0x7fe7b40caa20 2024-08-17T02:25:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.547+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1042583051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7b41591f0 con 0x7fe7b40caa20 2024-08-17T02:25:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.548+0000 7fe7a9600640 1 -- 172.21.15.45:0/1042583051 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe7a0007520 con 0x7fe7b40caa20 2024-08-17T02:25:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.549+0000 7fe7a9600640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe794065150 0x7fe794067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.549+0000 7fe7a9600640 1 -- 172.21.15.45:0/1042583051 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7a0081f10 con 0x7fe7b40caa20 2024-08-17T02:25:49.550 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.549+0000 7fe7b1e00640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe794065150 0x7fe794067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.550+0000 7fe7b1e00640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe794065150 0x7fe794067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe7b416c5d0 tx=0x7fe7a4007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.553+0000 7fe7a9600640 1 -- 172.21.15.45:0/1042583051 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe7b41591f0 con 0x7fe7b40caa20 2024-08-17T02:25:49.735 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.734+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1042583051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe7b41591f0 con 0x7fe7b40caa20 2024-08-17T02:25:49.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.735+0000 7fe7a9600640 1 -- 172.21.15.45:0/1042583051 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe7b41591f0 con 0x7fe7b40caa20 2024-08-17T02:25:49.736 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:25:49.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1042583051 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe794065150 msgr2=0x7fe794067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe794065150 0x7fe794067600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe7b416c5d0 tx=0x7fe7a4007cc0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1042583051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b40caa20 msgr2=0x7fe7b416a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b40caa20 0x7fe7b416a240 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0005840 tx=0x7fe7a0007e10 comp rx=0 tx=0).stop 2024-08-17T02:25:49.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1042583051 shutdown_connections 2024-08-17T02:25:49.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe794065150 0x7fe794067600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe7b4158e20 0x7fe7b4157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7b40caa20 0x7fe7b416a240 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 --2- 172.21.15.45:0/1042583051 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe7b40c3390 0x7fe7b4156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1042583051 >> 172.21.15.45:0/1042583051 conn(0x7fe7b40cfd70 msgr2=0x7fe7b40c8210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1042583051 shutdown_connections 2024-08-17T02:25:49.739 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.737+0000 7fe7b8e00640 1 -- 172.21.15.45:0/1042583051 wait complete. 2024-08-17T02:25:49.752 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.906+0000 7f6404000640 1 Processor -- start 2024-08-17T02:25:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.906+0000 7f6404000640 1 -- start start 2024-08-17T02:25:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.907+0000 7f6404000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f63fc156c50 0x7f63fc0c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.907+0000 7f6404000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63fc0c8bd0 0x7f63fc0c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.907+0000 7f6404000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63fc0ab130 con 0x7f63fc0adcf0 2024-08-17T02:25:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.907+0000 7f6404000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc0c9530 con 0x7f63fc0c8bd0 2024-08-17T02:25:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.907+0000 7f6404000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63fc0ae5a0 con 0x7f63fc156c50 2024-08-17T02:25:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.907+0000 7f6402000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63fc0c8bd0 0x7f63fc0c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.907+0000 7f6402000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63fc0c8bd0 0x7f63fc0c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47198/0 (socket says 172.21.15.45:47198) 2024-08-17T02:25:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.907+0000 7f6402000640 1 -- 172.21.15.45:0/3197769424 learned_addr learned my addr 172.21.15.45:0/3197769424 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.907+0000 7f6400c00640 1 --1- 172.21.15.45:0/3197769424 >> v1:172.21.15.45:6789/0 conn(0x7f63fc0adcf0 0x7f63fc0ab5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46390/0 (socket says 172.21.15.45:46390) 2024-08-17T02:25:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.908+0000 7f6401600640 1 --2- 172.21.15.45:0/3197769424 >> v2:172.21.15.169:3300/0 conn(0x7f63fc156c50 0x7f63fc0c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.908+0000 7f6402000640 1 -- 172.21.15.45:0/3197769424 >> v2:172.21.15.169:3300/0 conn(0x7f63fc156c50 msgr2=0x7f63fc0c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.908+0000 7f6402000640 1 --2- 172.21.15.45:0/3197769424 >> v2:172.21.15.169:3300/0 conn(0x7f63fc156c50 0x7f63fc0c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.908+0000 7f6402000640 1 -- 172.21.15.45:0/3197769424 >> v1:172.21.15.45:6789/0 conn(0x7f63fc0adcf0 legacy=0x7f63fc0ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.908+0000 7f6402000640 1 -- 172.21.15.45:0/3197769424 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc0ae2c0 con 0x7f63fc0c8bd0 2024-08-17T02:25:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.909+0000 7f6402000640 1 --2- 172.21.15.45:0/3197769424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc0c8bd0 0x7f63fc0c8ff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f63fc06efd0 tx=0x7f63f4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae9c6601016abf96 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.909+0000 7f63fbe00640 1 -- 172.21.15.45:0/3197769424 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f4031400 con 0x7f63fc0c8bd0 2024-08-17T02:25:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.909+0000 7f63fbe00640 1 -- 172.21.15.45:0/3197769424 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f402d050 con 0x7f63fc0c8bd0 2024-08-17T02:25:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.909+0000 7f63fbe00640 1 -- 172.21.15.45:0/3197769424 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f40317d0 con 0x7f63fc0c8bd0 2024-08-17T02:25:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.910+0000 7f6404000640 1 -- 172.21.15.45:0/3197769424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc0c8bd0 msgr2=0x7f63fc0c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.910+0000 7f6404000640 1 --2- 172.21.15.45:0/3197769424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc0c8bd0 0x7f63fc0c8ff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f63fc06efd0 tx=0x7f63f4009840 comp rx=0 tx=0).stop 2024-08-17T02:25:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.910+0000 7f6404000640 1 -- 172.21.15.45:0/3197769424 shutdown_connections 2024-08-17T02:25:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.910+0000 7f6404000640 1 --2- 172.21.15.45:0/3197769424 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc0c8bd0 0x7f63fc0c8ff0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.910+0000 7f6404000640 1 --2- 172.21.15.45:0/3197769424 >> v2:172.21.15.169:3300/0 conn(0x7f63fc156c50 0x7f63fc0c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.910+0000 7f6404000640 1 -- 172.21.15.45:0/3197769424 >> 172.21.15.45:0/3197769424 conn(0x7f63fc067750 msgr2=0x7f63fc0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.910+0000 7f6404000640 1 -- 172.21.15.45:0/3197769424 shutdown_connections 2024-08-17T02:25:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.910+0000 7f6404000640 1 -- 172.21.15.45:0/3197769424 wait complete. 2024-08-17T02:25:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.911+0000 7f6404000640 1 Processor -- start 2024-08-17T02:25:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.911+0000 7f6404000640 1 -- start start 2024-08-17T02:25:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.912+0000 7f6404000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc0adcf0 0x7f63fc0aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.912+0000 7f6404000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63fc0c8bd0 0x7f63fc06c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.912+0000 7f6404000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63fc156c50 0x7f63fc157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.912+0000 7f6404000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc0aa660 con 0x7f63fc0adcf0 2024-08-17T02:25:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.912+0000 7f6404000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc16c540 con 0x7f63fc156c50 2024-08-17T02:25:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.912+0000 7f6404000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc159480 con 0x7f63fc0c8bd0 2024-08-17T02:25:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.912+0000 7f6401600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc0adcf0 0x7f63fc0aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.912+0000 7f6401600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc0adcf0 0x7f63fc0aa120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47204/0 (socket says 172.21.15.45:47204) 2024-08-17T02:25:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.912+0000 7f6401600640 1 -- 172.21.15.45:0/4041785940 learned_addr learned my addr 172.21.15.45:0/4041785940 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.913+0000 7f6402000640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63fc156c50 0x7f63fc157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.913+0000 7f6400c00640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63fc0c8bd0 0x7f63fc06c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.913+0000 7f6401600640 1 -- 172.21.15.45:0/4041785940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63fc0c8bd0 msgr2=0x7f63fc06c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.913+0000 7f6401600640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63fc0c8bd0 0x7f63fc06c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.913+0000 7f6401600640 1 -- 172.21.15.45:0/4041785940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63fc156c50 msgr2=0x7f63fc157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.913+0000 7f6401600640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63fc156c50 0x7f63fc157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.913+0000 7f6401600640 1 -- 172.21.15.45:0/4041785940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f4009ae0 con 0x7f63fc0adcf0 2024-08-17T02:25:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.913+0000 7f6401600640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc0adcf0 0x7f63fc0aa120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f63f000e900 tx=0x7f63f00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.913+0000 7f63f8c00640 1 -- 172.21.15.45:0/4041785940 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f000c8e0 con 0x7f63fc0adcf0 2024-08-17T02:25:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.914+0000 7f63f8c00640 1 -- 172.21.15.45:0/4041785940 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63f000ca40 con 0x7f63fc0adcf0 2024-08-17T02:25:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.914+0000 7f6404000640 1 -- 172.21.15.45:0/4041785940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc159760 con 0x7f63fc0adcf0 2024-08-17T02:25:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.914+0000 7f63f8c00640 1 -- 172.21.15.45:0/4041785940 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63f000cde0 con 0x7f63fc0adcf0 2024-08-17T02:25:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.914+0000 7f6404000640 1 -- 172.21.15.45:0/4041785940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc159da0 con 0x7f63fc0adcf0 2024-08-17T02:25:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.915+0000 7f6404000640 1 -- 172.21.15.45:0/4041785940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc1591e0 con 0x7f63fc0adcf0 2024-08-17T02:25:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.916+0000 7f63f8c00640 1 -- 172.21.15.45:0/4041785940 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f63f0013680 con 0x7f63fc0adcf0 2024-08-17T02:25:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.916+0000 7f63f8c00640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63dc065150 0x7f63dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.916+0000 7f63f8c00640 1 -- 172.21.15.45:0/4041785940 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63f00825c0 con 0x7f63fc0adcf0 2024-08-17T02:25:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.917+0000 7f6400c00640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63dc065150 0x7f63dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.917+0000 7f6400c00640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63dc065150 0x7f63dc067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0ace40 tx=0x7f63e8007e20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:49.920+0000 7f63f8c00640 1 -- 172.21.15.45:0/4041785940 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f63f0050730 con 0x7f63fc0adcf0 2024-08-17T02:25:50.101 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.100+0000 7f6404000640 1 -- 172.21.15.45:0/4041785940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63fc071050 con 0x7f63fc0adcf0 2024-08-17T02:25:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.101+0000 7f63f8c00640 1 -- 172.21.15.45:0/4041785940 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63f0053d50 con 0x7f63fc0adcf0 2024-08-17T02:25:50.102 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-08-17T02:25:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 -- 172.21.15.45:0/4041785940 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63dc065150 msgr2=0x7f63dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63dc065150 0x7f63dc067600 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f63fc0ace40 tx=0x7f63e8007e20 comp rx=0 tx=0).stop 2024-08-17T02:25:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 -- 172.21.15.45:0/4041785940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc0adcf0 msgr2=0x7f63fc0aa120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc0adcf0 0x7f63fc0aa120 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f63f000e900 tx=0x7f63f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 -- 172.21.15.45:0/4041785940 shutdown_connections 2024-08-17T02:25:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63fc156c50 0x7f63fc157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.104 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63dc065150 0x7f63dc067600 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63fc0c8bd0 0x7f63fc06c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 --2- 172.21.15.45:0/4041785940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63fc0adcf0 0x7f63fc0aa120 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 -- 172.21.15.45:0/4041785940 >> 172.21.15.45:0/4041785940 conn(0x7f63fc067750 msgr2=0x7f63fc0aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 -- 172.21.15.45:0/4041785940 shutdown_connections 2024-08-17T02:25:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.103+0000 7f6404000640 1 -- 172.21.15.45:0/4041785940 wait complete. 2024-08-17T02:25:50.119 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:25:50.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.269+0000 7f4b2ce00640 1 Processor -- start 2024-08-17T02:25:50.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.269+0000 7f4b2ce00640 1 -- start start 2024-08-17T02:25:50.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.270+0000 7f4b2ce00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4b280b0270 0x7f4b281563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.270+0000 7f4b2ce00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b28158b30 0x7f4b280ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.270+0000 7f4b2ce00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b28157690 con 0x7f4b28155900 2024-08-17T02:25:50.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.270+0000 7f4b2ce00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b28156a80 con 0x7f4b280b0270 2024-08-17T02:25:50.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.270+0000 7f4b2ce00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b28156d60 con 0x7f4b28158b30 2024-08-17T02:25:50.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.270+0000 7f4b27400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4b28155900 0x7f4b28155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46398/0 (socket says 172.21.15.45:46398) 2024-08-17T02:25:50.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.270+0000 7f4b27400640 1 -- 172.21.15.45:0/2354391305 learned_addr learned my addr 172.21.15.45:0/2354391305 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:50.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.271+0000 7f4b27e00640 1 --2- 172.21.15.45:0/2354391305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b28158b30 0x7f4b280ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.271+0000 7f4b1ea00640 1 --2- 172.21.15.45:0/2354391305 >> v2:172.21.15.169:3300/0 conn(0x7f4b280b0270 0x7f4b281563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.271+0000 7f4b26a00640 1 -- 172.21.15.45:0/2354391305 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069044384 0 0) 0x7f4b28157690 con 0x7f4b28155900 2024-08-17T02:25:50.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.271+0000 7f4b26a00640 1 -- 172.21.15.45:0/2354391305 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b0c0034e0 con 0x7f4b28155900 2024-08-17T02:25:50.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.271+0000 7f4b26a00640 1 -- 172.21.15.45:0/2354391305 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2242995238 0 0) 0x7f4b0c0034e0 con 0x7f4b28155900 2024-08-17T02:25:50.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.271+0000 7f4b27e00640 1 -- 172.21.15.45:0/2354391305 >> v2:172.21.15.169:3300/0 conn(0x7f4b280b0270 msgr2=0x7f4b281563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:50.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.271+0000 7f4b27e00640 1 --2- 172.21.15.45:0/2354391305 >> v2:172.21.15.169:3300/0 conn(0x7f4b280b0270 0x7f4b281563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.271+0000 7f4b27e00640 1 -- 172.21.15.45:0/2354391305 >> v1:172.21.15.45:6789/0 conn(0x7f4b28155900 legacy=0x7f4b28155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.271+0000 7f4b27e00640 1 -- 172.21.15.45:0/2354391305 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b28157040 con 0x7f4b28158b30 2024-08-17T02:25:50.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.272+0000 7f4b27e00640 1 --2- 172.21.15.45:0/2354391305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b28158b30 0x7f4b280ae6b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009e60 tx=0x7f4b20009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ea5287aff7557b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.273+0000 7f4b26a00640 1 -- 172.21.15.45:0/2354391305 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b18001470 con 0x7f4b28158b30 2024-08-17T02:25:50.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.273+0000 7f4b26a00640 1 -- 172.21.15.45:0/2354391305 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b2002d050 con 0x7f4b28158b30 2024-08-17T02:25:50.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.273+0000 7f4b26a00640 1 -- 172.21.15.45:0/2354391305 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20031630 con 0x7f4b28158b30 2024-08-17T02:25:50.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.273+0000 7f4b2ce00640 1 -- 172.21.15.45:0/2354391305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b28158b30 msgr2=0x7f4b280ae6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.273+0000 7f4b2ce00640 1 --2- 172.21.15.45:0/2354391305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b28158b30 0x7f4b280ae6b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4b20009e60 tx=0x7f4b20009780 comp rx=0 tx=0).stop 2024-08-17T02:25:50.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.273+0000 7f4b2ce00640 1 -- 172.21.15.45:0/2354391305 shutdown_connections 2024-08-17T02:25:50.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.273+0000 7f4b2ce00640 1 --2- 172.21.15.45:0/2354391305 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b28158b30 0x7f4b280ae6b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.273+0000 7f4b2ce00640 1 --2- 172.21.15.45:0/2354391305 >> v2:172.21.15.169:3300/0 conn(0x7f4b280b0270 0x7f4b281563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.273+0000 7f4b2ce00640 1 -- 172.21.15.45:0/2354391305 >> 172.21.15.45:0/2354391305 conn(0x7f4b28067750 msgr2=0x7f4b280cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:50.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.273+0000 7f4b2ce00640 1 -- 172.21.15.45:0/2354391305 shutdown_connections 2024-08-17T02:25:50.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.273+0000 7f4b2ce00640 1 -- 172.21.15.45:0/2354391305 wait complete. 2024-08-17T02:25:50.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.275+0000 7f4b2ce00640 1 Processor -- start 2024-08-17T02:25:50.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.275+0000 7f4b2ce00640 1 -- start start 2024-08-17T02:25:50.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b2ce00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b280b0270 0x7f4b280c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b2ce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b28155900 0x7f4b280c0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b2ce00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28158b30 0x7f4b280c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b2ce00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280c2ae0 con 0x7f4b28155900 2024-08-17T02:25:50.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b2ce00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280c7480 con 0x7f4b28158b30 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b2ce00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b280c10f0 con 0x7f4b280b0270 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b1ea00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b28155900 0x7f4b280c0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b1ea00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b28155900 0x7f4b280c0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47218/0 (socket says 172.21.15.45:47218) 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b1ea00640 1 -- 172.21.15.45:0/1213947725 learned_addr learned my addr 172.21.15.45:0/1213947725 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b27400640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b280b0270 0x7f4b280c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b27e00640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28158b30 0x7f4b280c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b1ea00640 1 -- 172.21.15.45:0/1213947725 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b280b0270 msgr2=0x7f4b280c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b1ea00640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b280b0270 0x7f4b280c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b1ea00640 1 -- 172.21.15.45:0/1213947725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28158b30 msgr2=0x7f4b280c9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b1ea00640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28158b30 0x7f4b280c9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b1ea00640 1 -- 172.21.15.45:0/1213947725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b20009a20 con 0x7f4b28155900 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b27400640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b280b0270 0x7f4b280c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:50.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.276+0000 7f4b27e00640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28158b30 0x7f4b280c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:50.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.277+0000 7f4b1ea00640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b28155900 0x7f4b280c0630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000ea20 tx=0x7f4b100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.277+0000 7f4b1f400640 1 -- 172.21.15.45:0/1213947725 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b1000caa0 con 0x7f4b28155900 2024-08-17T02:25:50.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.277+0000 7f4b1f400640 1 -- 172.21.15.45:0/1213947725 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b1000cc00 con 0x7f4b28155900 2024-08-17T02:25:50.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.277+0000 7f4b2ce00640 1 -- 172.21.15.45:0/1213947725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b280c13d0 con 0x7f4b28155900 2024-08-17T02:25:50.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.277+0000 7f4b1f400640 1 -- 172.21.15.45:0/1213947725 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b10013470 con 0x7f4b28155900 2024-08-17T02:25:50.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.277+0000 7f4b2ce00640 1 -- 172.21.15.45:0/1213947725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b280c1e30 con 0x7f4b28155900 2024-08-17T02:25:50.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.278+0000 7f4b2ce00640 1 -- 172.21.15.45:0/1213947725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b280c25b0 con 0x7f4b28155900 2024-08-17T02:25:50.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.279+0000 7f4b1f400640 1 -- 172.21.15.45:0/1213947725 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4b10013860 con 0x7f4b28155900 2024-08-17T02:25:50.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.280+0000 7f4b1f400640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4b04065150 0x7f4b04067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.280+0000 7f4b1f400640 1 -- 172.21.15.45:0/1213947725 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b10082880 con 0x7f4b28155900 2024-08-17T02:25:50.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.280+0000 7f4b27400640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4b04065150 0x7f4b04067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.280+0000 7f4b27400640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4b04065150 0x7f4b04067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4b180011e0 tx=0x7f4b18001aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.284+0000 7f4b1f400640 1 -- 172.21.15.45:0/1213947725 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4b100508a0 con 0x7f4b28155900 2024-08-17T02:25:50.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.531+0000 7f4b2ce00640 1 -- 172.21.15.45:0/1213947725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f4b280c15c0 con 0x7f4b28155900 2024-08-17T02:25:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.813+0000 7f4b1f400640 1 -- 172.21.15.45:0/1213947725 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v56) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4b10053ec0 con 0x7f4b28155900 2024-08-17T02:25:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 -- 172.21.15.45:0/1213947725 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4b04065150 msgr2=0x7f4b04067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4b04065150 0x7f4b04067600 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4b180011e0 tx=0x7f4b18001aa0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 -- 172.21.15.45:0/1213947725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b28155900 msgr2=0x7f4b280c0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b28155900 0x7f4b280c0630 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4b1000ea20 tx=0x7f4b100090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 -- 172.21.15.45:0/1213947725 shutdown_connections 2024-08-17T02:25:50.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4b28158b30 0x7f4b280c9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b28155900 0x7f4b280c0630 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4b04065150 0x7f4b04067600 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 --2- 172.21.15.45:0/1213947725 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4b280b0270 0x7f4b280c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 -- 172.21.15.45:0/1213947725 >> 172.21.15.45:0/1213947725 conn(0x7f4b28067750 msgr2=0x7f4b281518c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:50.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 -- 172.21.15.45:0/1213947725 shutdown_connections 2024-08-17T02:25:50.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.815+0000 7f4b2ce00640 1 -- 172.21.15.45:0/1213947725 wait complete. 2024-08-17T02:25:50.831 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:25:50.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.984+0000 7f73f9000640 1 Processor -- start 2024-08-17T02:25:50.985 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.984+0000 7f73f9000640 1 -- start start 2024-08-17T02:25:50.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.985+0000 7f73f9000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f4155a80 0x7f73f406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.985+0000 7f73f9000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f73f40c7db0 0x7f73f40c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.985+0000 7f73f9000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73f41598f0 con 0x7f73f4155e50 2024-08-17T02:25:50.986 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.985+0000 7f73f9000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73f4159bd0 con 0x7f73f40c7db0 2024-08-17T02:25:50.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.985+0000 7f73f9000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f4159eb0 con 0x7f73f4155a80 2024-08-17T02:25:50.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.986+0000 7f73ebe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f73f40c7db0 0x7f73f40c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.986+0000 7f73ebe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f73f40c7db0 0x7f73f40c8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:60622/0 (socket says 172.21.15.45:60622) 2024-08-17T02:25:50.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.986+0000 7f73ebe00640 1 -- 172.21.15.45:0/1753689029 learned_addr learned my addr 172.21.15.45:0/1753689029 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.986+0000 7f73f1e00640 1 --2- 172.21.15.45:0/1753689029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f4155a80 0x7f73f406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.987+0000 7f73ebe00640 1 -- 172.21.15.45:0/1753689029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f4155a80 msgr2=0x7f73f406dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.987+0000 7f73ebe00640 1 --2- 172.21.15.45:0/1753689029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f4155a80 0x7f73f406dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.987+0000 7f73ebe00640 1 -- 172.21.15.45:0/1753689029 >> v1:172.21.15.169:6789/0 conn(0x7f73f4155e50 legacy=0x7f73f406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.987+0000 7f73ebe00640 1 -- 172.21.15.45:0/1753689029 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f415a190 con 0x7f73f40c7db0 2024-08-17T02:25:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.988+0000 7f73ebe00640 1 --2- 172.21.15.45:0/1753689029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f40c7db0 0x7f73f40c8bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009910 tx=0x7f73dc0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adafd49eaea350aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.988+0000 7f73f1400640 1 -- 172.21.15.45:0/1753689029 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc02ae40 con 0x7f73f40c7db0 2024-08-17T02:25:50.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.988+0000 7f73f1400640 1 -- 172.21.15.45:0/1753689029 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc032440 con 0x7f73f40c7db0 2024-08-17T02:25:50.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.988+0000 7f73f1400640 1 -- 172.21.15.45:0/1753689029 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc032820 con 0x7f73f40c7db0 2024-08-17T02:25:50.989 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.988+0000 7f73f9000640 1 -- 172.21.15.45:0/1753689029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f40c7db0 msgr2=0x7f73f40c8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.988+0000 7f73f9000640 1 --2- 172.21.15.45:0/1753689029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f40c7db0 0x7f73f40c8bd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009910 tx=0x7f73dc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.989+0000 7f73f9000640 1 -- 172.21.15.45:0/1753689029 shutdown_connections 2024-08-17T02:25:50.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.989+0000 7f73f9000640 1 --2- 172.21.15.45:0/1753689029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f40c7db0 0x7f73f40c8bd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.989+0000 7f73f9000640 1 --2- 172.21.15.45:0/1753689029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f4155a80 0x7f73f406dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.989+0000 7f73f9000640 1 -- 172.21.15.45:0/1753689029 >> 172.21.15.45:0/1753689029 conn(0x7f73f4067750 msgr2=0x7f73f40c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:50.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.989+0000 7f73f9000640 1 -- 172.21.15.45:0/1753689029 shutdown_connections 2024-08-17T02:25:50.990 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.989+0000 7f73f9000640 1 -- 172.21.15.45:0/1753689029 wait complete. 2024-08-17T02:25:50.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.990+0000 7f73f9000640 1 Processor -- start 2024-08-17T02:25:50.991 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.990+0000 7f73f9000640 1 -- start start 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.991+0000 7f73f9000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f40c7db0 0x7f73f4146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.991+0000 7f73f9000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f4155a80 0x7f73f4146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.991+0000 7f73f9000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f4155e50 0x7f73f4147740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.991+0000 7f73f9000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f4156c60 con 0x7f73f40c7db0 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.991+0000 7f73f9000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f416dee0 con 0x7f73f4155e50 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.991+0000 7f73f9000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73f4158af0 con 0x7f73f4155a80 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.991+0000 7f73f1e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f40c7db0 0x7f73f4146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73f1e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f40c7db0 0x7f73f4146860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47234/0 (socket says 172.21.15.45:47234) 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73f1e00640 1 -- 172.21.15.45:0/448749918 learned_addr learned my addr 172.21.15.45:0/448749918 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73f2800640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f4155e50 0x7f73f4147740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73ebe00640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f4155a80 0x7f73f4146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73f1e00640 1 -- 172.21.15.45:0/448749918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f4155a80 msgr2=0x7f73f4146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73f1e00640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f4155a80 0x7f73f4146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73f1e00640 1 -- 172.21.15.45:0/448749918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f4155e50 msgr2=0x7f73f4147740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73f1e00640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f4155e50 0x7f73f4147740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73f1e00640 1 -- 172.21.15.45:0/448749918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc009450 con 0x7f73f40c7db0 2024-08-17T02:25:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73f2800640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f4155e50 0x7f73f4147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:50.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73f1e00640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f40c7db0 0x7f73f4146860 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f73e400ea20 tx=0x7f73e40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73e9600640 1 -- 172.21.15.45:0/448749918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e400ca10 con 0x7f73f40c7db0 2024-08-17T02:25:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73e9600640 1 -- 172.21.15.45:0/448749918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e400cb70 con 0x7f73f40c7db0 2024-08-17T02:25:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73e9600640 1 -- 172.21.15.45:0/448749918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e4013470 con 0x7f73f40c7db0 2024-08-17T02:25:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.992+0000 7f73f9000640 1 -- 172.21.15.45:0/448749918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f4158dd0 con 0x7f73f40c7db0 2024-08-17T02:25:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.993+0000 7f73f9000640 1 -- 172.21.15.45:0/448749918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f41465d0 con 0x7f73f40c7db0 2024-08-17T02:25:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.994+0000 7f73f9000640 1 -- 172.21.15.45:0/448749918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f4071050 con 0x7f73f40c7db0 2024-08-17T02:25:50.995 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.995+0000 7f73e9600640 1 -- 172.21.15.45:0/448749918 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f73e4013860 con 0x7f73f40c7db0 2024-08-17T02:25:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.995+0000 7f73e9600640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065220 0x7f73d00676d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.995+0000 7f73e9600640 1 -- 172.21.15.45:0/448749918 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f73e4082780 con 0x7f73f40c7db0 2024-08-17T02:25:50.996 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.996+0000 7f73ebe00640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065220 0x7f73d00676d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:50.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.996+0000 7f73ebe00640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065220 0x7f73d00676d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f73dc034000 tx=0x7f73dc032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:50.999+0000 7f73e9600640 1 -- 172.21.15.45:0/448749918 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f73e4050820 con 0x7f73f40c7db0 2024-08-17T02:25:51.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.181+0000 7f73f9000640 1 -- 172.21.15.45:0/448749918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f73f414bb30 con 0x7f73f40c7db0 2024-08-17T02:25:51.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.185+0000 7f73e9600640 1 -- 172.21.15.45:0/448749918 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f73e4053e40 con 0x7f73f40c7db0 2024-08-17T02:25:51.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 -- 172.21.15.45:0/448749918 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065220 msgr2=0x7f73d00676d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065220 0x7f73d00676d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f73dc034000 tx=0x7f73dc032000 comp rx=0 tx=0).stop 2024-08-17T02:25:51.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 -- 172.21.15.45:0/448749918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f40c7db0 msgr2=0x7f73f4146860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f40c7db0 0x7f73f4146860 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f73e400ea20 tx=0x7f73e40090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 -- 172.21.15.45:0/448749918 shutdown_connections 2024-08-17T02:25:51.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f73f4155e50 0x7f73f4147740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f73d0065220 0x7f73d00676d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f73f4155a80 0x7f73f4146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 --2- 172.21.15.45:0/448749918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73f40c7db0 0x7f73f4146860 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 -- 172.21.15.45:0/448749918 >> 172.21.15.45:0/448749918 conn(0x7f73f4067750 msgr2=0x7f73f4152500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:51.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 -- 172.21.15.45:0/448749918 shutdown_connections 2024-08-17T02:25:51.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.187+0000 7f73f9000640 1 -- 172.21.15.45:0/448749918 wait complete. 2024-08-17T02:25:51.203 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:25:51.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:25:51.292 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:25:51.394 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:25:51.395 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:25:51.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:51.395 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-08-17T02:25:51.456 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:25:51.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:51.456 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:25:51.499 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:25:51.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:51.499 DEBUG:teuthology.orchestra.run.smithi169:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-08-17T02:25:51.563 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:25:51.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:51.564 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:25:51.610 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-08-17T02:25:51.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:51.611 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-08-17T02:25:51.671 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:25:51.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:51.671 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-08-17T02:25:51.708 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-08-17T02:25:51.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:25:51.708 DEBUG:teuthology.orchestra.run.smithi169:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-08-17T02:25:51.768 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:25:51.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:25:51.768 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-08-17T02:25:51.804 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-08-17T02:25:51.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:51.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.955+0000 7fb920e00640 1 Processor -- start 2024-08-17T02:25:51.956 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.955+0000 7fb920e00640 1 -- start start 2024-08-17T02:25:51.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.956+0000 7fb920e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb91c0b1440 0x7fb91c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.956+0000 7fb920e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb91c140580 0x7fb91c0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.956+0000 7fb920e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb91c0caa80 con 0x7fb91c1401b0 2024-08-17T02:25:51.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.956+0000 7fb920e00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb91c0cb450 con 0x7fb91c0b1440 2024-08-17T02:25:51.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.956+0000 7fb920e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0c9e70 con 0x7fb91c140580 2024-08-17T02:25:51.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.957+0000 7fb919e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb91c1401b0 0x7fb91c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54416/0 (socket says 172.21.15.45:54416) 2024-08-17T02:25:51.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.957+0000 7fb919e00640 1 -- 172.21.15.45:0/213999634 learned_addr learned my addr 172.21.15.45:0/213999634 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:51.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.957+0000 7fb913e00640 1 --2- 172.21.15.45:0/213999634 >> v2:172.21.15.169:3300/0 conn(0x7fb91c0b1440 0x7fb91c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.957+0000 7fb91a800640 1 --2- 172.21.15.45:0/213999634 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb91c140580 0x7fb91c0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.957+0000 7fb919400640 1 -- 172.21.15.45:0/213999634 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788356898 0 0) 0x7fb91c0caa80 con 0x7fb91c1401b0 2024-08-17T02:25:51.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.957+0000 7fb919400640 1 -- 172.21.15.45:0/213999634 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9000034e0 con 0x7fb91c1401b0 2024-08-17T02:25:51.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.957+0000 7fb913e00640 1 -- 172.21.15.45:0/213999634 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb91c140580 msgr2=0x7fb91c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:51.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.957+0000 7fb913e00640 1 --2- 172.21.15.45:0/213999634 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb91c140580 0x7fb91c0c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.957+0000 7fb913e00640 1 -- 172.21.15.45:0/213999634 >> v1:172.21.15.45:6789/0 conn(0x7fb91c1401b0 legacy=0x7fb91c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.957+0000 7fb913e00640 1 -- 172.21.15.45:0/213999634 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c0ca150 con 0x7fb91c0b1440 2024-08-17T02:25:51.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.959+0000 7fb913e00640 1 --2- 172.21.15.45:0/213999634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c0b1440 0x7fb91c0caf10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb904009850 tx=0x7fb9040090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7ef3e585812bd11 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.959+0000 7fb919400640 1 -- 172.21.15.45:0/213999634 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90402ad90 con 0x7fb91c0b1440 2024-08-17T02:25:51.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.959+0000 7fb919400640 1 -- 172.21.15.45:0/213999634 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb904032440 con 0x7fb91c0b1440 2024-08-17T02:25:51.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.959+0000 7fb919400640 1 -- 172.21.15.45:0/213999634 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb904032820 con 0x7fb91c0b1440 2024-08-17T02:25:51.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.959+0000 7fb920e00640 1 -- 172.21.15.45:0/213999634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c0b1440 msgr2=0x7fb91c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.959+0000 7fb920e00640 1 --2- 172.21.15.45:0/213999634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c0b1440 0x7fb91c0caf10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb904009850 tx=0x7fb9040090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.960+0000 7fb920e00640 1 -- 172.21.15.45:0/213999634 shutdown_connections 2024-08-17T02:25:51.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.960+0000 7fb920e00640 1 --2- 172.21.15.45:0/213999634 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb91c140580 0x7fb91c0c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.960+0000 7fb920e00640 1 --2- 172.21.15.45:0/213999634 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c0b1440 0x7fb91c0caf10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.960+0000 7fb920e00640 1 -- 172.21.15.45:0/213999634 >> 172.21.15.45:0/213999634 conn(0x7fb91c0cb9b0 msgr2=0x7fb91c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:51.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.960+0000 7fb920e00640 1 -- 172.21.15.45:0/213999634 shutdown_connections 2024-08-17T02:25:51.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.960+0000 7fb920e00640 1 -- 172.21.15.45:0/213999634 wait complete. 2024-08-17T02:25:51.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.961+0000 7fb920e00640 1 Processor -- start 2024-08-17T02:25:51.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.961+0000 7fb920e00640 1 -- start start 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.962+0000 7fb920e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb91c0b1440 0x7fb91c169af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.962+0000 7fb920e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c1401b0 0x7fb91c13dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.962+0000 7fb920e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb91c140580 0x7fb91c0c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.962+0000 7fb920e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0c2ad0 con 0x7fb91c0b1440 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.962+0000 7fb920e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c16a030 con 0x7fb91c1401b0 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.962+0000 7fb920e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91c0c2220 con 0x7fb91c140580 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.962+0000 7fb919e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb91c0b1440 0x7fb91c169af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.962+0000 7fb919e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb91c0b1440 0x7fb91c169af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36938/0 (socket says 172.21.15.45:36938) 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.962+0000 7fb919e00640 1 -- 172.21.15.45:0/3907807517 learned_addr learned my addr 172.21.15.45:0/3907807517 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.962+0000 7fb913e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c1401b0 0x7fb91c13dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb91a800640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb91c140580 0x7fb91c0c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb919e00640 1 -- 172.21.15.45:0/3907807517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb91c140580 msgr2=0x7fb91c0c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb919e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb91c140580 0x7fb91c0c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb919e00640 1 -- 172.21.15.45:0/3907807517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c1401b0 msgr2=0x7fb91c13dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:51.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb919e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c1401b0 0x7fb91c13dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:51.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb919e00640 1 -- 172.21.15.45:0/3907807517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb904009390 con 0x7fb91c0b1440 2024-08-17T02:25:51.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb913e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c1401b0 0x7fb91c13dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:51.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb919e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb91c0b1440 0x7fb91c169af0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00c5e0 tx=0x7fb90c007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb911600640 1 -- 172.21.15.45:0/3907807517 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c005b70 con 0x7fb91c0b1440 2024-08-17T02:25:51.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb911600640 1 -- 172.21.15.45:0/3907807517 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb90c005cf0 con 0x7fb91c0b1440 2024-08-17T02:25:51.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb911600640 1 -- 172.21.15.45:0/3907807517 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90c005ea0 con 0x7fb91c0b1440 2024-08-17T02:25:51.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.963+0000 7fb920e00640 1 -- 172.21.15.45:0/3907807517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb91c0c0fa0 con 0x7fb91c0b1440 2024-08-17T02:25:51.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.964+0000 7fb920e00640 1 -- 172.21.15.45:0/3907807517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb91c0c3000 con 0x7fb91c0b1440 2024-08-17T02:25:51.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.965+0000 7fb920e00640 1 -- 172.21.15.45:0/3907807517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91c064db0 con 0x7fb91c0b1440 2024-08-17T02:25:51.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.965+0000 7fb911600640 1 -- 172.21.15.45:0/3907807517 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb90c01b400 con 0x7fb91c0b1440 2024-08-17T02:25:51.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.966+0000 7fb911600640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb8f8065150 0x7fb8f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:51.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.966+0000 7fb911600640 1 -- 172.21.15.45:0/3907807517 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb90c081df0 con 0x7fb91c0b1440 2024-08-17T02:25:51.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.967+0000 7fb913e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb8f8065150 0x7fb8f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:51.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.967+0000 7fb913e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb8f8065150 0x7fb8f8067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb904034000 tx=0x7fb904032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:51.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:51.970+0000 7fb911600640 1 -- 172.21.15.45:0/3907807517 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb90c04ff40 con 0x7fb91c0b1440 2024-08-17T02:25:52.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.190+0000 7fb920e00640 1 -- 172.21.15.45:0/3907807517 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb91c06d090 con 0x7fb91c0b1440 2024-08-17T02:25:52.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.190+0000 7fb911600640 1 -- 172.21.15.45:0/3907807517 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fb90c053560 con 0x7fb91c0b1440 2024-08-17T02:25:52.191 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:52.191 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1637538519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1637538519},{"type":"v1","addr":"172.21.15.45:6837","nonce":1637538519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1027153973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1027153973},{"type":"v1","addr":"172.21.15.169:6835","nonce":1027153973}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2482387224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2482387224},{"type":"v1","addr":"172.21.15.45:6835","nonce":2482387224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:14.095016+0000","modified":"2024-08-17T02:25:17.687006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6834/911178485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":911178485},{"type":"v1","addr":"172.21.15.169:6834","nonce":911178485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:52.192 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2024-08-17T02:25:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 -- 172.21.15.45:0/3907807517 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb8f8065150 msgr2=0x7fb8f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb8f8065150 0x7fb8f8067600 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb904034000 tx=0x7fb904032000 comp rx=0 tx=0).stop 2024-08-17T02:25:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 -- 172.21.15.45:0/3907807517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb91c0b1440 msgr2=0x7fb91c169af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb91c0b1440 0x7fb91c169af0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb90c00c5e0 tx=0x7fb90c007d70 comp rx=0 tx=0).stop 2024-08-17T02:25:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 -- 172.21.15.45:0/3907807517 shutdown_connections 2024-08-17T02:25:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb8f8065150 0x7fb8f8067600 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb91c140580 0x7fb91c0c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb91c1401b0 0x7fb91c13dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 --2- 172.21.15.45:0/3907807517 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb91c0b1440 0x7fb91c169af0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 -- 172.21.15.45:0/3907807517 >> 172.21.15.45:0/3907807517 conn(0x7fb91c0cb9b0 msgr2=0x7fb91c13eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:52.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 -- 172.21.15.45:0/3907807517 shutdown_connections 2024-08-17T02:25:52.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.193+0000 7fb920e00640 1 -- 172.21.15.45:0/3907807517 wait complete. 2024-08-17T02:25:52.209 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:52.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.361+0000 7f6894a00640 1 Processor -- start 2024-08-17T02:25:52.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.361+0000 7f6894a00640 1 -- start start 2024-08-17T02:25:52.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.362+0000 7f6894a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6890155900 0x7f6890155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.362+0000 7f6894a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 0x7f6890156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.362+0000 7f6894a00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6890157690 con 0x7f6890157b20 2024-08-17T02:25:52.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.362+0000 7f6894a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6890156a80 con 0x7f6890155900 2024-08-17T02:25:52.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.362+0000 7f6894a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6890156d60 con 0x7f68900b0270 2024-08-17T02:25:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.362+0000 7f688fe00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6890157b20 0x7f6890157fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54422/0 (socket says 172.21.15.45:54422) 2024-08-17T02:25:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.363+0000 7f688fe00640 1 -- 172.21.15.45:0/2155179452 learned_addr learned my addr 172.21.15.45:0/2155179452 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.363+0000 7f688ea00640 1 --2- 172.21.15.45:0/2155179452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 0x7f6890156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.363+0000 7f688f400640 1 --2- 172.21.15.45:0/2155179452 >> v2:172.21.15.169:3300/0 conn(0x7f6890155900 0x7f6890155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.363+0000 7f688e000640 1 -- 172.21.15.45:0/2155179452 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91485984 0 0) 0x7f6890157690 con 0x7f6890157b20 2024-08-17T02:25:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.363+0000 7f688e000640 1 -- 172.21.15.45:0/2155179452 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68740034e0 con 0x7f6890157b20 2024-08-17T02:25:52.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.363+0000 7f688f400640 1 -- 172.21.15.45:0/2155179452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 msgr2=0x7f6890156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:52.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.363+0000 7f688f400640 1 --2- 172.21.15.45:0/2155179452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 0x7f6890156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.363+0000 7f688f400640 1 -- 172.21.15.45:0/2155179452 >> v1:172.21.15.45:6789/0 conn(0x7f6890157b20 legacy=0x7f6890157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.363+0000 7f688f400640 1 -- 172.21.15.45:0/2155179452 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6890157040 con 0x7f6890155900 2024-08-17T02:25:52.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.363+0000 7f688ea00640 1 --2- 172.21.15.45:0/2155179452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 0x7f6890156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:52.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.364+0000 7f688f400640 1 --2- 172.21.15.45:0/2155179452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6890155900 0x7f6890155cd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6880009850 tx=0x7f68800090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24cb5ff8b4e6905f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.365+0000 7f688e000640 1 -- 172.21.15.45:0/2155179452 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688002ad00 con 0x7f6890155900 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.365+0000 7f688e000640 1 -- 172.21.15.45:0/2155179452 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688002ae60 con 0x7f6890155900 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.365+0000 7f688e000640 1 -- 172.21.15.45:0/2155179452 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880032670 con 0x7f6890155900 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.365+0000 7f6894a00640 1 -- 172.21.15.45:0/2155179452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6890155900 msgr2=0x7f6890155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.365+0000 7f6894a00640 1 --2- 172.21.15.45:0/2155179452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6890155900 0x7f6890155cd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6880009850 tx=0x7f68800090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.365+0000 7f6894a00640 1 -- 172.21.15.45:0/2155179452 shutdown_connections 2024-08-17T02:25:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.365+0000 7f6894a00640 1 --2- 172.21.15.45:0/2155179452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 0x7f6890156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.365+0000 7f6894a00640 1 --2- 172.21.15.45:0/2155179452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6890155900 0x7f6890155cd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.365+0000 7f6894a00640 1 -- 172.21.15.45:0/2155179452 >> 172.21.15.45:0/2155179452 conn(0x7f6890067750 msgr2=0x7f68900cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.366+0000 7f6894a00640 1 -- 172.21.15.45:0/2155179452 shutdown_connections 2024-08-17T02:25:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.366+0000 7f6894a00640 1 -- 172.21.15.45:0/2155179452 wait complete. 2024-08-17T02:25:52.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.367+0000 7f6894a00640 1 Processor -- start 2024-08-17T02:25:52.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.367+0000 7f6894a00640 1 -- start start 2024-08-17T02:25:52.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.368+0000 7f6894a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 0x7f68900abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.368+0000 7f6894a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890155900 0x7f6890164aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.368+0000 7f6894a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6890157b20 0x7f68900cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.368+0000 7f6894a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900a8630 con 0x7f6890155900 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.368+0000 7f6894a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900a8910 con 0x7f6890157b20 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.368+0000 7f6894a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68900a8bf0 con 0x7f68900b0270 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.368+0000 7f688ea00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890155900 0x7f6890164aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.368+0000 7f688ea00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890155900 0x7f6890164aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36948/0 (socket says 172.21.15.45:36948) 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.368+0000 7f688ea00640 1 -- 172.21.15.45:0/1230313434 learned_addr learned my addr 172.21.15.45:0/1230313434 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.368+0000 7f688fe00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6890157b20 0x7f68900cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.368+0000 7f688f400640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 0x7f68900abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f688ea00640 1 -- 172.21.15.45:0/1230313434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 msgr2=0x7f68900abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f688ea00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 0x7f68900abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f688ea00640 1 -- 172.21.15.45:0/1230313434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6890157b20 msgr2=0x7f68900cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f688ea00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6890157b20 0x7f68900cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f688ea00640 1 -- 172.21.15.45:0/1230313434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c009390 con 0x7f6890155900 2024-08-17T02:25:52.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f688f400640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 0x7f68900abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:52.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f688fe00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6890157b20 0x7f68900cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:52.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f688ea00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890155900 0x7f6890164aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f687c00ec80 tx=0x7f687c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f6886a00640 1 -- 172.21.15.45:0/1230313434 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c00eec0 con 0x7f6890155900 2024-08-17T02:25:52.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f6886a00640 1 -- 172.21.15.45:0/1230313434 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c00cbc0 con 0x7f6890155900 2024-08-17T02:25:52.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f6886a00640 1 -- 172.21.15.45:0/1230313434 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c013470 con 0x7f6890155900 2024-08-17T02:25:52.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f6894a00640 1 -- 172.21.15.45:0/1230313434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6880009390 con 0x7f6890155900 2024-08-17T02:25:52.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.369+0000 7f6894a00640 1 -- 172.21.15.45:0/1230313434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68900ac510 con 0x7f6890155900 2024-08-17T02:25:52.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.370+0000 7f6894a00640 1 -- 172.21.15.45:0/1230313434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6890071050 con 0x7f6890155900 2024-08-17T02:25:52.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.371+0000 7f6886a00640 1 -- 172.21.15.45:0/1230313434 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f687c0137e0 con 0x7f6890155900 2024-08-17T02:25:52.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.372+0000 7f6886a00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6870065150 0x7f6870067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.372+0000 7f6886a00640 1 -- 172.21.15.45:0/1230313434 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f687c082870 con 0x7f6890155900 2024-08-17T02:25:52.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.372+0000 7f688f400640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6870065150 0x7f6870067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.373+0000 7f688f400640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6870065150 0x7f6870067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6880034000 tx=0x7f6880032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.376+0000 7f6886a00640 1 -- 172.21.15.45:0/1230313434 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f687c050890 con 0x7f6890155900 2024-08-17T02:25:52.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.563+0000 7f6894a00640 1 -- 172.21.15.45:0/1230313434 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f68900a8770 con 0x7f6890155900 2024-08-17T02:25:52.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.564+0000 7f6886a00640 1 -- 172.21.15.45:0/1230313434 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f68900a8770 con 0x7f6890155900 2024-08-17T02:25:52.565 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:52.565 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:52.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 -- 172.21.15.45:0/1230313434 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6870065150 msgr2=0x7f6870067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6870065150 0x7f6870067600 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6880034000 tx=0x7f6880032000 comp rx=0 tx=0).stop 2024-08-17T02:25:52.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 -- 172.21.15.45:0/1230313434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890155900 msgr2=0x7f6890164aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890155900 0x7f6890164aa0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f687c00ec80 tx=0x7f687c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 -- 172.21.15.45:0/1230313434 shutdown_connections 2024-08-17T02:25:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6890157b20 0x7f68900cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6890155900 0x7f6890164aa0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6870065150 0x7f6870067600 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 --2- 172.21.15.45:0/1230313434 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f68900b0270 0x7f68900abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 -- 172.21.15.45:0/1230313434 >> 172.21.15.45:0/1230313434 conn(0x7f6890067750 msgr2=0x7f68901516a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 -- 172.21.15.45:0/1230313434 shutdown_connections 2024-08-17T02:25:52.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.566+0000 7f6894a00640 1 -- 172.21.15.45:0/1230313434 wait complete. 2024-08-17T02:25:52.582 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:25:12.166249+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:25:13.072271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-17T02:25:52.583 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:25:52.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.737+0000 7fe64f000640 1 Processor -- start 2024-08-17T02:25:52.738 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.737+0000 7fe64f000640 1 -- start start 2024-08-17T02:25:52.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.738+0000 7fe64f000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe648158f60 0x7fe6480ac820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.738+0000 7fe64f000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6480ac390 con 0x7fe6480cc5f0 2024-08-17T02:25:52.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.738+0000 7fe64f000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6480ab4a0 con 0x7fe648158b90 2024-08-17T02:25:52.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.738+0000 7fe64f000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6480ab780 con 0x7fe648158f60 2024-08-17T02:25:52.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.739+0000 7fe64d000640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe6480cc5f0 0x7fe64806d7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54426/0 (socket says 172.21.15.45:54426) 2024-08-17T02:25:52.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.739+0000 7fe64d000640 1 -- 172.21.15.45:0/2564546100 learned_addr learned my addr 172.21.15.45:0/2564546100 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:52.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.739+0000 7fe63fe00640 1 --2- 172.21.15.45:0/2564546100 >> v2:172.21.15.169:3300/0 conn(0x7fe648158f60 0x7fe6480ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.739+0000 7fe647400640 1 -- 172.21.15.45:0/2564546100 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203033967 0 0) 0x7fe6480ac390 con 0x7fe6480cc5f0 2024-08-17T02:25:52.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.739+0000 7fe647400640 1 -- 172.21.15.45:0/2564546100 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe62c0034e0 con 0x7fe6480cc5f0 2024-08-17T02:25:52.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.739+0000 7fe647400640 1 -- 172.21.15.45:0/2564546100 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513719481 0 0) 0x7fe6480ab4a0 con 0x7fe648158b90 2024-08-17T02:25:52.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.739+0000 7fe647400640 1 -- 172.21.15.45:0/2564546100 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6480ac390 con 0x7fe648158b90 2024-08-17T02:25:52.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.739+0000 7fe647400640 1 -- 172.21.15.45:0/2564546100 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2165889906 0 0) 0x7fe62c0034e0 con 0x7fe6480cc5f0 2024-08-17T02:25:52.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.739+0000 7fe63fe00640 1 -- 172.21.15.45:0/2564546100 >> v1:172.21.15.169:6789/0 conn(0x7fe648158b90 legacy=0x7fe6480aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.739+0000 7fe63fe00640 1 -- 172.21.15.45:0/2564546100 >> v1:172.21.15.45:6789/0 conn(0x7fe6480cc5f0 legacy=0x7fe64806d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.740+0000 7fe63fe00640 1 -- 172.21.15.45:0/2564546100 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6480aba60 con 0x7fe648158f60 2024-08-17T02:25:52.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.741+0000 7fe63fe00640 1 --2- 172.21.15.45:0/2564546100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648158f60 0x7fe6480ac820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe630009850 tx=0x7fe6300090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8fa9fd5f84024ea server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.741+0000 7fe647400640 1 -- 172.21.15.45:0/2564546100 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6400017f0 con 0x7fe648158f60 2024-08-17T02:25:52.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.741+0000 7fe647400640 1 -- 172.21.15.45:0/2564546100 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63002ab00 con 0x7fe648158f60 2024-08-17T02:25:52.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.741+0000 7fe647400640 1 -- 172.21.15.45:0/2564546100 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63002ae80 con 0x7fe648158f60 2024-08-17T02:25:52.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.741+0000 7fe64f000640 1 -- 172.21.15.45:0/2564546100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648158f60 msgr2=0x7fe6480ac820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.741+0000 7fe64f000640 1 --2- 172.21.15.45:0/2564546100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648158f60 0x7fe6480ac820 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe630009850 tx=0x7fe6300090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.742+0000 7fe64f000640 1 -- 172.21.15.45:0/2564546100 shutdown_connections 2024-08-17T02:25:52.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.742+0000 7fe64f000640 1 --2- 172.21.15.45:0/2564546100 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648158f60 0x7fe6480ac820 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.742+0000 7fe64f000640 1 -- 172.21.15.45:0/2564546100 >> 172.21.15.45:0/2564546100 conn(0x7fe648067750 msgr2=0x7fe6480cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:52.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.742+0000 7fe64f000640 1 -- 172.21.15.45:0/2564546100 shutdown_connections 2024-08-17T02:25:52.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.742+0000 7fe64f000640 1 -- 172.21.15.45:0/2564546100 wait complete. 2024-08-17T02:25:52.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.743+0000 7fe64f000640 1 Processor -- start 2024-08-17T02:25:52.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.743+0000 7fe64f000640 1 -- start start 2024-08-17T02:25:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.744+0000 7fe64f000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6480cc5f0 0x7fe648150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.744+0000 7fe64f000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe648158b90 0x7fe64815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.744+0000 7fe64f000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648158f60 0x7fe64814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.744+0000 7fe64f000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe648151410 con 0x7fe648158b90 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.744+0000 7fe64f000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64814fe30 con 0x7fe648158f60 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.744+0000 7fe64f000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe648150110 con 0x7fe6480cc5f0 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.744+0000 7fe63fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe648158b90 0x7fe64815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.744+0000 7fe63fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe648158b90 0x7fe64815ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36956/0 (socket says 172.21.15.45:36956) 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.744+0000 7fe63fe00640 1 -- 172.21.15.45:0/4096754423 learned_addr learned my addr 172.21.15.45:0/4096754423 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.744+0000 7fe647e00640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6480cc5f0 0x7fe648150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.744+0000 7fe64d000640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648158f60 0x7fe64814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.745+0000 7fe63fe00640 1 -- 172.21.15.45:0/4096754423 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6480cc5f0 msgr2=0x7fe648150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.745+0000 7fe63fe00640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6480cc5f0 0x7fe648150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.745+0000 7fe63fe00640 1 -- 172.21.15.45:0/4096754423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648158f60 msgr2=0x7fe64814f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.745+0000 7fe63fe00640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648158f60 0x7fe64814f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.745+0000 7fe63fe00640 1 -- 172.21.15.45:0/4096754423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe630009390 con 0x7fe648158b90 2024-08-17T02:25:52.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.745+0000 7fe63fe00640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe648158b90 0x7fe64815ca60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe630009850 tx=0x7fe630032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.745+0000 7fe63f400640 1 -- 172.21.15.45:0/4096754423 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63003c650 con 0x7fe648158b90 2024-08-17T02:25:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.746+0000 7fe63f400640 1 -- 172.21.15.45:0/4096754423 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63003c7b0 con 0x7fe648158b90 2024-08-17T02:25:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.746+0000 7fe64f000640 1 -- 172.21.15.45:0/4096754423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6481503f0 con 0x7fe648158b90 2024-08-17T02:25:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.746+0000 7fe63f400640 1 -- 172.21.15.45:0/4096754423 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63003cb30 con 0x7fe648158b90 2024-08-17T02:25:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.746+0000 7fe64f000640 1 -- 172.21.15.45:0/4096754423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6481509b0 con 0x7fe648158b90 2024-08-17T02:25:52.748 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.747+0000 7fe64f000640 1 -- 172.21.15.45:0/4096754423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe648150ba0 con 0x7fe648158b90 2024-08-17T02:25:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.748+0000 7fe63f400640 1 -- 172.21.15.45:0/4096754423 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe63003e450 con 0x7fe648158b90 2024-08-17T02:25:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.748+0000 7fe63f400640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe624065150 0x7fe624067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.748+0000 7fe63f400640 1 -- 172.21.15.45:0/4096754423 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe6300a23d0 con 0x7fe648158b90 2024-08-17T02:25:52.749 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.749+0000 7fe647e00640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe624065150 0x7fe624067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:52.750 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.749+0000 7fe647e00640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe624065150 0x7fe624067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe638003a10 tx=0x7fe638007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:52.753 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.752+0000 7fe63f400640 1 -- 172.21.15.45:0/4096754423 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe6300705c0 con 0x7fe648158b90 2024-08-17T02:25:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.934+0000 7fe64f000640 1 -- 172.21.15.45:0/4096754423 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe648064db0 con 0x7fe648158b90 2024-08-17T02:25:52.935 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.934+0000 7fe63f400640 1 -- 172.21.15.45:0/4096754423 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe630073be0 con 0x7fe648158b90 2024-08-17T02:25:52.935 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:25:52.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.936+0000 7fe64f000640 1 -- 172.21.15.45:0/4096754423 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe624065150 msgr2=0x7fe624067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.936+0000 7fe64f000640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe624065150 0x7fe624067600 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe638003a10 tx=0x7fe638007cc0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.936+0000 7fe64f000640 1 -- 172.21.15.45:0/4096754423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe648158b90 msgr2=0x7fe64815ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:52.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.936+0000 7fe64f000640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe648158b90 0x7fe64815ca60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe630009850 tx=0x7fe630032000 comp rx=0 tx=0).stop 2024-08-17T02:25:52.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.936+0000 7fe64f000640 1 -- 172.21.15.45:0/4096754423 shutdown_connections 2024-08-17T02:25:52.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.936+0000 7fe64f000640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe648158f60 0x7fe64814f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.936+0000 7fe64f000640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe648158b90 0x7fe64815ca60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.936+0000 7fe64f000640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe624065150 0x7fe624067600 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.936+0000 7fe64f000640 1 --2- 172.21.15.45:0/4096754423 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6480cc5f0 0x7fe648150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:52.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.936+0000 7fe64f000640 1 -- 172.21.15.45:0/4096754423 >> 172.21.15.45:0/4096754423 conn(0x7fe648067750 msgr2=0x7fe648159360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:52.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.937+0000 7fe64f000640 1 -- 172.21.15.45:0/4096754423 shutdown_connections 2024-08-17T02:25:52.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:52.937+0000 7fe64f000640 1 -- 172.21.15.45:0/4096754423 wait complete. 2024-08-17T02:25:52.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:25:53.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.107+0000 7fccdba00640 1 Processor -- start 2024-08-17T02:25:53.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.107+0000 7fccdba00640 1 -- start start 2024-08-17T02:25:53.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.108+0000 7fccdba00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fccd415c2f0 0x7fccd40af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.108+0000 7fccdba00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fccd40d0890 0x7fccd40b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.109 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.108+0000 7fccdba00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fccd40b0d50 0x7fccd40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.108+0000 7fccdba00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd40b1e10 con 0x7fccd415c2f0 2024-08-17T02:25:53.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.108+0000 7fccdba00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccd40b11d0 con 0x7fccd40b0d50 2024-08-17T02:25:53.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.108+0000 7fccdba00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd40af910 con 0x7fccd40d0890 2024-08-17T02:25:53.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd9000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fccd415c2f0 0x7fccd40af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd9000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fccd415c2f0 0x7fccd40af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36970/0 (socket says 172.21.15.45:36970) 2024-08-17T02:25:53.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd9000640 1 -- 172.21.15.45:0/2541771852 learned_addr learned my addr 172.21.15.45:0/2541771852 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:53.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd9a00640 1 --2- 172.21.15.45:0/2541771852 >> v2:172.21.15.169:3300/0 conn(0x7fccd40b0d50 0x7fccd40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd3e00640 1 --2- 172.21.15.45:0/2541771852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fccd40d0890 0x7fccd40b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd9000640 1 -- 172.21.15.45:0/2541771852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fccd40d0890 msgr2=0x7fccd40b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:53.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd9000640 1 --2- 172.21.15.45:0/2541771852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fccd40d0890 0x7fccd40b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.112 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd9000640 1 -- 172.21.15.45:0/2541771852 >> v2:172.21.15.169:3300/0 conn(0x7fccd40b0d50 msgr2=0x7fccd40ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd9000640 1 --2- 172.21.15.45:0/2541771852 >> v2:172.21.15.169:3300/0 conn(0x7fccd40b0d50 0x7fccd40ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd9000640 1 -- 172.21.15.45:0/2541771852 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd40afbb0 con 0x7fccd415c2f0 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd3e00640 1 --2- 172.21.15.45:0/2541771852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fccd40d0890 0x7fccd40b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.109+0000 7fccd9a00640 1 --2- 172.21.15.45:0/2541771852 >> v2:172.21.15.169:3300/0 conn(0x7fccd40b0d50 0x7fccd40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.110+0000 7fccd9000640 1 --2- 172.21.15.45:0/2541771852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd415c2f0 0x7fccd40af3d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fccd4089900 tx=0x7fccc80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f304c9a5b2aee75 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.110+0000 7fccd3400640 1 -- 172.21.15.45:0/2541771852 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc802add0 con 0x7fccd415c2f0 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.110+0000 7fccd3400640 1 -- 172.21.15.45:0/2541771852 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc8032440 con 0x7fccd415c2f0 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.110+0000 7fccd3400640 1 -- 172.21.15.45:0/2541771852 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc8032820 con 0x7fccd415c2f0 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.111+0000 7fccdba00640 1 -- 172.21.15.45:0/2541771852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd415c2f0 msgr2=0x7fccd40af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.111+0000 7fccdba00640 1 --2- 172.21.15.45:0/2541771852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd415c2f0 0x7fccd40af3d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fccd4089900 tx=0x7fccc80091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.111+0000 7fccdba00640 1 -- 172.21.15.45:0/2541771852 shutdown_connections 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.111+0000 7fccdba00640 1 --2- 172.21.15.45:0/2541771852 >> v2:172.21.15.169:3300/0 conn(0x7fccd40b0d50 0x7fccd40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.111+0000 7fccdba00640 1 --2- 172.21.15.45:0/2541771852 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fccd40d0890 0x7fccd40b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.111+0000 7fccdba00640 1 --2- 172.21.15.45:0/2541771852 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd415c2f0 0x7fccd40af3d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.111+0000 7fccdba00640 1 -- 172.21.15.45:0/2541771852 >> 172.21.15.45:0/2541771852 conn(0x7fccd40cfdb0 msgr2=0x7fccd40d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.111+0000 7fccdba00640 1 -- 172.21.15.45:0/2541771852 shutdown_connections 2024-08-17T02:25:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.111+0000 7fccdba00640 1 -- 172.21.15.45:0/2541771852 wait complete. 2024-08-17T02:25:53.116 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.112+0000 7fccdba00640 1 Processor -- start 2024-08-17T02:25:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.113+0000 7fccdba00640 1 -- start start 2024-08-17T02:25:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.113+0000 7fccdba00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fccd40b0d50 0x7fccd4155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.113+0000 7fccdba00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd40d0890 0x7fccd415aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.113+0000 7fccdba00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccd415c2f0 0x7fccd409c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.113+0000 7fccdba00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd409a960 con 0x7fccd40d0890 2024-08-17T02:25:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.113+0000 7fccdba00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd409ac00 con 0x7fccd415c2f0 2024-08-17T02:25:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.113+0000 7fccdba00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd409aee0 con 0x7fccd40b0d50 2024-08-17T02:25:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.114+0000 7fccd3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd40d0890 0x7fccd415aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.114+0000 7fccd3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd40d0890 0x7fccd415aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36972/0 (socket says 172.21.15.45:36972) 2024-08-17T02:25:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.114+0000 7fccd3e00640 1 -- 172.21.15.45:0/1284735968 learned_addr learned my addr 172.21.15.45:0/1284735968 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.114+0000 7fccd9000640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fccd40b0d50 0x7fccd4155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.114+0000 7fccd9a00640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccd415c2f0 0x7fccd409c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.114+0000 7fccd3e00640 1 -- 172.21.15.45:0/1284735968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fccd40b0d50 msgr2=0x7fccd4155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.114+0000 7fccd3e00640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fccd40b0d50 0x7fccd4155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.114+0000 7fccd3e00640 1 -- 172.21.15.45:0/1284735968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccd415c2f0 msgr2=0x7fccd409c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.114+0000 7fccd3e00640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccd415c2f0 0x7fccd409c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.114+0000 7fccd3e00640 1 -- 172.21.15.45:0/1284735968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc8009450 con 0x7fccd40d0890 2024-08-17T02:25:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.115+0000 7fccd3e00640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd40d0890 0x7fccd415aca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fccc000d890 tx=0x7fccc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.115+0000 7fccc7e00640 1 -- 172.21.15.45:0/1284735968 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc000de80 con 0x7fccd40d0890 2024-08-17T02:25:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.115+0000 7fccc7e00640 1 -- 172.21.15.45:0/1284735968 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc00098d0 con 0x7fccd40d0890 2024-08-17T02:25:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.115+0000 7fccc7e00640 1 -- 172.21.15.45:0/1284735968 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc0009c90 con 0x7fccd40d0890 2024-08-17T02:25:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.115+0000 7fccdba00640 1 -- 172.21.15.45:0/1284735968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd409b1c0 con 0x7fccd40d0890 2024-08-17T02:25:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.115+0000 7fccdba00640 1 -- 172.21.15.45:0/1284735968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd4168c30 con 0x7fccd40d0890 2024-08-17T02:25:53.119 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.116+0000 7fccdba00640 1 -- 172.21.15.45:0/1284735968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd4071050 con 0x7fccd40d0890 2024-08-17T02:25:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.117+0000 7fccc7e00640 1 -- 172.21.15.45:0/1284735968 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fccc0014410 con 0x7fccd40d0890 2024-08-17T02:25:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.118+0000 7fccc7e00640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccb4065150 0x7fccb4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.118+0000 7fccc7e00640 1 -- 172.21.15.45:0/1284735968 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fccc0082de0 con 0x7fccd40d0890 2024-08-17T02:25:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.118+0000 7fccd9000640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccb4065150 0x7fccb4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.119+0000 7fccd9000640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccb4065150 0x7fccb4067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fccc8034000 tx=0x7fccc8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.122+0000 7fccc7e00640 1 -- 172.21.15.45:0/1284735968 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fccc0054890 con 0x7fccd40d0890 2024-08-17T02:25:53.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.304+0000 7fccdba00640 1 -- 172.21.15.45:0/1284735968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fccd40899a0 con 0x7fccd40d0890 2024-08-17T02:25:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.305+0000 7fccc7e00640 1 -- 172.21.15.45:0/1284735968 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fccc0054420 con 0x7fccd40d0890 2024-08-17T02:25:53.306 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:25:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 -- 172.21.15.45:0/1284735968 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccb4065150 msgr2=0x7fccb4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccb4065150 0x7fccb4067600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fccc8034000 tx=0x7fccc8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 -- 172.21.15.45:0/1284735968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd40d0890 msgr2=0x7fccd415aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd40d0890 0x7fccd415aca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fccc000d890 tx=0x7fccc0008040 comp rx=0 tx=0).stop 2024-08-17T02:25:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 -- 172.21.15.45:0/1284735968 shutdown_connections 2024-08-17T02:25:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fccd415c2f0 0x7fccd409c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fccd40d0890 0x7fccd415aca0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fccb4065150 0x7fccb4067600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 --2- 172.21.15.45:0/1284735968 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fccd40b0d50 0x7fccd4155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 -- 172.21.15.45:0/1284735968 >> 172.21.15.45:0/1284735968 conn(0x7fccd40cfdb0 msgr2=0x7fccd4157f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 -- 172.21.15.45:0/1284735968 shutdown_connections 2024-08-17T02:25:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.307+0000 7fccdba00640 1 -- 172.21.15.45:0/1284735968 wait complete. 2024-08-17T02:25:53.323 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:25:53.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.476+0000 7f5049400640 1 Processor -- start 2024-08-17T02:25:53.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.476+0000 7f5049400640 1 -- start start 2024-08-17T02:25:53.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.477+0000 7f5049400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5044155a80 0x7f504406dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.477+0000 7f5049400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f50440c7db0 0x7f50440c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.477+0000 7f5049400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50441598f0 con 0x7f5044155e50 2024-08-17T02:25:53.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.477+0000 7f5049400640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5044159bd0 con 0x7f5044155a80 2024-08-17T02:25:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.477+0000 7f5049400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5044159eb0 con 0x7f50440c7db0 2024-08-17T02:25:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.478+0000 7f5042800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5044155a80 0x7f504406dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.478+0000 7f5042800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5044155a80 0x7f504406dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36978/0 (socket says 172.21.15.45:36978) 2024-08-17T02:25:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.478+0000 7f5042800640 1 -- 172.21.15.45:0/3543446913 learned_addr learned my addr 172.21.15.45:0/3543446913 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.478+0000 7f5039e00640 1 --2- 172.21.15.45:0/3543446913 >> v2:172.21.15.169:3300/0 conn(0x7f50440c7db0 0x7f50440c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.478+0000 7f5042800640 1 -- 172.21.15.45:0/3543446913 >> v2:172.21.15.169:3300/0 conn(0x7f50440c7db0 msgr2=0x7f50440c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.478+0000 7f5042800640 1 --2- 172.21.15.45:0/3543446913 >> v2:172.21.15.169:3300/0 conn(0x7f50440c7db0 0x7f50440c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.478+0000 7f5042800640 1 -- 172.21.15.45:0/3543446913 >> v1:172.21.15.169:6789/0 conn(0x7f5044155e50 legacy=0x7f504406c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.478+0000 7f5042800640 1 -- 172.21.15.45:0/3543446913 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f504415a190 con 0x7f5044155a80 2024-08-17T02:25:53.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.479+0000 7f5042800640 1 --2- 172.21.15.45:0/3543446913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5044155a80 0x7f504406dc00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f504406c750 tx=0x7f50340091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e16422b564d2ca7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.480+0000 7f5041e00640 1 -- 172.21.15.45:0/3543446913 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034032440 con 0x7f5044155a80 2024-08-17T02:25:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.480+0000 7f5041e00640 1 -- 172.21.15.45:0/3543446913 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50340325a0 con 0x7f5044155a80 2024-08-17T02:25:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.480+0000 7f5041e00640 1 -- 172.21.15.45:0/3543446913 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034032980 con 0x7f5044155a80 2024-08-17T02:25:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.480+0000 7f5049400640 1 -- 172.21.15.45:0/3543446913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5044155a80 msgr2=0x7f504406dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.480+0000 7f5049400640 1 --2- 172.21.15.45:0/3543446913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5044155a80 0x7f504406dc00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f504406c750 tx=0x7f50340091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.480+0000 7f5049400640 1 -- 172.21.15.45:0/3543446913 shutdown_connections 2024-08-17T02:25:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.480+0000 7f5049400640 1 --2- 172.21.15.45:0/3543446913 >> v2:172.21.15.169:3300/0 conn(0x7f50440c7db0 0x7f50440c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.480+0000 7f5049400640 1 --2- 172.21.15.45:0/3543446913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5044155a80 0x7f504406dc00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.480+0000 7f5049400640 1 -- 172.21.15.45:0/3543446913 >> 172.21.15.45:0/3543446913 conn(0x7f5044067750 msgr2=0x7f50440c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.480+0000 7f5049400640 1 -- 172.21.15.45:0/3543446913 shutdown_connections 2024-08-17T02:25:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.480+0000 7f5049400640 1 -- 172.21.15.45:0/3543446913 wait complete. 2024-08-17T02:25:53.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.482+0000 7f5049400640 1 Processor -- start 2024-08-17T02:25:53.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.482+0000 7f5049400640 1 -- start start 2024-08-17T02:25:53.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5049400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50440c7db0 0x7f5044158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5049400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5044155a80 0x7f504415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5049400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5044155e50 0x7f504416c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5049400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504415f790 con 0x7f5044155e50 2024-08-17T02:25:53.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5049400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5044155000 con 0x7f5044155a80 2024-08-17T02:25:53.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5049400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50441575c0 con 0x7f50440c7db0 2024-08-17T02:25:53.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5043200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5044155e50 0x7f504416c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5043200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5044155e50 0x7f504416c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36994/0 (socket says 172.21.15.45:36994) 2024-08-17T02:25:53.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5043200640 1 -- 172.21.15.45:0/2242576466 learned_addr learned my addr 172.21.15.45:0/2242576466 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:53.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5042800640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50440c7db0 0x7f5044158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5039e00640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5044155a80 0x7f504415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5043200640 1 -- 172.21.15.45:0/2242576466 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50440c7db0 msgr2=0x7f5044158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5043200640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50440c7db0 0x7f5044158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5043200640 1 -- 172.21.15.45:0/2242576466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5044155a80 msgr2=0x7f504415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.483+0000 7f5043200640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5044155a80 0x7f504415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.484+0000 7f5043200640 1 -- 172.21.15.45:0/2242576466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5034009450 con 0x7f5044155e50 2024-08-17T02:25:53.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.484+0000 7f5043200640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5044155e50 0x7f504416c8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c7c0 tx=0x7f503c0015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.484+0000 7f503aa00640 1 -- 172.21.15.45:0/2242576466 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00a640 con 0x7f5044155e50 2024-08-17T02:25:53.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.484+0000 7f503aa00640 1 -- 172.21.15.45:0/2242576466 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c00a7c0 con 0x7f5044155e50 2024-08-17T02:25:53.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.484+0000 7f5049400640 1 -- 172.21.15.45:0/2242576466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504415ea50 con 0x7f5044155e50 2024-08-17T02:25:53.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.484+0000 7f503aa00640 1 -- 172.21.15.45:0/2242576466 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00ab80 con 0x7f5044155e50 2024-08-17T02:25:53.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.484+0000 7f5049400640 1 -- 172.21.15.45:0/2242576466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504416ce00 con 0x7f5044155e50 2024-08-17T02:25:53.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.485+0000 7f5049400640 1 -- 172.21.15.45:0/2242576466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f504415e890 con 0x7f5044155e50 2024-08-17T02:25:53.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.486+0000 7f503aa00640 1 -- 172.21.15.45:0/2242576466 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f503c003030 con 0x7f5044155e50 2024-08-17T02:25:53.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.487+0000 7f503aa00640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5020065150 0x7f5020067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.487+0000 7f503aa00640 1 -- 172.21.15.45:0/2242576466 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f503c082240 con 0x7f5044155e50 2024-08-17T02:25:53.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.487+0000 7f5042800640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5020065150 0x7f5020067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.488+0000 7f5042800640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5020065150 0x7f5020067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5034034000 tx=0x7f5034032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.491 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.491+0000 7f503aa00640 1 -- 172.21.15.45:0/2242576466 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f503c0503b0 con 0x7f5044155e50 2024-08-17T02:25:53.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.672+0000 7f5049400640 1 -- 172.21.15.45:0/2242576466 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5044071050 con 0x7f5044155e50 2024-08-17T02:25:53.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.673+0000 7f503aa00640 1 -- 172.21.15.45:0/2242576466 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f503c0539d0 con 0x7f5044155e50 2024-08-17T02:25:53.673 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-08-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 -- 172.21.15.45:0/2242576466 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5020065150 msgr2=0x7f5020067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5020065150 0x7f5020067600 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5034034000 tx=0x7f5034032000 comp rx=0 tx=0).stop 2024-08-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 -- 172.21.15.45:0/2242576466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5044155e50 msgr2=0x7f504416c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5044155e50 0x7f504416c8c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f503c00c7c0 tx=0x7f503c0015f0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 -- 172.21.15.45:0/2242576466 shutdown_connections 2024-08-17T02:25:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5044155e50 0x7f504416c8c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5044155a80 0x7f504415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5020065150 0x7f5020067600 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 --2- 172.21.15.45:0/2242576466 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f50440c7db0 0x7f5044158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 -- 172.21.15.45:0/2242576466 >> 172.21.15.45:0/2242576466 conn(0x7f5044067750 msgr2=0x7f5044068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 -- 172.21.15.45:0/2242576466 shutdown_connections 2024-08-17T02:25:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.675+0000 7f5049400640 1 -- 172.21.15.45:0/2242576466 wait complete. 2024-08-17T02:25:53.692 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:53.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.842+0000 7f6049e00640 1 Processor -- start 2024-08-17T02:25:53.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.842+0000 7f6049e00640 1 -- start start 2024-08-17T02:25:53.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6049e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6044155a20 0x7f60440adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6049e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155df0 0x7f60440ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.844 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6049e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6044156670 con 0x7f604406d7f0 2024-08-17T02:25:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6049e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60440b0350 con 0x7f6044155a20 2024-08-17T02:25:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6049e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604406e5e0 con 0x7f6044155df0 2024-08-17T02:25:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6043400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f604406d7f0 0x7f60440ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54442/0 (socket says 172.21.15.45:54442) 2024-08-17T02:25:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6042a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6044155a20 0x7f60440adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6043400640 1 -- 172.21.15.45:0/2190197329 learned_addr learned my addr 172.21.15.45:0/2190197329 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6042000640 1 --2- 172.21.15.45:0/2190197329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155df0 0x7f60440ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6041600640 1 -- 172.21.15.45:0/2190197329 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758166222 0 0) 0x7f6044156670 con 0x7f604406d7f0 2024-08-17T02:25:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6041600640 1 -- 172.21.15.45:0/2190197329 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60280034e0 con 0x7f604406d7f0 2024-08-17T02:25:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6042a00640 1 -- 172.21.15.45:0/2190197329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155df0 msgr2=0x7f60440ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.844+0000 7f6042a00640 1 --2- 172.21.15.45:0/2190197329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155df0 0x7f60440ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.845+0000 7f6042a00640 1 -- 172.21.15.45:0/2190197329 >> v1:172.21.15.45:6789/0 conn(0x7f604406d7f0 legacy=0x7f60440ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.845+0000 7f6042a00640 1 -- 172.21.15.45:0/2190197329 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f604406e8c0 con 0x7f6044155a20 2024-08-17T02:25:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.845+0000 7f6042000640 1 --2- 172.21.15.45:0/2190197329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155df0 0x7f60440ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.845+0000 7f6042a00640 1 --2- 172.21.15.45:0/2190197329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6044155a20 0x7f60440adf10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6034009850 tx=0x7f60340090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e342c2dadb05dde8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.846+0000 7f6041600640 1 -- 172.21.15.45:0/2190197329 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603402ad80 con 0x7f6044155a20 2024-08-17T02:25:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.846+0000 7f6041600640 1 -- 172.21.15.45:0/2190197329 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6034032440 con 0x7f6044155a20 2024-08-17T02:25:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.846+0000 7f6041600640 1 -- 172.21.15.45:0/2190197329 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034032800 con 0x7f6044155a20 2024-08-17T02:25:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.846+0000 7f6049e00640 1 -- 172.21.15.45:0/2190197329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6044155a20 msgr2=0x7f60440adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.846+0000 7f6049e00640 1 --2- 172.21.15.45:0/2190197329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6044155a20 0x7f60440adf10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6034009850 tx=0x7f60340090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.846+0000 7f6049e00640 1 -- 172.21.15.45:0/2190197329 shutdown_connections 2024-08-17T02:25:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.846+0000 7f6049e00640 1 --2- 172.21.15.45:0/2190197329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6044155df0 0x7f60440ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.846+0000 7f6049e00640 1 --2- 172.21.15.45:0/2190197329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6044155a20 0x7f60440adf10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.846+0000 7f6049e00640 1 -- 172.21.15.45:0/2190197329 >> 172.21.15.45:0/2190197329 conn(0x7f60440cb9b0 msgr2=0x7f60440cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.846+0000 7f6049e00640 1 -- 172.21.15.45:0/2190197329 shutdown_connections 2024-08-17T02:25:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.846+0000 7f6049e00640 1 -- 172.21.15.45:0/2190197329 wait complete. 2024-08-17T02:25:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.848+0000 7f6049e00640 1 Processor -- start 2024-08-17T02:25:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.848+0000 7f6049e00640 1 -- start start 2024-08-17T02:25:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.849+0000 7f6049e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f604406d7f0 0x7f604413dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.849+0000 7f6049e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6044155a20 0x7f60440a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.849+0000 7f6049e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6044155df0 0x7f60440a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.849+0000 7f6049e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60440a7fe0 con 0x7f6044155df0 2024-08-17T02:25:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.849+0000 7f6049e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60440a8f60 con 0x7f6044155a20 2024-08-17T02:25:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.849+0000 7f6049e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6044151ba0 con 0x7f604406d7f0 2024-08-17T02:25:53.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.849+0000 7f6043400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6044155df0 0x7f60440a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.849+0000 7f6043400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6044155df0 0x7f60440a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37006/0 (socket says 172.21.15.45:37006) 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.849+0000 7f6043400640 1 -- 172.21.15.45:0/2444024615 learned_addr learned my addr 172.21.15.45:0/2444024615 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.849+0000 7f6042a00640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f604406d7f0 0x7f604413dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.849+0000 7f6042000640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6044155a20 0x7f60440a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f6043400640 1 -- 172.21.15.45:0/2444024615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f604406d7f0 msgr2=0x7f604413dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f6043400640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f604406d7f0 0x7f604413dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f6043400640 1 -- 172.21.15.45:0/2444024615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6044155a20 msgr2=0x7f60440a6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f6043400640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6044155a20 0x7f60440a6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f6043400640 1 -- 172.21.15.45:0/2444024615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034009390 con 0x7f6044155df0 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f6042a00640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f604406d7f0 0x7f604413dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f6043400640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6044155df0 0x7f60440a6cc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f603c00cca0 tx=0x7f603c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f603a000640 1 -- 172.21.15.45:0/2444024615 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c00a850 con 0x7f6044155df0 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f603a000640 1 -- 172.21.15.45:0/2444024615 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603c00a9b0 con 0x7f6044155df0 2024-08-17T02:25:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f603a000640 1 -- 172.21.15.45:0/2444024615 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603c00ad70 con 0x7f6044155df0 2024-08-17T02:25:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f6049e00640 1 -- 172.21.15.45:0/2444024615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60440a7360 con 0x7f6044155df0 2024-08-17T02:25:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.850+0000 7f6049e00640 1 -- 172.21.15.45:0/2444024615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60440a7920 con 0x7f6044155df0 2024-08-17T02:25:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.851+0000 7f6049e00640 1 -- 172.21.15.45:0/2444024615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60440a8120 con 0x7f6044155df0 2024-08-17T02:25:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.852+0000 7f603a000640 1 -- 172.21.15.45:0/2444024615 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f603c007300 con 0x7f6044155df0 2024-08-17T02:25:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.853+0000 7f603a000640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6024065150 0x7f6024067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.853+0000 7f603a000640 1 -- 172.21.15.45:0/2444024615 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f603c082660 con 0x7f6044155df0 2024-08-17T02:25:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.853+0000 7f6042a00640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6024065150 0x7f6024067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:53.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.854+0000 7f6042a00640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6024065150 0x7f6024067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6034034000 tx=0x7f6034032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:53.858 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:53.857+0000 7f603a000640 1 -- 172.21.15.45:0/2444024615 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f603c050700 con 0x7f6044155df0 2024-08-17T02:25:54.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.078+0000 7f6049e00640 1 -- 172.21.15.45:0/2444024615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6044064db0 con 0x7f6044155df0 2024-08-17T02:25:54.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.079+0000 7f603a000640 1 -- 172.21.15.45:0/2444024615 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f603c053d20 con 0x7f6044155df0 2024-08-17T02:25:54.079 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:54.080 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1637538519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1637538519},{"type":"v1","addr":"172.21.15.45:6837","nonce":1637538519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1027153973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1027153973},{"type":"v1","addr":"172.21.15.169:6835","nonce":1027153973}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2482387224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2482387224},{"type":"v1","addr":"172.21.15.45:6835","nonce":2482387224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:14.095016+0000","modified":"2024-08-17T02:25:17.687006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6834/911178485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":911178485},{"type":"v1","addr":"172.21.15.169:6834","nonce":911178485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:54.080 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 -- 172.21.15.45:0/2444024615 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6024065150 msgr2=0x7f6024067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6024065150 0x7f6024067600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6034034000 tx=0x7f6034032000 comp rx=0 tx=0).stop 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 -- 172.21.15.45:0/2444024615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6044155df0 msgr2=0x7f60440a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6044155df0 0x7f60440a6cc0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f603c00cca0 tx=0x7f603c001ae0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 -- 172.21.15.45:0/2444024615 shutdown_connections 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6044155df0 0x7f60440a6cc0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6044155a20 0x7f60440a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6024065150 0x7f6024067600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 --2- 172.21.15.45:0/2444024615 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f604406d7f0 0x7f604413dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 -- 172.21.15.45:0/2444024615 >> 172.21.15.45:0/2444024615 conn(0x7f60440cb9b0 msgr2=0x7f60441521a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 -- 172.21.15.45:0/2444024615 shutdown_connections 2024-08-17T02:25:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.081+0000 7f6049e00640 1 -- 172.21.15.45:0/2444024615 wait complete. 2024-08-17T02:25:54.097 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:54.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.250+0000 7facab600640 1 Processor -- start 2024-08-17T02:25:54.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.250+0000 7facab600640 1 -- start start 2024-08-17T02:25:54.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.251+0000 7facab600640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7faca41401b0 0x7faca40caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.251+0000 7facab600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faca40b1440 0x7faca40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.251+0000 7facab600640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca40caa80 con 0x7faca4140580 2024-08-17T02:25:54.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.251+0000 7facab600640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faca40cb450 con 0x7faca41401b0 2024-08-17T02:25:54.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.251+0000 7facab600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca40c9e70 con 0x7faca40b1440 2024-08-17T02:25:54.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.251+0000 7faca3e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faca4140580 0x7faca40b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54448/0 (socket says 172.21.15.45:54448) 2024-08-17T02:25:54.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.251+0000 7faca3e00640 1 -- 172.21.15.45:0/1773148987 learned_addr learned my addr 172.21.15.45:0/1773148987 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:54.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.252+0000 7faca8c00640 1 --2- 172.21.15.45:0/1773148987 >> v2:172.21.15.169:3300/0 conn(0x7faca41401b0 0x7faca40caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.252+0000 7faca9600640 1 --2- 172.21.15.45:0/1773148987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faca40b1440 0x7faca40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.252+0000 7faca3400640 1 -- 172.21.15.45:0/1773148987 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063658803 0 0) 0x7faca40caa80 con 0x7faca4140580 2024-08-17T02:25:54.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.252+0000 7faca3400640 1 -- 172.21.15.45:0/1773148987 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac8c0034e0 con 0x7faca4140580 2024-08-17T02:25:54.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.252+0000 7faca8c00640 1 -- 172.21.15.45:0/1773148987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faca40b1440 msgr2=0x7faca40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:54.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.252+0000 7faca8c00640 1 --2- 172.21.15.45:0/1773148987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faca40b1440 0x7faca40c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.252+0000 7faca8c00640 1 -- 172.21.15.45:0/1773148987 >> v1:172.21.15.45:6789/0 conn(0x7faca4140580 legacy=0x7faca40b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.252+0000 7faca8c00640 1 -- 172.21.15.45:0/1773148987 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca40ca150 con 0x7faca41401b0 2024-08-17T02:25:54.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.252+0000 7faca9600640 1 --2- 172.21.15.45:0/1773148987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faca40b1440 0x7faca40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:54.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.253+0000 7faca8c00640 1 --2- 172.21.15.45:0/1773148987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faca41401b0 0x7faca40caf10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac98009850 tx=0x7fac980090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55ab5ae1f30b49cd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:54.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.254+0000 7faca3400640 1 -- 172.21.15.45:0/1773148987 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9802ad00 con 0x7faca41401b0 2024-08-17T02:25:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.254+0000 7faca3400640 1 -- 172.21.15.45:0/1773148987 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9802ae60 con 0x7faca41401b0 2024-08-17T02:25:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.254+0000 7faca3400640 1 -- 172.21.15.45:0/1773148987 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac98032670 con 0x7faca41401b0 2024-08-17T02:25:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.254+0000 7facab600640 1 -- 172.21.15.45:0/1773148987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faca41401b0 msgr2=0x7faca40caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.254+0000 7facab600640 1 --2- 172.21.15.45:0/1773148987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faca41401b0 0x7faca40caf10 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fac98009850 tx=0x7fac980090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.255+0000 7facab600640 1 -- 172.21.15.45:0/1773148987 shutdown_connections 2024-08-17T02:25:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.255+0000 7facab600640 1 --2- 172.21.15.45:0/1773148987 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faca40b1440 0x7faca40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.255+0000 7facab600640 1 --2- 172.21.15.45:0/1773148987 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faca41401b0 0x7faca40caf10 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.255+0000 7facab600640 1 -- 172.21.15.45:0/1773148987 >> 172.21.15.45:0/1773148987 conn(0x7faca40cb9b0 msgr2=0x7faca40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.255+0000 7facab600640 1 -- 172.21.15.45:0/1773148987 shutdown_connections 2024-08-17T02:25:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.255+0000 7facab600640 1 -- 172.21.15.45:0/1773148987 wait complete. 2024-08-17T02:25:54.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.256+0000 7facab600640 1 Processor -- start 2024-08-17T02:25:54.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.256+0000 7facab600640 1 -- start start 2024-08-17T02:25:54.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.257+0000 7facab600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faca40b1440 0x7faca40a83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.257+0000 7facab600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faca41401b0 0x7faca4156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.257+0000 7facab600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faca4140580 0x7faca4166ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.257+0000 7facab600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca416a2a0 con 0x7faca41401b0 2024-08-17T02:25:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.257+0000 7facab600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca40a6d80 con 0x7faca40b1440 2024-08-17T02:25:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.257+0000 7facab600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca40a7060 con 0x7faca4140580 2024-08-17T02:25:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.257+0000 7faca3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faca41401b0 0x7faca4156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.257+0000 7faca3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faca41401b0 0x7faca4156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37020/0 (socket says 172.21.15.45:37020) 2024-08-17T02:25:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.258+0000 7faca3e00640 1 -- 172.21.15.45:0/2765641009 learned_addr learned my addr 172.21.15.45:0/2765641009 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.258+0000 7faca8c00640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faca40b1440 0x7faca40a83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.258+0000 7faca9600640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faca4140580 0x7faca4166ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.258+0000 7faca3e00640 1 -- 172.21.15.45:0/2765641009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faca4140580 msgr2=0x7faca4166ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.258+0000 7faca3e00640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faca4140580 0x7faca4166ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.258+0000 7faca3e00640 1 -- 172.21.15.45:0/2765641009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faca40b1440 msgr2=0x7faca40a83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.258+0000 7faca3e00640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faca40b1440 0x7faca40a83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.258+0000 7faca3e00640 1 -- 172.21.15.45:0/2765641009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c009a20 con 0x7faca41401b0 2024-08-17T02:25:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.258+0000 7faca3e00640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faca41401b0 0x7faca4156150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c590 tx=0x7fac90007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.259+0000 7fac97e00640 1 -- 172.21.15.45:0/2765641009 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90005b70 con 0x7faca41401b0 2024-08-17T02:25:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.259+0000 7fac97e00640 1 -- 172.21.15.45:0/2765641009 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac90005cf0 con 0x7faca41401b0 2024-08-17T02:25:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.259+0000 7fac97e00640 1 -- 172.21.15.45:0/2765641009 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac90007320 con 0x7faca41401b0 2024-08-17T02:25:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.259+0000 7facab600640 1 -- 172.21.15.45:0/2765641009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac98009390 con 0x7faca41401b0 2024-08-17T02:25:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.259+0000 7facab600640 1 -- 172.21.15.45:0/2765641009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca40a7620 con 0x7faca41401b0 2024-08-17T02:25:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.260+0000 7facab600640 1 -- 172.21.15.45:0/2765641009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca415c1c0 con 0x7faca41401b0 2024-08-17T02:25:54.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.262+0000 7fac97e00640 1 -- 172.21.15.45:0/2765641009 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fac9001b3b0 con 0x7faca41401b0 2024-08-17T02:25:54.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.262+0000 7fac97e00640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac84065150 0x7fac84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.262+0000 7fac97e00640 1 -- 172.21.15.45:0/2765641009 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac900818e0 con 0x7faca41401b0 2024-08-17T02:25:54.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.263+0000 7faca8c00640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac84065150 0x7fac84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.263+0000 7faca8c00640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac84065150 0x7fac84067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fac98034000 tx=0x7fac98032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:54.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.266+0000 7fac97e00640 1 -- 172.21.15.45:0/2765641009 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7faca415c1c0 con 0x7faca41401b0 2024-08-17T02:25:54.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.450+0000 7facab600640 1 -- 172.21.15.45:0/2765641009 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faca415c1c0 con 0x7faca41401b0 2024-08-17T02:25:54.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.451+0000 7fac97e00640 1 -- 172.21.15.45:0/2765641009 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7faca415c1c0 con 0x7faca41401b0 2024-08-17T02:25:54.452 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:54.452 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 -- 172.21.15.45:0/2765641009 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac84065150 msgr2=0x7fac84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac84065150 0x7fac84067600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fac98034000 tx=0x7fac98032000 comp rx=0 tx=0).stop 2024-08-17T02:25:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 -- 172.21.15.45:0/2765641009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faca41401b0 msgr2=0x7faca4156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faca41401b0 0x7faca4156150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fac9000c590 tx=0x7fac90007d70 comp rx=0 tx=0).stop 2024-08-17T02:25:54.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 -- 172.21.15.45:0/2765641009 shutdown_connections 2024-08-17T02:25:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac84065150 0x7fac84067600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7faca4140580 0x7faca4166ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faca41401b0 0x7faca4156150 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 --2- 172.21.15.45:0/2765641009 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7faca40b1440 0x7faca40a83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 -- 172.21.15.45:0/2765641009 >> 172.21.15.45:0/2765641009 conn(0x7faca40cb9b0 msgr2=0x7faca406cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 -- 172.21.15.45:0/2765641009 shutdown_connections 2024-08-17T02:25:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.453+0000 7facab600640 1 -- 172.21.15.45:0/2765641009 wait complete. 2024-08-17T02:25:54.469 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:25:54.470 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:54.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.624+0000 7fd6ca200640 1 Processor -- start 2024-08-17T02:25:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.625+0000 7fd6ca200640 1 -- start start 2024-08-17T02:25:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.626+0000 7fd6ca200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fd6c40ccca0 0x7fd6c4163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.626 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.626+0000 7fd6ca200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c40cadc0 con 0x7fd6c40ceb40 2024-08-17T02:25:54.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.626+0000 7fd6ca200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c40cb060 con 0x7fd6c4159ca0 2024-08-17T02:25:54.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.626+0000 7fd6ca200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c40cd6e0 con 0x7fd6c40ccca0 2024-08-17T02:25:54.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.626+0000 7fd6c3e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd6c40ceb40 0x7fd6c40cc590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54452/0 (socket says 172.21.15.45:54452) 2024-08-17T02:25:54.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.626+0000 7fd6c3e00640 1 -- 172.21.15.45:0/2214259925 learned_addr learned my addr 172.21.15.45:0/2214259925 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.626+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717711860 0 0) 0x7fd6c40cadc0 con 0x7fd6c40ceb40 2024-08-17T02:25:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.626+0000 7fd6c9800640 1 --2- 172.21.15.45:0/2214259925 >> v2:172.21.15.169:3300/0 conn(0x7fd6c40ccca0 0x7fd6c4163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.626+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6ac0034e0 con 0x7fd6c40ceb40 2024-08-17T02:25:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2918143952 0 0) 0x7fd6ac0034e0 con 0x7fd6c40ceb40 2024-08-17T02:25:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 >> v2:172.21.15.169:3300/0 conn(0x7fd6c40ccca0 msgr2=0x7fd6c4163870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 --2- 172.21.15.45:0/2214259925 >> v2:172.21.15.169:3300/0 conn(0x7fd6c40ccca0 0x7fd6c4163870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 >> v1:172.21.15.169:6789/0 conn(0x7fd6c4159ca0 legacy=0x7fd6c40ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40cb300 con 0x7fd6c40ceb40 2024-08-17T02:25:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7fd6b0001490 con 0x7fd6c40ceb40 2024-08-17T02:25:54.629 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 >> v1:172.21.15.45:6789/0 conn(0x7fd6c40ceb40 legacy=0x7fd6c40cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ac0039d0 0x7fd6ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ac004780 0x7fd6ac004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6ac005130 0x7fd6ac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40cd6e0 con 0x7fd6ac004780 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac00bfc0 con 0x7fd6ac0039d0 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac00c180 con 0x7fd6ac005130 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c3e00640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ac004780 0x7fd6ac004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.627+0000 7fd6c8e00640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ac0039d0 0x7fd6ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.628+0000 7fd6c3e00640 1 -- 172.21.15.45:0/2214259925 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6ac005130 msgr2=0x7fd6ac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.628+0000 7fd6c9800640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6ac005130 0x7fd6ac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.628+0000 7fd6c3e00640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6ac005130 0x7fd6ac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.628+0000 7fd6c3e00640 1 -- 172.21.15.45:0/2214259925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ac0039d0 msgr2=0x7fd6ac003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:54.630 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.628+0000 7fd6c3e00640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ac0039d0 0x7fd6ac003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.628+0000 7fd6c3e00640 1 -- 172.21.15.45:0/2214259925 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac0034e0 con 0x7fd6ac004780 2024-08-17T02:25:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.628+0000 7fd6c8e00640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ac0039d0 0x7fd6ac003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.628+0000 7fd6c9800640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6ac005130 0x7fd6ac00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:54.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.628+0000 7fd6c9800640 1 -- 172.21.15.45:0/2214259925 reap_dead start 2024-08-17T02:25:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.629+0000 7fd6c3e00640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ac004780 0x7fd6ac004bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4089ab0 tx=0x7fd6c40caf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb527ee5fccbc188 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.629+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0005890 con 0x7fd6ac004780 2024-08-17T02:25:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.629+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b002d070 con 0x7fd6ac004780 2024-08-17T02:25:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.629+0000 7fd6c3400640 1 -- 172.21.15.45:0/2214259925 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0005a30 con 0x7fd6ac004780 2024-08-17T02:25:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.630+0000 7fd6ca200640 1 -- 172.21.15.45:0/2214259925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ac004780 msgr2=0x7fd6ac004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.630+0000 7fd6ca200640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ac004780 0x7fd6ac004bf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4089ab0 tx=0x7fd6c40caf50 comp rx=0 tx=0).stop 2024-08-17T02:25:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.630+0000 7fd6ca200640 1 -- 172.21.15.45:0/2214259925 shutdown_connections 2024-08-17T02:25:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.630+0000 7fd6ca200640 1 --2- 172.21.15.45:0/2214259925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6ac004780 0x7fd6ac004bf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.630+0000 7fd6ca200640 1 -- 172.21.15.45:0/2214259925 >> 172.21.15.45:0/2214259925 conn(0x7fd6c4098e00 msgr2=0x7fd6c406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:54.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.630+0000 7fd6ca200640 1 -- 172.21.15.45:0/2214259925 shutdown_connections 2024-08-17T02:25:54.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.630+0000 7fd6ca200640 1 -- 172.21.15.45:0/2214259925 wait complete. 2024-08-17T02:25:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.632+0000 7fd6ca200640 1 Processor -- start 2024-08-17T02:25:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.632+0000 7fd6ca200640 1 -- start start 2024-08-17T02:25:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.632+0000 7fd6ca200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ac004780 0x7fd6c40c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6ca200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6c4155680 0x7fd6c40c5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6ca200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c4147cf0 0x7fd6c4155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6ca200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40c6bc0 con 0x7fd6c4147cf0 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6ca200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40c5bd0 con 0x7fd6ac004780 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6ca200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40c6dd0 con 0x7fd6c4155680 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6c9800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c4147cf0 0x7fd6c4155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6c9800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c4147cf0 0x7fd6c4155c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37032/0 (socket says 172.21.15.45:37032) 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6c9800640 1 -- 172.21.15.45:0/3923569969 learned_addr learned my addr 172.21.15.45:0/3923569969 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6c8e00640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ac004780 0x7fd6c40c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6c3e00640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6c4155680 0x7fd6c40c5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6c9800640 1 -- 172.21.15.45:0/3923569969 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6c4155680 msgr2=0x7fd6c40c5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6c9800640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6c4155680 0x7fd6c40c5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6c9800640 1 -- 172.21.15.45:0/3923569969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ac004780 msgr2=0x7fd6c40c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6c9800640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ac004780 0x7fd6c40c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6c9800640 1 -- 172.21.15.45:0/3923569969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40c70b0 con 0x7fd6c4147cf0 2024-08-17T02:25:54.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.633+0000 7fd6c8e00640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ac004780 0x7fd6c40c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:54.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.634+0000 7fd6c9800640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c4147cf0 0x7fd6c4155c30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40cd0c0 tx=0x7fd6bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:54.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.634+0000 7fd6b7e00640 1 -- 172.21.15.45:0/3923569969 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc009bf0 con 0x7fd6c4147cf0 2024-08-17T02:25:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.634+0000 7fd6b7e00640 1 -- 172.21.15.45:0/3923569969 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc0145e0 con 0x7fd6c4147cf0 2024-08-17T02:25:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.634+0000 7fd6ca200640 1 -- 172.21.15.45:0/3923569969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c40c7390 con 0x7fd6c4147cf0 2024-08-17T02:25:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.634+0000 7fd6b7e00640 1 -- 172.21.15.45:0/3923569969 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc014980 con 0x7fd6c4147cf0 2024-08-17T02:25:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.634+0000 7fd6ca200640 1 -- 172.21.15.45:0/3923569969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c40c7950 con 0x7fd6c4147cf0 2024-08-17T02:25:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.635+0000 7fd6ca200640 1 -- 172.21.15.45:0/3923569969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c40c83b0 con 0x7fd6c4147cf0 2024-08-17T02:25:54.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.636+0000 7fd6b7e00640 1 -- 172.21.15.45:0/3923569969 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd6bc016420 con 0x7fd6c4147cf0 2024-08-17T02:25:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.637+0000 7fd6b7e00640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd6a4065180 0x7fd6a4067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.637+0000 7fd6b7e00640 1 -- 172.21.15.45:0/3923569969 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd6bc0829d0 con 0x7fd6c4147cf0 2024-08-17T02:25:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.637+0000 7fd6c8e00640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd6a4065180 0x7fd6a4067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:54.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.638+0000 7fd6c8e00640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd6a4065180 0x7fd6a4067630 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8003af0 tx=0x7fd6b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:54.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.641+0000 7fd6b7e00640 1 -- 172.21.15.45:0/3923569969 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd6bc0509f0 con 0x7fd6c4147cf0 2024-08-17T02:25:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.867+0000 7fd6ca200640 1 -- 172.21.15.45:0/3923569969 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6c40c7b40 con 0x7fd6c4147cf0 2024-08-17T02:25:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.868+0000 7fd6b7e00640 1 -- 172.21.15.45:0/3923569969 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7fd6bc054010 con 0x7fd6c4147cf0 2024-08-17T02:25:54.869 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:54.869 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1637538519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1637538519},{"type":"v1","addr":"172.21.15.45:6837","nonce":1637538519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1027153973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1027153973},{"type":"v1","addr":"172.21.15.169:6835","nonce":1027153973}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2482387224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2482387224},{"type":"v1","addr":"172.21.15.45:6835","nonce":2482387224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:14.095016+0000","modified":"2024-08-17T02:25:17.687006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6834/911178485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":911178485},{"type":"v1","addr":"172.21.15.169:6834","nonce":911178485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:54.869 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2024-08-17T02:25:54.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 -- 172.21.15.45:0/3923569969 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd6a4065180 msgr2=0x7fd6a4067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd6a4065180 0x7fd6a4067630 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8003af0 tx=0x7fd6b8009040 comp rx=0 tx=0).stop 2024-08-17T02:25:54.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 -- 172.21.15.45:0/3923569969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c4147cf0 msgr2=0x7fd6c4155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:54.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c4147cf0 0x7fd6c4155c30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40cd0c0 tx=0x7fd6bc00b040 comp rx=0 tx=0).stop 2024-08-17T02:25:54.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 -- 172.21.15.45:0/3923569969 shutdown_connections 2024-08-17T02:25:54.871 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6c4147cf0 0x7fd6c4155c30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd6a4065180 0x7fd6a4067630 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd6c4155680 0x7fd6c40c5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 --2- 172.21.15.45:0/3923569969 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd6ac004780 0x7fd6c40c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 -- 172.21.15.45:0/3923569969 >> 172.21.15.45:0/3923569969 conn(0x7fd6c4098e00 msgr2=0x7fd6c4068850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 -- 172.21.15.45:0/3923569969 shutdown_connections 2024-08-17T02:25:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:54.870+0000 7fd6ca200640 1 -- 172.21.15.45:0/3923569969 wait complete. 2024-08-17T02:25:54.887 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:25:55.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.040+0000 7f0130a00640 1 Processor -- start 2024-08-17T02:25:55.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.040+0000 7f0130a00640 1 -- start start 2024-08-17T02:25:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.041+0000 7f0130a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f012c15a050 0x7f012c1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.041+0000 7f0130a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f012c0cd750 0x7f012c0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.041+0000 7f0130a00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f012c0cbd90 con 0x7f012c158cf0 2024-08-17T02:25:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.041+0000 7f0130a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012c0cb4d0 con 0x7f012c0cd750 2024-08-17T02:25:55.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.041+0000 7f0130a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f012c0cb740 con 0x7f012c15a050 2024-08-17T02:25:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.041+0000 7f012be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f012c0cd750 0x7f012c0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.041+0000 7f012be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f012c0cd750 0x7f012c0cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37034/0 (socket says 172.21.15.45:37034) 2024-08-17T02:25:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.041+0000 7f012be00640 1 -- 172.21.15.45:0/4260329780 learned_addr learned my addr 172.21.15.45:0/4260329780 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.042+0000 7f012aa00640 1 --2- 172.21.15.45:0/4260329780 >> v2:172.21.15.169:3300/0 conn(0x7f012c15a050 0x7f012c1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.042+0000 7f012be00640 1 -- 172.21.15.45:0/4260329780 >> v2:172.21.15.169:3300/0 conn(0x7f012c15a050 msgr2=0x7f012c1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.042+0000 7f012be00640 1 --2- 172.21.15.45:0/4260329780 >> v2:172.21.15.169:3300/0 conn(0x7f012c15a050 0x7f012c1597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.042+0000 7f012be00640 1 -- 172.21.15.45:0/4260329780 >> v1:172.21.15.169:6789/0 conn(0x7f012c158cf0 legacy=0x7f012c1590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.042+0000 7f012be00640 1 -- 172.21.15.45:0/4260329780 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f012c0cba20 con 0x7f012c0cd750 2024-08-17T02:25:55.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.043+0000 7f012be00640 1 --2- 172.21.15.45:0/4260329780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f012c0cd750 0x7f012c0cdbb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f012c088d00 tx=0x7f0124009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247dd616f0ee507 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.043+0000 7f012a000640 1 -- 172.21.15.45:0/4260329780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f012402e050 con 0x7f012c0cd750 2024-08-17T02:25:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.043+0000 7f012a000640 1 -- 172.21.15.45:0/4260329780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0124007400 con 0x7f012c0cd750 2024-08-17T02:25:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.043+0000 7f012a000640 1 -- 172.21.15.45:0/4260329780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01240077e0 con 0x7f012c0cd750 2024-08-17T02:25:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.044+0000 7f0130a00640 1 -- 172.21.15.45:0/4260329780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f012c0cd750 msgr2=0x7f012c0cdbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.044+0000 7f0130a00640 1 --2- 172.21.15.45:0/4260329780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f012c0cd750 0x7f012c0cdbb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f012c088d00 tx=0x7f0124009840 comp rx=0 tx=0).stop 2024-08-17T02:25:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.044+0000 7f0130a00640 1 -- 172.21.15.45:0/4260329780 shutdown_connections 2024-08-17T02:25:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.044+0000 7f0130a00640 1 --2- 172.21.15.45:0/4260329780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f012c0cd750 0x7f012c0cdbb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.044+0000 7f0130a00640 1 --2- 172.21.15.45:0/4260329780 >> v2:172.21.15.169:3300/0 conn(0x7f012c15a050 0x7f012c1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.044+0000 7f0130a00640 1 -- 172.21.15.45:0/4260329780 >> 172.21.15.45:0/4260329780 conn(0x7f012c06eb90 msgr2=0x7f012c0cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.044+0000 7f0130a00640 1 -- 172.21.15.45:0/4260329780 shutdown_connections 2024-08-17T02:25:55.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.044+0000 7f0130a00640 1 -- 172.21.15.45:0/4260329780 wait complete. 2024-08-17T02:25:55.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.045+0000 7f0130a00640 1 Processor -- start 2024-08-17T02:25:55.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.045+0000 7f0130a00640 1 -- start start 2024-08-17T02:25:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.046+0000 7f0130a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f012c0cd750 0x7f012c0b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.046+0000 7f0130a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f012c158cf0 0x7f012c09a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.046+0000 7f0130a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f012c15a050 0x7f012c144490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.046+0000 7f0130a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c09b090 con 0x7f012c0cd750 2024-08-17T02:25:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.046+0000 7f0130a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f012c09aae0 con 0x7f012c15a050 2024-08-17T02:25:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.046+0000 7f0130a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f012c09adb0 con 0x7f012c158cf0 2024-08-17T02:25:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.046+0000 7f012b400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f012c0cd750 0x7f012c0b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f012b400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f012c0cd750 0x7f012c0b5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37038/0 (socket says 172.21.15.45:37038) 2024-08-17T02:25:55.048 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f012b400640 1 -- 172.21.15.45:0/4261273010 learned_addr learned my addr 172.21.15.45:0/4261273010 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f012aa00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f012c158cf0 0x7f012c09a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f012be00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f012c15a050 0x7f012c144490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f012b400640 1 -- 172.21.15.45:0/4261273010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f012c158cf0 msgr2=0x7f012c09a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f012b400640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f012c158cf0 0x7f012c09a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f012b400640 1 -- 172.21.15.45:0/4261273010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f012c15a050 msgr2=0x7f012c144490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f012b400640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f012c15a050 0x7f012c144490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f012b400640 1 -- 172.21.15.45:0/4261273010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0124009ae0 con 0x7f012c0cd750 2024-08-17T02:25:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f012aa00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f012c158cf0 0x7f012c09a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:55.049 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f012b400640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f012c0cd750 0x7f012c0b5430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c560 tx=0x7f011c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.047+0000 7f0122a00640 1 -- 172.21.15.45:0/4261273010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c011590 con 0x7f012c0cd750 2024-08-17T02:25:55.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.048+0000 7f0122a00640 1 -- 172.21.15.45:0/4261273010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f011c011710 con 0x7f012c0cd750 2024-08-17T02:25:55.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.048+0000 7f0122a00640 1 -- 172.21.15.45:0/4261273010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f011c011ad0 con 0x7f012c0cd750 2024-08-17T02:25:55.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.048+0000 7f0130a00640 1 -- 172.21.15.45:0/4261273010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f012c0b4950 con 0x7f012c0cd750 2024-08-17T02:25:55.050 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.048+0000 7f0130a00640 1 -- 172.21.15.45:0/4261273010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f012c0b4f10 con 0x7f012c0cd750 2024-08-17T02:25:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.049+0000 7f0130a00640 1 -- 172.21.15.45:0/4261273010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f012c0b5130 con 0x7f012c0cd750 2024-08-17T02:25:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.049+0000 7f0122a00640 1 -- 172.21.15.45:0/4261273010 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f011c01b3b0 con 0x7f012c0cd750 2024-08-17T02:25:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.050+0000 7f0122a00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f010c065150 0x7f010c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.050+0000 7f0122a00640 1 -- 172.21.15.45:0/4261273010 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f011c081a90 con 0x7f012c0cd750 2024-08-17T02:25:55.051 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.051+0000 7f012aa00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f010c065150 0x7f010c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.052 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.051+0000 7f012aa00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f010c065150 0x7f010c067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f012c148060 tx=0x7f0118008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.055 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.054+0000 7f0122a00640 1 -- 172.21.15.45:0/4261273010 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f011c04fab0 con 0x7f012c0cd750 2024-08-17T02:25:55.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.274+0000 7f0130a00640 1 -- 172.21.15.45:0/4261273010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f012c071050 con 0x7f012c0cd750 2024-08-17T02:25:55.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.275+0000 7f0122a00640 1 -- 172.21.15.45:0/4261273010 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4594 (secure 0 0 0) 0x7f011c017070 con 0x7f012c0cd750 2024-08-17T02:25:55.275 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:55.276 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1637538519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":1637538519},{"type":"v1","addr":"172.21.15.45:6837","nonce":1637538519}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1027153973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1027153973},{"type":"v1","addr":"172.21.15.169:6835","nonce":1027153973}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4269,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2482387224","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2482387224},{"type":"v1","addr":"172.21.15.45:6835","nonce":2482387224}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:25:14.095016+0000","modified":"2024-08-17T02:25:17.687006+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4291},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4291":{"gid":4291,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.169:6834/911178485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":911178485},{"type":"v1","addr":"172.21.15.169:6834","nonce":911178485}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-08-17T02:25:55.276 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2024-08-17T02:25:55.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 -- 172.21.15.45:0/4261273010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f010c065150 msgr2=0x7f010c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f010c065150 0x7f010c067600 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f012c148060 tx=0x7f0118008040 comp rx=0 tx=0).stop 2024-08-17T02:25:55.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 -- 172.21.15.45:0/4261273010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f012c0cd750 msgr2=0x7f012c0b5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f012c0cd750 0x7f012c0b5430 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f011c00c560 tx=0x7f011c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 -- 172.21.15.45:0/4261273010 shutdown_connections 2024-08-17T02:25:55.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f012c15a050 0x7f012c144490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f010c065150 0x7f010c067600 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f012c158cf0 0x7f012c09a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 --2- 172.21.15.45:0/4261273010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f012c0cd750 0x7f012c0b5430 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 -- 172.21.15.45:0/4261273010 >> 172.21.15.45:0/4261273010 conn(0x7f012c06eb90 msgr2=0x7f012c0cdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:55.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 -- 172.21.15.45:0/4261273010 shutdown_connections 2024-08-17T02:25:55.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.277+0000 7f0130a00640 1 -- 172.21.15.45:0/4261273010 wait complete. 2024-08-17T02:25:55.293 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:25:55.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.444+0000 7f6a74c00640 1 Processor -- start 2024-08-17T02:25:55.445 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.444+0000 7f6a74c00640 1 -- start start 2024-08-17T02:25:55.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.445+0000 7f6a74c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a70158ce0 0x7f6a700c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.446+0000 7f6a74c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a700cb7c0 con 0x7f6a700d08d0 2024-08-17T02:25:55.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.446+0000 7f6a74c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a700ceb20 con 0x7f6a700cb340 2024-08-17T02:25:55.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.446+0000 7f6a74c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700cf0c0 con 0x7f6a70158ce0 2024-08-17T02:25:55.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.446+0000 7f6a67e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6a700d08d0 0x7f6a700cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54454/0 (socket says 172.21.15.45:54454) 2024-08-17T02:25:55.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.446+0000 7f6a67e00640 1 -- 172.21.15.45:0/221691650 learned_addr learned my addr 172.21.15.45:0/221691650 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:55.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.446+0000 7f6a6de00640 1 --2- 172.21.15.45:0/221691650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a70158ce0 0x7f6a700c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.446+0000 7f6a6d400640 1 -- 172.21.15.45:0/221691650 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863263159 0 0) 0x7f6a700cb7c0 con 0x7f6a700d08d0 2024-08-17T02:25:55.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.446+0000 7f6a6d400640 1 -- 172.21.15.45:0/221691650 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a540034e0 con 0x7f6a700d08d0 2024-08-17T02:25:55.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.446+0000 7f6a6d400640 1 -- 172.21.15.45:0/221691650 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693376904 0 0) 0x7f6a700ceb20 con 0x7f6a700cb340 2024-08-17T02:25:55.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.447+0000 7f6a6d400640 1 -- 172.21.15.45:0/221691650 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a700cb7c0 con 0x7f6a700cb340 2024-08-17T02:25:55.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.447+0000 7f6a6de00640 1 -- 172.21.15.45:0/221691650 >> v1:172.21.15.169:6789/0 conn(0x7f6a700cb340 legacy=0x7f6a700c5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.447+0000 7f6a6de00640 1 -- 172.21.15.45:0/221691650 >> v1:172.21.15.45:6789/0 conn(0x7f6a700d08d0 legacy=0x7f6a700cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.447+0000 7f6a6de00640 1 -- 172.21.15.45:0/221691650 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a700cede0 con 0x7f6a70158ce0 2024-08-17T02:25:55.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.448+0000 7f6a6de00640 1 --2- 172.21.15.45:0/221691650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a70158ce0 0x7f6a700c68c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009880 tx=0x7f6a600090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f5dcdfb518df4a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.448+0000 7f6a6d400640 1 -- 172.21.15.45:0/221691650 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6002ae10 con 0x7f6a70158ce0 2024-08-17T02:25:55.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.448+0000 7f6a6d400640 1 -- 172.21.15.45:0/221691650 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a60032440 con 0x7f6a70158ce0 2024-08-17T02:25:55.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.448+0000 7f6a6d400640 1 -- 172.21.15.45:0/221691650 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a600327c0 con 0x7f6a70158ce0 2024-08-17T02:25:55.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.448+0000 7f6a74c00640 1 -- 172.21.15.45:0/221691650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a70158ce0 msgr2=0x7f6a700c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.448+0000 7f6a74c00640 1 --2- 172.21.15.45:0/221691650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a70158ce0 0x7f6a700c68c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6a60009880 tx=0x7f6a600090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.449+0000 7f6a74c00640 1 -- 172.21.15.45:0/221691650 shutdown_connections 2024-08-17T02:25:55.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.449+0000 7f6a74c00640 1 --2- 172.21.15.45:0/221691650 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a70158ce0 0x7f6a700c68c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.449+0000 7f6a74c00640 1 -- 172.21.15.45:0/221691650 >> 172.21.15.45:0/221691650 conn(0x7f6a700cfdc0 msgr2=0x7f6a700d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:55.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.449+0000 7f6a74c00640 1 -- 172.21.15.45:0/221691650 shutdown_connections 2024-08-17T02:25:55.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.449+0000 7f6a74c00640 1 -- 172.21.15.45:0/221691650 wait complete. 2024-08-17T02:25:55.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.450+0000 7f6a74c00640 1 Processor -- start 2024-08-17T02:25:55.451 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.450+0000 7f6a74c00640 1 -- start start 2024-08-17T02:25:55.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.451+0000 7f6a74c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a700cb340 0x7f6a70153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.451+0000 7f6a74c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a700d08d0 0x7f6a700c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.451+0000 7f6a74c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a70158ce0 0x7f6a700c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.451+0000 7f6a74c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700b4430 con 0x7f6a700d08d0 2024-08-17T02:25:55.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.451+0000 7f6a74c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700b3820 con 0x7f6a700cb340 2024-08-17T02:25:55.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.451+0000 7f6a74c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a700b3b00 con 0x7f6a70158ce0 2024-08-17T02:25:55.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.451+0000 7f6a67e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a700d08d0 0x7f6a700c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.451+0000 7f6a67e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a700d08d0 0x7f6a700c85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37054/0 (socket says 172.21.15.45:37054) 2024-08-17T02:25:55.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.451+0000 7f6a67e00640 1 -- 172.21.15.45:0/285487311 learned_addr learned my addr 172.21.15.45:0/285487311 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:55.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.451+0000 7f6a6e800640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a70158ce0 0x7f6a700c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a6de00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a700cb340 0x7f6a70153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a67e00640 1 -- 172.21.15.45:0/285487311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a70158ce0 msgr2=0x7f6a700c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a67e00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a70158ce0 0x7f6a700c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a67e00640 1 -- 172.21.15.45:0/285487311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a700cb340 msgr2=0x7f6a70153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a67e00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a700cb340 0x7f6a70153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a67e00640 1 -- 172.21.15.45:0/285487311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a60009390 con 0x7f6a700d08d0 2024-08-17T02:25:55.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a6de00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a700cb340 0x7f6a70153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:25:55.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a67e00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a700d08d0 0x7f6a700c85f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a58005840 tx=0x7f6a58007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a65600640 1 -- 172.21.15.45:0/285487311 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a58005aa0 con 0x7f6a700d08d0 2024-08-17T02:25:55.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a65600640 1 -- 172.21.15.45:0/285487311 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a58005c00 con 0x7f6a700d08d0 2024-08-17T02:25:55.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a74c00640 1 -- 172.21.15.45:0/285487311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a700b3de0 con 0x7f6a700d08d0 2024-08-17T02:25:55.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.452+0000 7f6a65600640 1 -- 172.21.15.45:0/285487311 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a580070f0 con 0x7f6a700d08d0 2024-08-17T02:25:55.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.453+0000 7f6a74c00640 1 -- 172.21.15.45:0/285487311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a70153c90 con 0x7f6a700d08d0 2024-08-17T02:25:55.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.454+0000 7f6a74c00640 1 -- 172.21.15.45:0/285487311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a70064db0 con 0x7f6a700d08d0 2024-08-17T02:25:55.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.454+0000 7f6a65600640 1 -- 172.21.15.45:0/285487311 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6a58007520 con 0x7f6a700d08d0 2024-08-17T02:25:55.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.455+0000 7f6a65600640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6a4c065150 0x7f6a4c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.455+0000 7f6a65600640 1 -- 172.21.15.45:0/285487311 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a58081f40 con 0x7f6a700d08d0 2024-08-17T02:25:55.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.455+0000 7f6a6de00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6a4c065150 0x7f6a4c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.456+0000 7f6a6de00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6a4c065150 0x7f6a4c067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6a60034000 tx=0x7f6a60032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.459+0000 7f6a65600640 1 -- 172.21.15.45:0/285487311 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6a5804ffe0 con 0x7f6a700d08d0 2024-08-17T02:25:55.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.646+0000 7f6a74c00640 1 -- 172.21.15.45:0/285487311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a70070430 con 0x7f6a700d08d0 2024-08-17T02:25:55.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.647+0000 7f6a65600640 1 -- 172.21.15.45:0/285487311 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f6a58053600 con 0x7f6a700d08d0 2024-08-17T02:25:55.647 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:25:55.648 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:25:15.663751+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:25:12.166249+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-17T02:25:13.072271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:25:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 -- 172.21.15.45:0/285487311 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6a4c065150 msgr2=0x7f6a4c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6a4c065150 0x7f6a4c067600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6a60034000 tx=0x7f6a60032000 comp rx=0 tx=0).stop 2024-08-17T02:25:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 -- 172.21.15.45:0/285487311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a700d08d0 msgr2=0x7f6a700c85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a700d08d0 0x7f6a700c85f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6a58005840 tx=0x7f6a58007e10 comp rx=0 tx=0).stop 2024-08-17T02:25:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 -- 172.21.15.45:0/285487311 shutdown_connections 2024-08-17T02:25:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6a4c065150 0x7f6a4c067600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a70158ce0 0x7f6a700c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a700d08d0 0x7f6a700c85f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 --2- 172.21.15.45:0/285487311 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a700cb340 0x7f6a70153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 -- 172.21.15.45:0/285487311 >> 172.21.15.45:0/285487311 conn(0x7f6a700cfdc0 msgr2=0x7f6a700cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:55.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 -- 172.21.15.45:0/285487311 shutdown_connections 2024-08-17T02:25:55.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.649+0000 7f6a74c00640 1 -- 172.21.15.45:0/285487311 wait complete. 2024-08-17T02:25:55.665 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:25:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.817+0000 7f4ce7a00640 1 Processor -- start 2024-08-17T02:25:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.817+0000 7f4ce7a00640 1 -- start start 2024-08-17T02:25:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.818+0000 7f4ce7a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ce0158f80 0x7f4ce00ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.818+0000 7f4ce7a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ce00cf280 0x7f4ce00ade50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.818+0000 7f4ce7a00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ce00cb560 con 0x7f4ce0159350 2024-08-17T02:25:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.818+0000 7f4ce7a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce00cf7e0 con 0x7f4ce0158f80 2024-08-17T02:25:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.818+0000 7f4ce7a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00cfac0 con 0x7f4ce00cf280 2024-08-17T02:25:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.818+0000 7f4ce5000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4ce0158f80 0x7f4ce00ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.818+0000 7f4cdfe00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4ce0159350 0x7f4ce00cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54470/0 (socket says 172.21.15.45:54470) 2024-08-17T02:25:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.819+0000 7f4cdfe00640 1 -- 172.21.15.45:0/1550607233 learned_addr learned my addr 172.21.15.45:0/1550607233 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.819+0000 7f4ce5000640 1 -- 172.21.15.45:0/1550607233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ce00cf280 msgr2=0x7f4ce00ade50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.819+0000 7f4ce5a00640 1 --2- 172.21.15.45:0/1550607233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ce00cf280 0x7f4ce00ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.819+0000 7f4ce5000640 1 --2- 172.21.15.45:0/1550607233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ce00cf280 0x7f4ce00ade50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.819+0000 7f4ce5000640 1 -- 172.21.15.45:0/1550607233 >> v1:172.21.15.45:6789/0 conn(0x7f4ce0159350 legacy=0x7f4ce00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.819+0000 7f4ce5000640 1 -- 172.21.15.45:0/1550607233 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce00caf10 con 0x7f4ce0158f80 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.819+0000 7f4cdf400640 1 -- 172.21.15.45:0/1550607233 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2832130083 0 0) 0x7f4ce00cb560 con 0x7f4ce0159350 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.819+0000 7f4ce5a00640 1 --2- 172.21.15.45:0/1550607233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ce00cf280 0x7f4ce00ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:25:55.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.820+0000 7f4ce5000640 1 --2- 172.21.15.45:0/1550607233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ce0158f80 0x7f4ce00ca330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009850 tx=0x7f4cd40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7ba3445e4cb507 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.820+0000 7f4cdf400640 1 -- 172.21.15.45:0/1550607233 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd402ad80 con 0x7f4ce0158f80 2024-08-17T02:25:55.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.820+0000 7f4cdf400640 1 -- 172.21.15.45:0/1550607233 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd4032440 con 0x7f4ce0158f80 2024-08-17T02:25:55.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.820+0000 7f4cdf400640 1 -- 172.21.15.45:0/1550607233 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd40327e0 con 0x7f4ce0158f80 2024-08-17T02:25:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.821+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1550607233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ce0158f80 msgr2=0x7f4ce00ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.821+0000 7f4ce7a00640 1 --2- 172.21.15.45:0/1550607233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ce0158f80 0x7f4ce00ca330 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009850 tx=0x7f4cd40090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.821+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1550607233 shutdown_connections 2024-08-17T02:25:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.821+0000 7f4ce7a00640 1 --2- 172.21.15.45:0/1550607233 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ce00cf280 0x7f4ce00ade50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.821+0000 7f4ce7a00640 1 --2- 172.21.15.45:0/1550607233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ce0158f80 0x7f4ce00ca330 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.821+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1550607233 >> 172.21.15.45:0/1550607233 conn(0x7f4ce00cfd90 msgr2=0x7f4ce00d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.821+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1550607233 shutdown_connections 2024-08-17T02:25:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.821+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1550607233 wait complete. 2024-08-17T02:25:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.822+0000 7f4ce7a00640 1 Processor -- start 2024-08-17T02:25:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.823+0000 7f4ce7a00640 1 -- start start 2024-08-17T02:25:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.823+0000 7f4ce7a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ce00cf280 0x7f4ce00c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.823+0000 7f4ce7a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ce0158f80 0x7f4ce00b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.823+0000 7f4ce7a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ce0159350 0x7f4ce015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.823+0000 7f4ce7a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce00b3610 con 0x7f4ce0158f80 2024-08-17T02:25:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.823+0000 7f4ce7a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce015bec0 con 0x7f4ce0159350 2024-08-17T02:25:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.823+0000 7f4ce7a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce015c1a0 con 0x7f4ce00cf280 2024-08-17T02:25:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.824+0000 7f4cdfe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ce0158f80 0x7f4ce00b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.824+0000 7f4cdfe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ce0158f80 0x7f4ce00b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37064/0 (socket says 172.21.15.45:37064) 2024-08-17T02:25:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.824+0000 7f4cdfe00640 1 -- 172.21.15.45:0/1239646572 learned_addr learned my addr 172.21.15.45:0/1239646572 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.824+0000 7f4ce5000640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ce00cf280 0x7f4ce00c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.824+0000 7f4ce5a00640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ce0159350 0x7f4ce015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.824+0000 7f4cdfe00640 1 -- 172.21.15.45:0/1239646572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ce00cf280 msgr2=0x7f4ce00c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.824+0000 7f4cdfe00640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ce00cf280 0x7f4ce00c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.824+0000 7f4cdfe00640 1 -- 172.21.15.45:0/1239646572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ce0159350 msgr2=0x7f4ce015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.824+0000 7f4cdfe00640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ce0159350 0x7f4ce015afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.824+0000 7f4cdfe00640 1 -- 172.21.15.45:0/1239646572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4009390 con 0x7f4ce0158f80 2024-08-17T02:25:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.824+0000 7f4cdfe00640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ce0158f80 0x7f4ce00b2c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00c5e0 tx=0x7f4ccc007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.825+0000 7f4cd3e00640 1 -- 172.21.15.45:0/1239646572 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc005aa0 con 0x7f4ce0158f80 2024-08-17T02:25:55.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.825+0000 7f4cd3e00640 1 -- 172.21.15.45:0/1239646572 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc005c00 con 0x7f4ce0158f80 2024-08-17T02:25:55.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.825+0000 7f4cd3e00640 1 -- 172.21.15.45:0/1239646572 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ccc0070f0 con 0x7f4ce0158f80 2024-08-17T02:25:55.827 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.825+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1239646572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce015c480 con 0x7f4ce0158f80 2024-08-17T02:25:55.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.825+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1239646572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce00b31c0 con 0x7f4ce0158f80 2024-08-17T02:25:55.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.826+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1239646572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce00b3780 con 0x7f4ce0158f80 2024-08-17T02:25:55.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.827+0000 7f4cd3e00640 1 -- 172.21.15.45:0/1239646572 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4ccc007520 con 0x7f4ce0158f80 2024-08-17T02:25:55.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.828+0000 7f4cd3e00640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4cc0065150 0x7f4cc0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:55.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.828+0000 7f4cd3e00640 1 -- 172.21.15.45:0/1239646572 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4ccc081e70 con 0x7f4ce0158f80 2024-08-17T02:25:55.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.828+0000 7f4ce5000640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4cc0065150 0x7f4cc0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:55.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.829+0000 7f4ce5000640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4cc0065150 0x7f4cc0067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4034000 tx=0x7f4cd4032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:55.839 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:55.838+0000 7f4cd3e00640 1 -- 172.21.15.45:0/1239646572 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4ccc050070 con 0x7f4ce0158f80 2024-08-17T02:25:56.060 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.059+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1239646572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4ce0064db0 con 0x7f4ce0158f80 2024-08-17T02:25:56.061 INFO:tasks.ceph.mon.a.smithi045.stderr:2024-08-17T02:25:56.060+0000 7f430de00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:25:56.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.064+0000 7f4cd3e00640 1 -- 172.21.15.45:0/1239646572 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4ccc053690 con 0x7f4ce0158f80 2024-08-17T02:25:56.065 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:25:56.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.067+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1239646572 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4cc0065150 msgr2=0x7f4cc0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.067+0000 7f4ce7a00640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4cc0065150 0x7f4cc0067600 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4034000 tx=0x7f4cd4032000 comp rx=0 tx=0).stop 2024-08-17T02:25:56.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.067+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1239646572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ce0158f80 msgr2=0x7f4ce00b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.067+0000 7f4ce7a00640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ce0158f80 0x7f4ce00b2c80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00c5e0 tx=0x7f4ccc007d60 comp rx=0 tx=0).stop 2024-08-17T02:25:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.068+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1239646572 shutdown_connections 2024-08-17T02:25:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.068+0000 7f4ce7a00640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4ce0159350 0x7f4ce015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.068+0000 7f4ce7a00640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4ce0158f80 0x7f4ce00b2c80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.068+0000 7f4ce7a00640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4cc0065150 0x7f4cc0067600 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.068+0000 7f4ce7a00640 1 --2- 172.21.15.45:0/1239646572 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4ce00cf280 0x7f4ce00c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.068+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1239646572 >> 172.21.15.45:0/1239646572 conn(0x7f4ce00cfd90 msgr2=0x7f4ce00d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.068+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1239646572 shutdown_connections 2024-08-17T02:25:56.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.068+0000 7f4ce7a00640 1 -- 172.21.15.45:0/1239646572 wait complete. 2024-08-17T02:25:56.073 INFO:tasks.ceph.mds.b.smithi169.stderr: -2006> 2024-08-17T02:25:20.648+0000 7f5fbfe00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:25:56.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:25:56.117 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-08-17T02:25:56.240 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.239+0000 7f2420000640 1 Processor -- start 2024-08-17T02:25:56.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.239+0000 7f2420000640 1 -- start start 2024-08-17T02:25:56.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.240+0000 7f2420000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2418156d60 0x7f24180ad7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.240+0000 7f2420000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f24180adcf0 0x7f24180ae940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.240+0000 7f2420000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241815b030 con 0x7f2418156990 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.240+0000 7f2420000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24180cc2e0 con 0x7f2418156d60 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.240+0000 7f2420000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24180ae0f0 con 0x7f24180adcf0 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.241+0000 7f241d600640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2418156990 0x7f24180b05a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54482/0 (socket says 172.21.15.45:54482) 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.241+0000 7f241d600640 1 -- 172.21.15.45:0/1413024280 learned_addr learned my addr 172.21.15.45:0/1413024280 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.241+0000 7f241cc00640 1 --2- 172.21.15.45:0/1413024280 >> v2:172.21.15.45:3300/0 conn(0x7f2418156d60 0x7f24180ad7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.241+0000 7f241e000640 1 --2- 172.21.15.45:0/1413024280 >> v2:172.21.15.169:3300/0 conn(0x7f24180adcf0 0x7f24180ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.241+0000 7f2417e00640 1 -- 172.21.15.45:0/1413024280 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609244723 0 0) 0x7f241815b030 con 0x7f2418156990 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.241+0000 7f2417e00640 1 -- 172.21.15.45:0/1413024280 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24000034e0 con 0x7f2418156990 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.241+0000 7f241e000640 1 -- 172.21.15.45:0/1413024280 >> v2:172.21.15.45:3300/0 conn(0x7f2418156d60 msgr2=0x7f24180ad7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.241+0000 7f241e000640 1 --2- 172.21.15.45:0/1413024280 >> v2:172.21.15.45:3300/0 conn(0x7f2418156d60 0x7f24180ad7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.241+0000 7f241e000640 1 -- 172.21.15.45:0/1413024280 >> v1:172.21.15.45:6789/0 conn(0x7f2418156990 legacy=0x7f24180b05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.241+0000 7f241e000640 1 -- 172.21.15.45:0/1413024280 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24180b1110 con 0x7f24180adcf0 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.242+0000 7f241e000640 1 --2- 172.21.15.45:0/1413024280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24180adcf0 0x7f24180ae940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f241806c730 tx=0x7f2410009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5017665ba025c1b3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.242+0000 7f2417e00640 1 -- 172.21.15.45:0/1413024280 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410007550 con 0x7f24180adcf0 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.243+0000 7f2417e00640 1 -- 172.21.15.45:0/1413024280 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241002d050 con 0x7f24180adcf0 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.243+0000 7f2417e00640 1 -- 172.21.15.45:0/1413024280 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410007900 con 0x7f24180adcf0 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.243+0000 7f2420000640 1 -- 172.21.15.45:0/1413024280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24180adcf0 msgr2=0x7f24180ae940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.243+0000 7f2420000640 1 --2- 172.21.15.45:0/1413024280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24180adcf0 0x7f24180ae940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f241806c730 tx=0x7f2410009780 comp rx=0 tx=0).stop 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.243+0000 7f2420000640 1 -- 172.21.15.45:0/1413024280 shutdown_connections 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.243+0000 7f2420000640 1 --2- 172.21.15.45:0/1413024280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24180adcf0 0x7f24180ae940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.243+0000 7f2420000640 1 --2- 172.21.15.45:0/1413024280 >> v2:172.21.15.45:3300/0 conn(0x7f2418156d60 0x7f24180ad7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.243+0000 7f2420000640 1 -- 172.21.15.45:0/1413024280 >> 172.21.15.45:0/1413024280 conn(0x7f2418067750 msgr2=0x7f24180cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:56.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.243+0000 7f2420000640 1 -- 172.21.15.45:0/1413024280 shutdown_connections 2024-08-17T02:25:56.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.243+0000 7f2420000640 1 -- 172.21.15.45:0/1413024280 wait complete. 2024-08-17T02:25:56.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.245+0000 7f2420000640 1 Processor -- start 2024-08-17T02:25:56.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.245+0000 7f2420000640 1 -- start start 2024-08-17T02:25:56.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f2420000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24180adcf0 0x7f241814f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f2420000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2418156990 0x7f24180a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f2420000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2418156d60 0x7f24180a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f2420000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2418068ca0 con 0x7f2418156d60 2024-08-17T02:25:56.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f2420000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2418069820 con 0x7f24180adcf0 2024-08-17T02:25:56.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f2420000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2418068ef0 con 0x7f2418156990 2024-08-17T02:25:56.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f241e000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2418156d60 0x7f24180a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f241e000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2418156d60 0x7f24180a9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37074/0 (socket says 172.21.15.45:37074) 2024-08-17T02:25:56.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f241e000640 1 -- 172.21.15.45:0/1273840388 learned_addr learned my addr 172.21.15.45:0/1273840388 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:56.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f241d600640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24180adcf0 0x7f241814f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f241cc00640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2418156990 0x7f24180a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f241e000640 1 -- 172.21.15.45:0/1273840388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2418156990 msgr2=0x7f24180a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f241e000640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2418156990 0x7f24180a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f241e000640 1 -- 172.21.15.45:0/1273840388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24180adcf0 msgr2=0x7f241814f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:56.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f241e000640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24180adcf0 0x7f241814f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:56.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.246+0000 7f241e000640 1 -- 172.21.15.45:0/1273840388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2410009a20 con 0x7f2418156d60 2024-08-17T02:25:56.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.247+0000 7f241e000640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2418156d60 0x7f24180a9e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f241002acb0 tx=0x7f2410037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.247+0000 7f2414c00640 1 -- 172.21.15.45:0/1273840388 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24100078d0 con 0x7f2418156d60 2024-08-17T02:25:56.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.247+0000 7f2414c00640 1 -- 172.21.15.45:0/1273840388 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2410031ac0 con 0x7f2418156d60 2024-08-17T02:25:56.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.247+0000 7f2420000640 1 -- 172.21.15.45:0/1273840388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24180691d0 con 0x7f2418156d60 2024-08-17T02:25:56.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.247+0000 7f2414c00640 1 -- 172.21.15.45:0/1273840388 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2410031e80 con 0x7f2418156d60 2024-08-17T02:25:56.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.247+0000 7f2420000640 1 -- 172.21.15.45:0/1273840388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241814f900 con 0x7f2418156d60 2024-08-17T02:25:56.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.248+0000 7f2420000640 1 -- 172.21.15.45:0/1273840388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241814faf0 con 0x7f2418156d60 2024-08-17T02:25:56.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.249+0000 7f2414c00640 1 -- 172.21.15.45:0/1273840388 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f241003c630 con 0x7f2418156d60 2024-08-17T02:25:56.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.250+0000 7f2414c00640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23f8065150 0x7f23f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:56.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.250+0000 7f2414c00640 1 -- 172.21.15.45:0/1273840388 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5936+0+0 (secure 0 0 0) 0x7f24100a3c10 con 0x7f2418156d60 2024-08-17T02:25:56.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.250+0000 7f241d600640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23f8065150 0x7f23f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:56.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.251+0000 7f241d600640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23f8065150 0x7f23f8067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f240c005840 tx=0x7f240c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:56.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.254+0000 7f2414c00640 1 -- 172.21.15.45:0/1273840388 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2410071c20 con 0x7f2418156d60 2024-08-17T02:25:56.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:56.473+0000 7f2420000640 1 -- 172.21.15.45:0/1273840388 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2418071050 con 0x7f2418156d60 2024-08-17T02:25:57.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.066+0000 7f2414c00640 1 -- 172.21.15.45:0/1273840388 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2410075240 con 0x7f2418156d60 2024-08-17T02:25:57.069 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.068+0000 7f2420000640 1 -- 172.21.15.45:0/1273840388 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23f8065150 msgr2=0x7f23f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.068+0000 7f2420000640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23f8065150 0x7f23f8067600 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f240c005840 tx=0x7f240c009040 comp rx=0 tx=0).stop 2024-08-17T02:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.068+0000 7f2420000640 1 -- 172.21.15.45:0/1273840388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2418156d60 msgr2=0x7f24180a9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.068+0000 7f2420000640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2418156d60 0x7f24180a9e50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f241002acb0 tx=0x7f2410037000 comp rx=0 tx=0).stop 2024-08-17T02:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.068+0000 7f2420000640 1 -- 172.21.15.45:0/1273840388 shutdown_connections 2024-08-17T02:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.068+0000 7f2420000640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2418156d60 0x7f24180a9e50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.068+0000 7f2420000640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23f8065150 0x7f23f8067600 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.068+0000 7f2420000640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2418156990 0x7f24180a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.068+0000 7f2420000640 1 --2- 172.21.15.45:0/1273840388 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f24180adcf0 0x7f241814f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.068+0000 7f2420000640 1 -- 172.21.15.45:0/1273840388 >> 172.21.15.45:0/1273840388 conn(0x7f2418067750 msgr2=0x7f24181503a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.069+0000 7f2420000640 1 -- 172.21.15.45:0/1273840388 shutdown_connections 2024-08-17T02:25:57.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.069+0000 7f2420000640 1 -- 172.21.15.45:0/1273840388 wait complete. 2024-08-17T02:25:57.087 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:25:57.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.244+0000 7fb203c00640 1 Processor -- start 2024-08-17T02:25:57.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.244+0000 7fb203c00640 1 -- start start 2024-08-17T02:25:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.245+0000 7fb203c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 0x7fb1fc06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.245+0000 7fb203c00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb1fc156c60 0x7fb1fc06e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.245+0000 7fb203c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1fc0ae9b0 con 0x7fb1fc0c8130 2024-08-17T02:25:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.245+0000 7fb203c00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1fc0aa730 con 0x7fb1fc156c60 2024-08-17T02:25:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.245+0000 7fb203c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0aa9f0 con 0x7fb1fc156890 2024-08-17T02:25:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.246+0000 7fb201200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 0x7fb1fc06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.246+0000 7fb1fbe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb1fc156c60 0x7fb1fc06e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.246+0000 7fb1fbe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fb1fc156c60 0x7fb1fc06e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:39304/0 (socket says 172.21.15.45:39304) 2024-08-17T02:25:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.246+0000 7fb201200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 0x7fb1fc06dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:42860/0 (socket says 172.21.15.45:42860) 2024-08-17T02:25:57.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.246+0000 7fb1fbe00640 1 -- 172.21.15.45:0/3394251752 learned_addr learned my addr 172.21.15.45:0/3394251752 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:57.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.247+0000 7fb1fbe00640 1 -- 172.21.15.45:0/3394251752 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 msgr2=0x7fb1fc06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:57.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.247+0000 7fb1fbe00640 1 --2- 172.21.15.45:0/3394251752 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 0x7fb1fc06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.247+0000 7fb1fbe00640 1 -- 172.21.15.45:0/3394251752 >> v1:172.21.15.169:6789/0 conn(0x7fb1fc0c8130 legacy=0x7fb1fc0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.247+0000 7fb1fb400640 1 -- 172.21.15.45:0/3394251752 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62497976 0 0) 0x7fb1fc0ae9b0 con 0x7fb1fc0c8130 2024-08-17T02:25:57.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.247+0000 7fb1fbe00640 1 -- 172.21.15.45:0/3394251752 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1fc0ab320 con 0x7fb1fc156c60 2024-08-17T02:25:57.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.247+0000 7fb201200640 1 --2- 172.21.15.45:0/3394251752 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 0x7fb1fc06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:25:57.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.248+0000 7fb1fbe00640 1 --2- 172.21.15.45:0/3394251752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1fc156c60 0x7fb1fc06e420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009910 tx=0x7fb1e80091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d81fd3fcc2cbd7c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.248+0000 7fb1fb400640 1 -- 172.21.15.45:0/3394251752 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e802add0 con 0x7fb1fc156c60 2024-08-17T02:25:57.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.248+0000 7fb1fb400640 1 -- 172.21.15.45:0/3394251752 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e8032440 con 0x7fb1fc156c60 2024-08-17T02:25:57.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.248+0000 7fb1fb400640 1 -- 172.21.15.45:0/3394251752 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80327e0 con 0x7fb1fc156c60 2024-08-17T02:25:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.248+0000 7fb203c00640 1 -- 172.21.15.45:0/3394251752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1fc156c60 msgr2=0x7fb1fc06e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.248+0000 7fb203c00640 1 --2- 172.21.15.45:0/3394251752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1fc156c60 0x7fb1fc06e420 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009910 tx=0x7fb1e80091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.249+0000 7fb203c00640 1 -- 172.21.15.45:0/3394251752 shutdown_connections 2024-08-17T02:25:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.249+0000 7fb203c00640 1 --2- 172.21.15.45:0/3394251752 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1fc156c60 0x7fb1fc06e420 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.249+0000 7fb203c00640 1 --2- 172.21.15.45:0/3394251752 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 0x7fb1fc06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.249+0000 7fb203c00640 1 -- 172.21.15.45:0/3394251752 >> 172.21.15.45:0/3394251752 conn(0x7fb1fc067750 msgr2=0x7fb1fc06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:57.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.249+0000 7fb203c00640 1 -- 172.21.15.45:0/3394251752 shutdown_connections 2024-08-17T02:25:57.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.249+0000 7fb203c00640 1 -- 172.21.15.45:0/3394251752 wait complete. 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.250+0000 7fb203c00640 1 Processor -- start 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.250+0000 7fb203c00640 1 -- start start 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.251+0000 7fb203c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1fc0c8130 0x7fb1fc149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.251+0000 7fb203c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 0x7fb1fc0afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.251+0000 7fb203c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc156c60 0x7fb1fc14d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.251+0000 7fb203c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0af8a0 con 0x7fb1fc156c60 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.251+0000 7fb203c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc149b60 con 0x7fb1fc0c8130 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.251+0000 7fb203c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1fc0ae9b0 con 0x7fb1fc156890 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.251+0000 7fb201c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc156c60 0x7fb1fc14d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.251+0000 7fb201c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc156c60 0x7fb1fc14d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37084/0 (socket says 172.21.15.45:37084) 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.251+0000 7fb201c00640 1 -- 172.21.15.45:0/2415839217 learned_addr learned my addr 172.21.15.45:0/2415839217 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:57.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.251+0000 7fb201200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1fc0c8130 0x7fb1fc149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.251+0000 7fb1fbe00640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 0x7fb1fc0afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.252+0000 7fb201c00640 1 -- 172.21.15.45:0/2415839217 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 msgr2=0x7fb1fc0afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.252+0000 7fb201c00640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 0x7fb1fc0afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.252+0000 7fb201c00640 1 -- 172.21.15.45:0/2415839217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1fc0c8130 msgr2=0x7fb1fc149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:57.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.252+0000 7fb201c00640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1fc0c8130 0x7fb1fc149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:57.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.252+0000 7fb201c00640 1 -- 172.21.15.45:0/2415839217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f0009390 con 0x7fb1fc156c60 2024-08-17T02:25:57.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.252+0000 7fb201c00640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc156c60 0x7fb1fc14d9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4001560 tx=0x7fb1f40016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.252+0000 7fb1efe00640 1 -- 172.21.15.45:0/2415839217 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400a7f0 con 0x7fb1fc156c60 2024-08-17T02:25:57.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.252+0000 7fb1efe00640 1 -- 172.21.15.45:0/2415839217 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f400a950 con 0x7fb1fc156c60 2024-08-17T02:25:57.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.252+0000 7fb1efe00640 1 -- 172.21.15.45:0/2415839217 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f400ad10 con 0x7fb1fc156c60 2024-08-17T02:25:57.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.252+0000 7fb203c00640 1 -- 172.21.15.45:0/2415839217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e8009450 con 0x7fb1fc156c60 2024-08-17T02:25:57.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.252+0000 7fb203c00640 1 -- 172.21.15.45:0/2415839217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1fc0aef70 con 0x7fb1fc156c60 2024-08-17T02:25:57.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.253+0000 7fb203c00640 1 -- 172.21.15.45:0/2415839217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1fc0afa10 con 0x7fb1fc156c60 2024-08-17T02:25:57.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.254+0000 7fb1efe00640 1 -- 172.21.15.45:0/2415839217 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb1f4003030 con 0x7fb1fc156c60 2024-08-17T02:25:57.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.255+0000 7fb1efe00640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb1dc065180 0x7fb1dc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:57.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.255+0000 7fb1efe00640 1 -- 172.21.15.45:0/2415839217 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5936+0+0 (secure 0 0 0) 0x7fb1f40824b0 con 0x7fb1fc156c60 2024-08-17T02:25:57.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.255+0000 7fb201200640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb1dc065180 0x7fb1dc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:57.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.256+0000 7fb201200640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb1dc065180 0x7fb1dc067630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009eb0 tx=0x7fb1f00090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:57.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.259+0000 7fb1efe00640 1 -- 172.21.15.45:0/2415839217 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb1f40504c0 con 0x7fb1fc156c60 2024-08-17T02:25:57.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:57.442+0000 7fb203c00640 1 -- 172.21.15.45:0/2415839217 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb1fc0710c0 con 0x7fb1fc156c60 2024-08-17T02:25:58.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.070+0000 7fb1efe00640 1 -- 172.21.15.45:0/2415839217 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb1f4053ae0 con 0x7fb1fc156c60 2024-08-17T02:25:58.072 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:25:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.073+0000 7fb203c00640 1 -- 172.21.15.45:0/2415839217 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb1dc065180 msgr2=0x7fb1dc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.073+0000 7fb203c00640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb1dc065180 0x7fb1dc067630 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0009eb0 tx=0x7fb1f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.073+0000 7fb203c00640 1 -- 172.21.15.45:0/2415839217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc156c60 msgr2=0x7fb1fc14d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.073+0000 7fb203c00640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc156c60 0x7fb1fc14d9c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4001560 tx=0x7fb1f40016c0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.074+0000 7fb203c00640 1 -- 172.21.15.45:0/2415839217 shutdown_connections 2024-08-17T02:25:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.074+0000 7fb203c00640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1fc156c60 0x7fb1fc14d9c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.074+0000 7fb203c00640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb1dc065180 0x7fb1dc067630 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.074+0000 7fb203c00640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb1fc156890 0x7fb1fc0afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.074+0000 7fb203c00640 1 --2- 172.21.15.45:0/2415839217 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb1fc0c8130 0x7fb1fc149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.074+0000 7fb203c00640 1 -- 172.21.15.45:0/2415839217 >> 172.21.15.45:0/2415839217 conn(0x7fb1fc067750 msgr2=0x7fb1fc0686f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.074+0000 7fb203c00640 1 -- 172.21.15.45:0/2415839217 shutdown_connections 2024-08-17T02:25:58.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.074+0000 7fb203c00640 1 -- 172.21.15.45:0/2415839217 wait complete. 2024-08-17T02:25:58.092 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:25:58.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.251+0000 7fdbdfe00640 1 Processor -- start 2024-08-17T02:25:58.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.251+0000 7fdbdfe00640 1 -- start start 2024-08-17T02:25:58.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.252+0000 7fdbdfe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b0830 0x7fdbe00b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.252+0000 7fdbdfe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdbe00ab790 0x7fdbe00abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.252+0000 7fdbdfe00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe00ad350 con 0x7fdbe00b2ef0 2024-08-17T02:25:58.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.252+0000 7fdbdfe00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe00b1d20 con 0x7fdbe00ab790 2024-08-17T02:25:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.252+0000 7fdbdfe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00b0cf0 con 0x7fdbe00b0830 2024-08-17T02:25:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.252+0000 7fdbd7e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b0830 0x7fdbe00b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.252+0000 7fdbd7e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b0830 0x7fdbe00b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:42882/0 (socket says 172.21.15.45:42882) 2024-08-17T02:25:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.252+0000 7fdbd7e00640 1 -- 172.21.15.45:0/3629256797 learned_addr learned my addr 172.21.15.45:0/3629256797 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.253+0000 7fdbdf400640 1 --2- 172.21.15.45:0/3629256797 >> v2:172.21.15.169:3300/0 conn(0x7fdbe00ab790 0x7fdbe00abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.253+0000 7fdbd7e00640 1 -- 172.21.15.45:0/3629256797 >> v2:172.21.15.169:3300/0 conn(0x7fdbe00ab790 msgr2=0x7fdbe00abbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.253+0000 7fdbd7e00640 1 --2- 172.21.15.45:0/3629256797 >> v2:172.21.15.169:3300/0 conn(0x7fdbe00ab790 0x7fdbe00abbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.253+0000 7fdbd7e00640 1 -- 172.21.15.45:0/3629256797 >> v1:172.21.15.169:6789/0 conn(0x7fdbe00b2ef0 legacy=0x7fdbe00b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.253+0000 7fdbd7e00640 1 -- 172.21.15.45:0/3629256797 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe00b0fd0 con 0x7fdbe00b0830 2024-08-17T02:25:58.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.254+0000 7fdbd7e00640 1 --2- 172.21.15.45:0/3629256797 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b0830 0x7fdbe00b1ef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009910 tx=0x7fdbc80091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16fc9711e6550ca server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.254+0000 7fdbde000640 1 -- 172.21.15.45:0/3629256797 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc802ae40 con 0x7fdbe00b0830 2024-08-17T02:25:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.254+0000 7fdbde000640 1 -- 172.21.15.45:0/3629256797 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc8032440 con 0x7fdbe00b0830 2024-08-17T02:25:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.254+0000 7fdbde000640 1 -- 172.21.15.45:0/3629256797 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8032820 con 0x7fdbe00b0830 2024-08-17T02:25:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.255+0000 7fdbdfe00640 1 -- 172.21.15.45:0/3629256797 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b0830 msgr2=0x7fdbe00b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.255+0000 7fdbdfe00640 1 --2- 172.21.15.45:0/3629256797 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b0830 0x7fdbe00b1ef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009910 tx=0x7fdbc80091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.255+0000 7fdbdfe00640 1 -- 172.21.15.45:0/3629256797 shutdown_connections 2024-08-17T02:25:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.255+0000 7fdbdfe00640 1 --2- 172.21.15.45:0/3629256797 >> v2:172.21.15.169:3300/0 conn(0x7fdbe00ab790 0x7fdbe00abbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.255+0000 7fdbdfe00640 1 --2- 172.21.15.45:0/3629256797 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b0830 0x7fdbe00b1ef0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.255+0000 7fdbdfe00640 1 -- 172.21.15.45:0/3629256797 >> 172.21.15.45:0/3629256797 conn(0x7fdbe0096a70 msgr2=0x7fdbe0096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:58.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.255+0000 7fdbdfe00640 1 -- 172.21.15.45:0/3629256797 shutdown_connections 2024-08-17T02:25:58.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.255+0000 7fdbdfe00640 1 -- 172.21.15.45:0/3629256797 wait complete. 2024-08-17T02:25:58.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.256+0000 7fdbdfe00640 1 Processor -- start 2024-08-17T02:25:58.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.257+0000 7fdbdfe00640 1 -- start start 2024-08-17T02:25:58.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.257+0000 7fdbdfe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbe00ab790 0x7fdbe014ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.257+0000 7fdbdfe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00b0830 0x7fdbe01536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.257+0000 7fdbdfe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b2ef0 0x7fdbe01514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.257+0000 7fdbdfe00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe0150100 con 0x7fdbe00b0830 2024-08-17T02:25:58.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.257+0000 7fdbdfe00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe00ae7b0 con 0x7fdbe00ab790 2024-08-17T02:25:58.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.257+0000 7fdbdfe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe016cb90 con 0x7fdbe00b2ef0 2024-08-17T02:25:58.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.258+0000 7fdbd7e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00b0830 0x7fdbe01536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.258+0000 7fdbd7e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00b0830 0x7fdbe01536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37098/0 (socket says 172.21.15.45:37098) 2024-08-17T02:25:58.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.258+0000 7fdbd7e00640 1 -- 172.21.15.45:0/2440533669 learned_addr learned my addr 172.21.15.45:0/2440533669 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:58.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.258+0000 7fdbdf400640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b2ef0 0x7fdbe01514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.258+0000 7fdbdea00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbe00ab790 0x7fdbe014ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.258+0000 7fdbd7e00640 1 -- 172.21.15.45:0/2440533669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b2ef0 msgr2=0x7fdbe01514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.258+0000 7fdbd7e00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b2ef0 0x7fdbe01514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.258+0000 7fdbd7e00640 1 -- 172.21.15.45:0/2440533669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbe00ab790 msgr2=0x7fdbe014ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:58.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.258+0000 7fdbd7e00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbe00ab790 0x7fdbe014ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:58.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.258+0000 7fdbd7e00640 1 -- 172.21.15.45:0/2440533669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8009450 con 0x7fdbe00b0830 2024-08-17T02:25:58.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.258+0000 7fdbd7e00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00b0830 0x7fdbe01536a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8035040 tx=0x7fdbc8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.259+0000 7fdbd6000640 1 -- 172.21.15.45:0/2440533669 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8031c80 con 0x7fdbe00b0830 2024-08-17T02:25:58.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.259+0000 7fdbd6000640 1 -- 172.21.15.45:0/2440533669 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc8031e00 con 0x7fdbe00b0830 2024-08-17T02:25:58.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.259+0000 7fdbd6000640 1 -- 172.21.15.45:0/2440533669 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc803d670 con 0x7fdbe00b0830 2024-08-17T02:25:58.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.259+0000 7fdbdfe00640 1 -- 172.21.15.45:0/2440533669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe016ce70 con 0x7fdbe00b0830 2024-08-17T02:25:58.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.259+0000 7fdbdfe00640 1 -- 172.21.15.45:0/2440533669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe016d430 con 0x7fdbe00b0830 2024-08-17T02:25:58.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.260+0000 7fdbdfe00640 1 -- 172.21.15.45:0/2440533669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe0063d20 con 0x7fdbe00b0830 2024-08-17T02:25:58.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.261+0000 7fdbd6000640 1 -- 172.21.15.45:0/2440533669 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdbc8039040 con 0x7fdbe00b0830 2024-08-17T02:25:58.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.261+0000 7fdbd6000640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdbbc065150 0x7fdbbc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:58.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.261+0000 7fdbd6000640 1 -- 172.21.15.45:0/2440533669 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5498+0+0 (secure 0 0 0) 0x7fdbc802ae40 con 0x7fdbe00b0830 2024-08-17T02:25:58.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.262+0000 7fdbdea00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdbbc065150 0x7fdbbc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:58.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.262+0000 7fdbdea00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdbbc065150 0x7fdbbc067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0003720 tx=0x7fdbd0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:58.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.266+0000 7fdbd6000640 1 -- 172.21.15.45:0/2440533669 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdbc80703f0 con 0x7fdbe00b0830 2024-08-17T02:25:58.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:58.447+0000 7fdbdfe00640 1 -- 172.21.15.45:0/2440533669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdbe0071050 con 0x7fdbe00b0830 2024-08-17T02:25:59.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.074+0000 7fdbd6000640 1 -- 172.21.15.45:0/2440533669 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdbc8073a10 con 0x7fdbe00b0830 2024-08-17T02:25:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2024-08-17T02:25:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.077+0000 7fdbdfe00640 1 -- 172.21.15.45:0/2440533669 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdbbc065150 msgr2=0x7fdbbc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.077+0000 7fdbdfe00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdbbc065150 0x7fdbbc067600 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0003720 tx=0x7fdbd0009040 comp rx=0 tx=0).stop 2024-08-17T02:25:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.077+0000 7fdbdfe00640 1 -- 172.21.15.45:0/2440533669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00b0830 msgr2=0x7fdbe01536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.077+0000 7fdbdfe00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00b0830 0x7fdbe01536a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8035040 tx=0x7fdbc8032000 comp rx=0 tx=0).stop 2024-08-17T02:25:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.078+0000 7fdbdfe00640 1 -- 172.21.15.45:0/2440533669 shutdown_connections 2024-08-17T02:25:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.078+0000 7fdbdfe00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdbbc065150 0x7fdbbc067600 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.078+0000 7fdbdfe00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdbe00b2ef0 0x7fdbe01514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.078+0000 7fdbdfe00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdbe00b0830 0x7fdbe01536a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.078+0000 7fdbdfe00640 1 --2- 172.21.15.45:0/2440533669 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdbe00ab790 0x7fdbe014ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.078+0000 7fdbdfe00640 1 -- 172.21.15.45:0/2440533669 >> 172.21.15.45:0/2440533669 conn(0x7fdbe0096a70 msgr2=0x7fdbe006a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.078+0000 7fdbdfe00640 1 -- 172.21.15.45:0/2440533669 shutdown_connections 2024-08-17T02:25:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.078+0000 7fdbdfe00640 1 -- 172.21.15.45:0/2440533669 wait complete. 2024-08-17T02:25:59.095 INFO:tasks.ceph.mds.a:Restarting daemon 2024-08-17T02:25:59.095 INFO:tasks.ceph.mds.a:Stopping old one... 2024-08-17T02:25:59.095 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:25:59.095 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:59.096 INFO:tasks.ceph.mds.c:Restarting daemon 2024-08-17T02:25:59.096 INFO:tasks.ceph.mds.c:Stopping old one... 2024-08-17T02:25:59.096 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:25:59.096 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:59.096 INFO:tasks.ceph.mds.b:Restarting daemon 2024-08-17T02:25:59.096 INFO:tasks.ceph.mds.b:Stopping old one... 2024-08-17T02:25:59.097 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:25:59.097 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:59.097 INFO:tasks.ceph.mds.d:Restarting daemon 2024-08-17T02:25:59.097 INFO:tasks.ceph.mds.d:Stopping old one... 2024-08-17T02:25:59.097 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:25:59.097 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:25:59.111 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:25:59.111 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-08-17T02:25:59.113 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:25:59.113 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-08-17T02:25:59.114 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:25:59.114 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-08-17T02:25:59.115 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:25:59.115 DEBUG:teuthology.orchestra.run.smithi169:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-08-17T02:25:59.156 INFO:tasks.ceph.mds.a:Started 2024-08-17T02:25:59.156 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:59.158 INFO:tasks.ceph.mds.d:Started 2024-08-17T02:25:59.158 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:59.159 INFO:tasks.ceph.mds.c:Started 2024-08-17T02:25:59.159 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:59.160 INFO:tasks.ceph.mds.b:Started 2024-08-17T02:25:59.160 DEBUG:teuthology.parallel:result is None 2024-08-17T02:25:59.161 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-08-17T02:25:59.283 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2024-08-17T02:25:59.285 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2024-08-17T02:25:59.292 INFO:tasks.ceph.mds.d.smithi169.stdout:starting mds.d at 2024-08-17T02:25:59.293 INFO:tasks.ceph.mds.b.smithi169.stdout:starting mds.b at 2024-08-17T02:25:59.325 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.325+0000 7f1346000640 1 Processor -- start 2024-08-17T02:25:59.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.325+0000 7f1346000640 1 -- start start 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.326+0000 7f1346000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1340158ce0 0x7f13400c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.326+0000 7f1346000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f13400cb340 0x7f13401590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.326+0000 7f1346000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13400cb7c0 con 0x7f13400d08d0 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.326+0000 7f1346000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13400cf0c0 con 0x7f1340158ce0 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.326+0000 7f1346000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1340089000 con 0x7f13400cb340 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.326+0000 7f133f400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1340158ce0 0x7f13400c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.327+0000 7f133f400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1340158ce0 0x7f13400c68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37126/0 (socket says 172.21.15.45:37126) 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.327+0000 7f133f400640 1 -- 172.21.15.45:0/1490651903 learned_addr learned my addr 172.21.15.45:0/1490651903 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.327+0000 7f133fe00640 1 --2- 172.21.15.45:0/1490651903 >> v2:172.21.15.169:3300/0 conn(0x7f13400cb340 0x7f13401590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.327+0000 7f133f400640 1 -- 172.21.15.45:0/1490651903 >> v2:172.21.15.169:3300/0 conn(0x7f13400cb340 msgr2=0x7f13401590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.327+0000 7f133f400640 1 --2- 172.21.15.45:0/1490651903 >> v2:172.21.15.169:3300/0 conn(0x7f13400cb340 0x7f13401590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.327+0000 7f133f400640 1 -- 172.21.15.45:0/1490651903 >> v1:172.21.15.169:6789/0 conn(0x7f13400d08d0 legacy=0x7f13400cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.327+0000 7f133f400640 1 -- 172.21.15.45:0/1490651903 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13400ceb20 con 0x7f1340158ce0 2024-08-17T02:25:59.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.328+0000 7f133f400640 1 --2- 172.21.15.45:0/1490651903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1340158ce0 0x7f13400c68c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f13400b2900 tx=0x7f13300091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682f9a06f995ce23 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.328+0000 7f133e000640 1 -- 172.21.15.45:0/1490651903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133002ae80 con 0x7f1340158ce0 2024-08-17T02:25:59.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.328+0000 7f133e000640 1 -- 172.21.15.45:0/1490651903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330032440 con 0x7f1340158ce0 2024-08-17T02:25:59.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.328+0000 7f133e000640 1 -- 172.21.15.45:0/1490651903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1330032800 con 0x7f1340158ce0 2024-08-17T02:25:59.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.329+0000 7f1346000640 1 -- 172.21.15.45:0/1490651903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1340158ce0 msgr2=0x7f13400c68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.329+0000 7f1346000640 1 --2- 172.21.15.45:0/1490651903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1340158ce0 0x7f13400c68c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f13400b2900 tx=0x7f13300091d0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.329+0000 7f1346000640 1 -- 172.21.15.45:0/1490651903 shutdown_connections 2024-08-17T02:25:59.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.329+0000 7f1346000640 1 --2- 172.21.15.45:0/1490651903 >> v2:172.21.15.169:3300/0 conn(0x7f13400cb340 0x7f13401590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.329+0000 7f1346000640 1 --2- 172.21.15.45:0/1490651903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1340158ce0 0x7f13400c68c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.329+0000 7f1346000640 1 -- 172.21.15.45:0/1490651903 >> 172.21.15.45:0/1490651903 conn(0x7f13400cfdc0 msgr2=0x7f13400d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:25:59.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.329+0000 7f1346000640 1 -- 172.21.15.45:0/1490651903 shutdown_connections 2024-08-17T02:25:59.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.329+0000 7f1346000640 1 -- 172.21.15.45:0/1490651903 wait complete. 2024-08-17T02:25:59.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.330+0000 7f1346000640 1 Processor -- start 2024-08-17T02:25:59.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.331+0000 7f1346000640 1 -- start start 2024-08-17T02:25:59.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.331+0000 7f1346000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13400cb340 0x7f13400c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.331+0000 7f1346000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13400d08d0 0x7f134015a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.331+0000 7f1346000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1340158ce0 0x7f1340144660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.331+0000 7f1346000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c7450 con 0x7f1340158ce0 2024-08-17T02:25:59.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.331+0000 7f1346000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c7730 con 0x7f13400d08d0 2024-08-17T02:25:59.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.331+0000 7f1346000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13400c7a10 con 0x7f13400cb340 2024-08-17T02:25:59.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.332+0000 7f133fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1340158ce0 0x7f1340144660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.332+0000 7f133fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1340158ce0 0x7f1340144660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37136/0 (socket says 172.21.15.45:37136) 2024-08-17T02:25:59.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.332+0000 7f133fe00640 1 -- 172.21.15.45:0/4012530060 learned_addr learned my addr 172.21.15.45:0/4012530060 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:25:59.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.332+0000 7f133f400640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13400cb340 0x7f13400c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.332+0000 7f133ea00640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13400d08d0 0x7f134015a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.332+0000 7f133fe00640 1 -- 172.21.15.45:0/4012530060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13400cb340 msgr2=0x7f13400c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.332+0000 7f133fe00640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13400cb340 0x7f13400c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.332+0000 7f133fe00640 1 -- 172.21.15.45:0/4012530060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13400d08d0 msgr2=0x7f134015a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:25:59.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.332+0000 7f133fe00640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13400d08d0 0x7f134015a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:25:59.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.332+0000 7f133fe00640 1 -- 172.21.15.45:0/4012530060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330009450 con 0x7f1340158ce0 2024-08-17T02:25:59.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.332+0000 7f133fe00640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1340158ce0 0x7f1340144660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1338009e90 tx=0x7f133800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.333+0000 7f1336a00640 1 -- 172.21.15.45:0/4012530060 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133800ce10 con 0x7f1340158ce0 2024-08-17T02:25:59.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.333+0000 7f1336a00640 1 -- 172.21.15.45:0/4012530060 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133800f040 con 0x7f1340158ce0 2024-08-17T02:25:59.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.333+0000 7f1336a00640 1 -- 172.21.15.45:0/4012530060 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13380146d0 con 0x7f1340158ce0 2024-08-17T02:25:59.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.333+0000 7f1346000640 1 -- 172.21.15.45:0/4012530060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13400c7cf0 con 0x7f1340158ce0 2024-08-17T02:25:59.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.333+0000 7f1346000640 1 -- 172.21.15.45:0/4012530060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1340155620 con 0x7f1340158ce0 2024-08-17T02:25:59.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.334+0000 7f1346000640 1 -- 172.21.15.45:0/4012530060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13400c81f0 con 0x7f1340158ce0 2024-08-17T02:25:59.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.335+0000 7f1336a00640 1 -- 172.21.15.45:0/4012530060 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1338014a80 con 0x7f1340158ce0 2024-08-17T02:25:59.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.336+0000 7f1336a00640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1320065150 0x7f1320067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:25:59.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.336+0000 7f1336a00640 1 -- 172.21.15.45:0/4012530060 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1338082c80 con 0x7f1340158ce0 2024-08-17T02:25:59.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.336+0000 7f133f400640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1320065150 0x7f1320067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:25:59.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.337+0000 7f133f400640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1320065150 0x7f1320067600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1330034000 tx=0x7f1330032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:25:59.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.340+0000 7f1336a00640 1 -- 172.21.15.45:0/4012530060 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1338051050 con 0x7f1340158ce0 2024-08-17T02:25:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:25:59.535+0000 7f1346000640 1 -- 172.21.15.45:0/4012530060 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f1340064db0 con 0x7f1340158ce0 2024-08-17T02:26:00.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.087+0000 7f1336a00640 1 -- 172.21.15.45:0/4012530060 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1338054670 con 0x7f1340158ce0 2024-08-17T02:26:00.088 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2024-08-17T02:26:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 -- 172.21.15.45:0/4012530060 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1320065150 msgr2=0x7f1320067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1320065150 0x7f1320067600 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1330034000 tx=0x7f1330032000 comp rx=0 tx=0).stop 2024-08-17T02:26:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 -- 172.21.15.45:0/4012530060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1340158ce0 msgr2=0x7f1340144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1340158ce0 0x7f1340144660 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1338009e90 tx=0x7f133800b040 comp rx=0 tx=0).stop 2024-08-17T02:26:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 -- 172.21.15.45:0/4012530060 shutdown_connections 2024-08-17T02:26:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1340158ce0 0x7f1340144660 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f13400d08d0 0x7f134015a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1320065150 0x7f1320067600 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 --2- 172.21.15.45:0/4012530060 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f13400cb340 0x7f13400c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 -- 172.21.15.45:0/4012530060 >> 172.21.15.45:0/4012530060 conn(0x7f13400cfdc0 msgr2=0x7f13400c5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 -- 172.21.15.45:0/4012530060 shutdown_connections 2024-08-17T02:26:00.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.090+0000 7f1346000640 1 -- 172.21.15.45:0/4012530060 wait complete. 2024-08-17T02:26:00.115 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-08-17T02:26:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.272+0000 7f5b94a00640 1 Processor -- start 2024-08-17T02:26:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.272+0000 7f5b94a00640 1 -- start start 2024-08-17T02:26:00.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.273+0000 7f5b94a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5b90155a20 0x7f5b900adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.274+0000 7f5b94a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 0x7f5b900ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.274+0000 7f5b94a00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b90156670 con 0x7f5b90155df0 2024-08-17T02:26:00.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.274+0000 7f5b94a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b900b0350 con 0x7f5b90155a20 2024-08-17T02:26:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.274+0000 7f5b94a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9006e5e0 con 0x7f5b9006df00 2024-08-17T02:26:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.274+0000 7f5b8e800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 0x7f5b900ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.274+0000 7f5b8de00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5b90155a20 0x7f5b900adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.274+0000 7f5b8e800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 0x7f5b900ad9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:42942/0 (socket says 172.21.15.45:42942) 2024-08-17T02:26:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.274+0000 7f5b8d400640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f5b90155df0 0x7f5b9006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:48240/0 (socket says 172.21.15.45:48240) 2024-08-17T02:26:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.274+0000 7f5b8e800640 1 -- 172.21.15.45:0/99524052 learned_addr learned my addr 172.21.15.45:0/99524052 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.274+0000 7f5b8de00640 1 --2- 172.21.15.45:0/99524052 >> v2:172.21.15.169:3300/0 conn(0x7f5b90155a20 0x7f5b900adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:39404/0 (socket says 172.21.15.45:39404) 2024-08-17T02:26:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.275+0000 7f5b8e800640 1 -- 172.21.15.45:0/99524052 >> v2:172.21.15.169:3300/0 conn(0x7f5b90155a20 msgr2=0x7f5b900adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.275+0000 7f5b8e800640 1 --2- 172.21.15.45:0/99524052 >> v2:172.21.15.169:3300/0 conn(0x7f5b90155a20 0x7f5b900adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.275+0000 7f5b8e800640 1 -- 172.21.15.45:0/99524052 >> v1:172.21.15.169:6789/0 conn(0x7f5b90155df0 legacy=0x7f5b9006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.275+0000 7f5b8e800640 1 -- 172.21.15.45:0/99524052 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9006e8c0 con 0x7f5b9006df00 2024-08-17T02:26:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.275+0000 7f5b8de00640 1 --2- 172.21.15.45:0/99524052 >> v2:172.21.15.169:3300/0 conn(0x7f5b90155a20 0x7f5b900adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.276+0000 7f5b8e800640 1 --2- 172.21.15.45:0/99524052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 0x7f5b900ad9b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009f20 tx=0x7f5b88009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69c8e6f262428e5a server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.276+0000 7f5b8ca00640 1 -- 172.21.15.45:0/99524052 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88031400 con 0x7f5b9006df00 2024-08-17T02:26:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.276+0000 7f5b8ca00640 1 -- 172.21.15.45:0/99524052 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8802d050 con 0x7f5b9006df00 2024-08-17T02:26:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.276+0000 7f5b8ca00640 1 -- 172.21.15.45:0/99524052 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880317d0 con 0x7f5b9006df00 2024-08-17T02:26:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.277+0000 7f5b94a00640 1 -- 172.21.15.45:0/99524052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 msgr2=0x7f5b900ad9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.277+0000 7f5b94a00640 1 --2- 172.21.15.45:0/99524052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 0x7f5b900ad9b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f5b88009f20 tx=0x7f5b88009840 comp rx=0 tx=0).stop 2024-08-17T02:26:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.277+0000 7f5b94a00640 1 -- 172.21.15.45:0/99524052 shutdown_connections 2024-08-17T02:26:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.277+0000 7f5b94a00640 1 --2- 172.21.15.45:0/99524052 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 0x7f5b900ad9b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.277+0000 7f5b94a00640 1 --2- 172.21.15.45:0/99524052 >> v2:172.21.15.169:3300/0 conn(0x7f5b90155a20 0x7f5b900adf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.277+0000 7f5b94a00640 1 -- 172.21.15.45:0/99524052 >> 172.21.15.45:0/99524052 conn(0x7f5b900cb9b0 msgr2=0x7f5b900cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.277+0000 7f5b94a00640 1 -- 172.21.15.45:0/99524052 shutdown_connections 2024-08-17T02:26:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.277+0000 7f5b94a00640 1 -- 172.21.15.45:0/99524052 wait complete. 2024-08-17T02:26:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.278+0000 7f5b94a00640 1 Processor -- start 2024-08-17T02:26:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.279+0000 7f5b94a00640 1 -- start start 2024-08-17T02:26:00.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.279+0000 7f5b94a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 0x7f5b9014f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.279+0000 7f5b94a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b90155a20 0x7f5b90150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.279+0000 7f5b94a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b90155df0 0x7f5b90168de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.279+0000 7f5b94a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900ab0b0 con 0x7f5b90155a20 2024-08-17T02:26:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.279+0000 7f5b94a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b90150820 con 0x7f5b90155df0 2024-08-17T02:26:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.279+0000 7f5b94a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9014fc10 con 0x7f5b9006df00 2024-08-17T02:26:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.280+0000 7f5b8d400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b90155a20 0x7f5b90150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.280+0000 7f5b8d400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b90155a20 0x7f5b90150cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37152/0 (socket says 172.21.15.45:37152) 2024-08-17T02:26:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.280+0000 7f5b8d400640 1 -- 172.21.15.45:0/1239457437 learned_addr learned my addr 172.21.15.45:0/1239457437 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.280+0000 7f5b8de00640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 0x7f5b9014f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.280+0000 7f5b8e800640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b90155df0 0x7f5b90168de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.280+0000 7f5b8d400640 1 -- 172.21.15.45:0/1239457437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 msgr2=0x7f5b9014f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.280+0000 7f5b8d400640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 0x7f5b9014f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.280+0000 7f5b8d400640 1 -- 172.21.15.45:0/1239457437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b90155df0 msgr2=0x7f5b90168de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.280+0000 7f5b8d400640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b90155df0 0x7f5b90168de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.280+0000 7f5b8d400640 1 -- 172.21.15.45:0/1239457437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8000b630 con 0x7f5b90155a20 2024-08-17T02:26:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.281+0000 7f5b8d400640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b90155a20 0x7f5b90150cb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00c590 tx=0x7f5b7c007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.281+0000 7f5b85600640 1 -- 172.21.15.45:0/1239457437 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c007300 con 0x7f5b90155a20 2024-08-17T02:26:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.281+0000 7f5b85600640 1 -- 172.21.15.45:0/1239457437 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c0074a0 con 0x7f5b90155a20 2024-08-17T02:26:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.281+0000 7f5b85600640 1 -- 172.21.15.45:0/1239457437 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0047a0 con 0x7f5b90155a20 2024-08-17T02:26:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.281+0000 7f5b94a00640 1 -- 172.21.15.45:0/1239457437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b88009ae0 con 0x7f5b90155a20 2024-08-17T02:26:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.281+0000 7f5b94a00640 1 -- 172.21.15.45:0/1239457437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b901501d0 con 0x7f5b90155a20 2024-08-17T02:26:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.282+0000 7f5b94a00640 1 -- 172.21.15.45:0/1239457437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b90064db0 con 0x7f5b90155a20 2024-08-17T02:26:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.283+0000 7f5b85600640 1 -- 172.21.15.45:0/1239457437 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5b7c004bf0 con 0x7f5b90155a20 2024-08-17T02:26:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.284+0000 7f5b85600640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b70065150 0x7f5b70067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.284+0000 7f5b85600640 1 -- 172.21.15.45:0/1239457437 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5b7c081500 con 0x7f5b90155a20 2024-08-17T02:26:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.284+0000 7f5b8de00640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b70065150 0x7f5b70067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.285+0000 7f5b8de00640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b70065150 0x7f5b70067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000bfa0 tx=0x7f5b8000b3b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.288+0000 7f5b85600640 1 -- 172.21.15.45:0/1239457437 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5b7c04ce40 con 0x7f5b90155a20 2024-08-17T02:26:00.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.536+0000 7f5b94a00640 1 -- 172.21.15.45:0/1239457437 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5b90150960 con 0x7f5b90155a20 2024-08-17T02:26:00.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.537+0000 7f5b85600640 1 -- 172.21.15.45:0/1239457437 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f5b7c04f9a0 con 0x7f5b90155a20 2024-08-17T02:26:00.537 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:00.538 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-08-17T02:26:00.538 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2024-08-17T02:26:00.538 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.538 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2024-08-17T02:26:00.538 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDQCcBmugtUOhAAoCZ/oIc5/Y83lwx83m+W6w==", 2024-08-17T02:26:00.538 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.538 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDRCcBm9WyrERAA/urklBOu7yhEPHOt71uzdQ==", 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2024-08-17T02:26:00.539 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDRCcBm3r8tCBAAN9okGEnCpElqvRQ5/GPpkA==", 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.540 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDRCcBm3zESGxAADV1G8iQrmWKLo8RyqPIFPA==", 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDTCcBmlbkxDRAAjEXuodIcQr0lxnMBexVj8g==", 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2024-08-17T02:26:00.541 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDWCcBmKuf0ERAA0/8o9380SPIAZXBDu03klA==", 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2024-08-17T02:26:00.542 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDZCcBmwrWNFRAAQqTYFyvCWlMpOSmqjwHbwg==", 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDcCcBmdM7XGRAAzuYhFc6Y1pKeGkJI0dpo4g==", 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.543 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.544 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.544 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.544 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2024-08-17T02:26:00.544 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDiCcBmZv84FRAAzjc+dcaL4GGAj75MDt6taA==", 2024-08-17T02:26:00.544 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.544 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:00.544 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2024-08-17T02:26:00.545 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.545 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.545 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.545 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDlCcBmLfR5GhAAM23vQje3y7hH7QUVNBZJhQ==", 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDoCcBmhVjiHxAABICAKNq8N92ecqX/Ryy6GQ==", 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.546 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDrCcBm5Ig7JRAArcSlfKv7r7Rg3WPZqZny0A==", 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.547 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDRCcBmFztLIxAAYhFZ+pnTExet5Tz55C2blw==", 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDRCcBmRfmCLxAAr8BGlJvP/yxuqVWkFDX2OA==", 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.548 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDRCcBmD8teKRAAaMM+KtD/wcMZ56mhMfqyFw==", 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.549 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDRCcBm8H6ZNRAAt9DBI348gXMa7ZMPiM/xEA==", 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDQCcBmcNldCxAAlWbZ/YiPvgG9zEbp9eAHEw==", 2024-08-17T02:26:00.550 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mds", 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDyCcBmw3CuOhAAEfLo7Hu5AXIdfVZJmQ215w==", 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mds" 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mgr", 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDyCcBmRH2uOhAAvHVoAp/m5ZkK9BbT1l1OIg==", 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mgr" 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-osd", 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDyCcBm6IWuOhAADArQy0EwjAgU4S6FNWql6A==", 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-osd" 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.552 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd", 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDyCcBmp46uOhAA7UvO7MKSgw/Bs2B94bMHlA==", 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd" 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDyCcBmv5iuOhAAMcuU3TKDJHfQOfjchhOE8Q==", 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.553 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rgw", 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDyCcBmNqGuOhAAA/woDFe35+tg6ZnZG7GRJw==", 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rgw" 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDQCcBm+0YZNBAAEHxJLjiGQFAJfW49L6AULw==", 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.554 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDQCcBmlv3hLBAApTWO9QIKFa3fBbvcIv98WA==", 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2024-08-17T02:26:00.555 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.538+0000 7f5b94a00640 1 -- 172.21.15.45:0/1239457437 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b70065150 msgr2=0x7f5b70067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.538+0000 7f5b94a00640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b70065150 0x7f5b70067600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000bfa0 tx=0x7f5b8000b3b0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.538+0000 7f5b94a00640 1 -- 172.21.15.45:0/1239457437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b90155a20 msgr2=0x7f5b90150cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.538+0000 7f5b94a00640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b90155a20 0x7f5b90150cb0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c00c590 tx=0x7f5b7c007eb0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.539+0000 7f5b94a00640 1 -- 172.21.15.45:0/1239457437 shutdown_connections 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.539+0000 7f5b94a00640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5b90155df0 0x7f5b90168de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.539+0000 7f5b94a00640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b90155a20 0x7f5b90150cb0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.539+0000 7f5b94a00640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b70065150 0x7f5b70067600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.539+0000 7f5b94a00640 1 --2- 172.21.15.45:0/1239457437 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5b9006df00 0x7f5b9014f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.539+0000 7f5b94a00640 1 -- 172.21.15.45:0/1239457437 >> 172.21.15.45:0/1239457437 conn(0x7f5b900cb9b0 msgr2=0x7f5b90157f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.539+0000 7f5b94a00640 1 -- 172.21.15.45:0/1239457437 shutdown_connections 2024-08-17T02:26:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.539+0000 7f5b94a00640 1 -- 172.21.15.45:0/1239457437 wait complete. 2024-08-17T02:26:00.558 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-08-17T02:26:00.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.709+0000 7f05aa400640 1 Processor -- start 2024-08-17T02:26:00.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.709+0000 7f05aa400640 1 -- start start 2024-08-17T02:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.710+0000 7f05aa400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05a4155a20 0x7f05a40adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.710+0000 7f05aa400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05a406df00 0x7f05a40ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.710+0000 7f05aa400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a4156670 con 0x7f05a4155df0 2024-08-17T02:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.710+0000 7f05aa400640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a40b0350 con 0x7f05a4155a20 2024-08-17T02:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.710+0000 7f05aa400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a406e5e0 con 0x7f05a406df00 2024-08-17T02:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.710+0000 7f05a3400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05a4155a20 0x7f05a40adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.711+0000 7f05a3400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f05a4155a20 0x7f05a40adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37166/0 (socket says 172.21.15.45:37166) 2024-08-17T02:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.711+0000 7f05a3400640 1 -- 172.21.15.45:0/1765410676 learned_addr learned my addr 172.21.15.45:0/1765410676 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.711+0000 7f05a3e00640 1 --2- 172.21.15.45:0/1765410676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05a406df00 0x7f05a40ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.711+0000 7f05a3400640 1 -- 172.21.15.45:0/1765410676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05a406df00 msgr2=0x7f05a40ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:00.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.711+0000 7f05a3400640 1 --2- 172.21.15.45:0/1765410676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05a406df00 0x7f05a40ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.711+0000 7f05a3400640 1 -- 172.21.15.45:0/1765410676 >> v1:172.21.15.169:6789/0 conn(0x7f05a4155df0 legacy=0x7f05a406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.711+0000 7f05a3400640 1 -- 172.21.15.45:0/1765410676 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a406e8c0 con 0x7f05a4155a20 2024-08-17T02:26:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.712+0000 7f05a3400640 1 --2- 172.21.15.45:0/1765410676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a4155a20 0x7f05a40adf10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0594009910 tx=0x7f05940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2e38d6b873d640 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.712+0000 7f05a2000640 1 -- 172.21.15.45:0/1765410676 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059402ae40 con 0x7f05a4155a20 2024-08-17T02:26:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.712+0000 7f05a2000640 1 -- 172.21.15.45:0/1765410676 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0594032440 con 0x7f05a4155a20 2024-08-17T02:26:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.712+0000 7f05a2000640 1 -- 172.21.15.45:0/1765410676 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594032820 con 0x7f05a4155a20 2024-08-17T02:26:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.713+0000 7f05aa400640 1 -- 172.21.15.45:0/1765410676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a4155a20 msgr2=0x7f05a40adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.713+0000 7f05aa400640 1 --2- 172.21.15.45:0/1765410676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a4155a20 0x7f05a40adf10 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0594009910 tx=0x7f05940091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.713+0000 7f05aa400640 1 -- 172.21.15.45:0/1765410676 shutdown_connections 2024-08-17T02:26:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.713+0000 7f05aa400640 1 --2- 172.21.15.45:0/1765410676 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05a406df00 0x7f05a40ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.713+0000 7f05aa400640 1 --2- 172.21.15.45:0/1765410676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a4155a20 0x7f05a40adf10 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.713+0000 7f05aa400640 1 -- 172.21.15.45:0/1765410676 >> 172.21.15.45:0/1765410676 conn(0x7f05a40cb9b0 msgr2=0x7f05a40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.713+0000 7f05aa400640 1 -- 172.21.15.45:0/1765410676 shutdown_connections 2024-08-17T02:26:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.713+0000 7f05aa400640 1 -- 172.21.15.45:0/1765410676 wait complete. 2024-08-17T02:26:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.714+0000 7f05aa400640 1 Processor -- start 2024-08-17T02:26:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.715+0000 7f05aa400640 1 -- start start 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.715+0000 7f05aa400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a406df00 0x7f05a40ad640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05aa400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05a4155a20 0x7f05a4168ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05aa400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05a4155df0 0x7f05a414f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05aa400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a40adb80 con 0x7f05a406df00 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05aa400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a416c550 con 0x7f05a4155a20 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05aa400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a416c830 con 0x7f05a4155df0 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a3400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a406df00 0x7f05a40ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a3400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a406df00 0x7f05a40ad640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37170/0 (socket says 172.21.15.45:37170) 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a3400640 1 -- 172.21.15.45:0/3914137336 learned_addr learned my addr 172.21.15.45:0/3914137336 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a3e00640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05a4155df0 0x7f05a414f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a2a00640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05a4155a20 0x7f05a4168ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a3400640 1 -- 172.21.15.45:0/3914137336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05a4155df0 msgr2=0x7f05a414f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a3400640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05a4155df0 0x7f05a414f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a3400640 1 -- 172.21.15.45:0/3914137336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05a4155a20 msgr2=0x7f05a4168ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a3400640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05a4155a20 0x7f05a4168ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a3400640 1 -- 172.21.15.45:0/3914137336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0594009450 con 0x7f05a406df00 2024-08-17T02:26:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a2a00640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05a4155a20 0x7f05a4168ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.716+0000 7f05a3400640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a406df00 0x7f05a40ad640 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0594035040 tx=0x7f0594032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.717+0000 7f059aa00640 1 -- 172.21.15.45:0/3914137336 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594031c80 con 0x7f05a406df00 2024-08-17T02:26:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.717+0000 7f059aa00640 1 -- 172.21.15.45:0/3914137336 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0594031e00 con 0x7f05a406df00 2024-08-17T02:26:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.717+0000 7f05aa400640 1 -- 172.21.15.45:0/3914137336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a4169730 con 0x7f05a406df00 2024-08-17T02:26:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.717+0000 7f059aa00640 1 -- 172.21.15.45:0/3914137336 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059403d670 con 0x7f05a406df00 2024-08-17T02:26:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.717+0000 7f05aa400640 1 -- 172.21.15.45:0/3914137336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a4169cf0 con 0x7f05a406df00 2024-08-17T02:26:00.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.718+0000 7f05aa400640 1 -- 172.21.15.45:0/3914137336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a4064db0 con 0x7f05a406df00 2024-08-17T02:26:00.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.719+0000 7f059aa00640 1 -- 172.21.15.45:0/3914137336 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0594039040 con 0x7f05a406df00 2024-08-17T02:26:00.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.719+0000 7f059aa00640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0584065150 0x7f0584067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:00.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.720+0000 7f059aa00640 1 -- 172.21.15.45:0/3914137336 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f059402ae40 con 0x7f05a406df00 2024-08-17T02:26:00.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.720+0000 7f05a2a00640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0584065150 0x7f0584067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:00.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.720+0000 7f05a2a00640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0584065150 0x7f0584067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f05a40c2030 tx=0x7f0590009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:00.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.723+0000 7f059aa00640 1 -- 172.21.15.45:0/3914137336 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0594070820 con 0x7f05a406df00 2024-08-17T02:26:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.974+0000 7f05aa400640 1 -- 172.21.15.45:0/3914137336 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f05a4069820 con 0x7f05a406df00 2024-08-17T02:26:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.978+0000 7f059aa00640 1 -- 172.21.15.45:0/3914137336 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f0594073e40 con 0x7f05a406df00 2024-08-17T02:26:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 -- 172.21.15.45:0/3914137336 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0584065150 msgr2=0x7f0584067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0584065150 0x7f0584067600 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f05a40c2030 tx=0x7f0590009040 comp rx=0 tx=0).stop 2024-08-17T02:26:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 -- 172.21.15.45:0/3914137336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a406df00 msgr2=0x7f05a40ad640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a406df00 0x7f05a40ad640 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0594035040 tx=0x7f0594032000 comp rx=0 tx=0).stop 2024-08-17T02:26:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 -- 172.21.15.45:0/3914137336 shutdown_connections 2024-08-17T02:26:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0584065150 0x7f0584067600 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f05a4155df0 0x7f05a414f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f05a4155a20 0x7f05a4168ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 --2- 172.21.15.45:0/3914137336 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f05a406df00 0x7f05a40ad640 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:00.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 -- 172.21.15.45:0/3914137336 >> 172.21.15.45:0/3914137336 conn(0x7f05a40cb9b0 msgr2=0x7f05a406a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:00.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 -- 172.21.15.45:0/3914137336 shutdown_connections 2024-08-17T02:26:00.982 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:00.980+0000 7f05aa400640 1 -- 172.21.15.45:0/3914137336 wait complete. 2024-08-17T02:26:00.996 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-08-17T02:26:01.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.149+0000 7f462da00640 1 Processor -- start 2024-08-17T02:26:01.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.150+0000 7f462da00640 1 -- start start 2024-08-17T02:26:01.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.151+0000 7f462da00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f4628155900 0x7f4628155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.151+0000 7f462da00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46280b0270 0x7f4628156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.151+0000 7f462da00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4628157b20 0x7f4628157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.151+0000 7f462da00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4628157690 con 0x7f4628157b20 2024-08-17T02:26:01.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.151+0000 7f462da00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4628156a80 con 0x7f4628155900 2024-08-17T02:26:01.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.151+0000 7f462da00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4628156d60 con 0x7f46280b0270 2024-08-17T02:26:01.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.151+0000 7f462d000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4628157b20 0x7f4628157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.151+0000 7f462d000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4628157b20 0x7f4628157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37172/0 (socket says 172.21.15.45:37172) 2024-08-17T02:26:01.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.151+0000 7f462d000640 1 -- 172.21.15.45:0/2261790893 learned_addr learned my addr 172.21.15.45:0/2261790893 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:01.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.151+0000 7f461fe00640 1 --2- 172.21.15.45:0/2261790893 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46280b0270 0x7f4628156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.151+0000 7f4627e00640 1 --2- 172.21.15.45:0/2261790893 >> v2:172.21.15.169:3300/0 conn(0x7f4628155900 0x7f4628155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.152+0000 7f462d000640 1 -- 172.21.15.45:0/2261790893 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46280b0270 msgr2=0x7f4628156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:01.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.152+0000 7f462d000640 1 --2- 172.21.15.45:0/2261790893 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46280b0270 0x7f4628156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.152+0000 7f462d000640 1 -- 172.21.15.45:0/2261790893 >> v2:172.21.15.169:3300/0 conn(0x7f4628155900 msgr2=0x7f4628155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:01.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.152+0000 7f462d000640 1 --2- 172.21.15.45:0/2261790893 >> v2:172.21.15.169:3300/0 conn(0x7f4628155900 0x7f4628155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.152+0000 7f462d000640 1 -- 172.21.15.45:0/2261790893 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4628157040 con 0x7f4628157b20 2024-08-17T02:26:01.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.152+0000 7f461fe00640 1 --2- 172.21.15.45:0/2261790893 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46280b0270 0x7f4628156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:01.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.153+0000 7f462d000640 1 --2- 172.21.15.45:0/2261790893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4628157b20 0x7f4628157fa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4628065fd0 tx=0x7f4620009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38403a5f20707b1b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.153+0000 7f4627400640 1 -- 172.21.15.45:0/2261790893 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4620031400 con 0x7f4628157b20 2024-08-17T02:26:01.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.153+0000 7f4627400640 1 -- 172.21.15.45:0/2261790893 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462002d050 con 0x7f4628157b20 2024-08-17T02:26:01.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.153+0000 7f4627400640 1 -- 172.21.15.45:0/2261790893 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46200317d0 con 0x7f4628157b20 2024-08-17T02:26:01.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.153+0000 7f462da00640 1 -- 172.21.15.45:0/2261790893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4628157b20 msgr2=0x7f4628157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.153+0000 7f462da00640 1 --2- 172.21.15.45:0/2261790893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4628157b20 0x7f4628157fa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4628065fd0 tx=0x7f4620009840 comp rx=0 tx=0).stop 2024-08-17T02:26:01.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.154+0000 7f462da00640 1 -- 172.21.15.45:0/2261790893 shutdown_connections 2024-08-17T02:26:01.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.154+0000 7f462da00640 1 --2- 172.21.15.45:0/2261790893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4628157b20 0x7f4628157fa0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.154+0000 7f462da00640 1 --2- 172.21.15.45:0/2261790893 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f46280b0270 0x7f4628156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.154+0000 7f462da00640 1 --2- 172.21.15.45:0/2261790893 >> v2:172.21.15.169:3300/0 conn(0x7f4628155900 0x7f4628155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.154+0000 7f462da00640 1 -- 172.21.15.45:0/2261790893 >> 172.21.15.45:0/2261790893 conn(0x7f4628067750 msgr2=0x7f46280cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.154+0000 7f462da00640 1 -- 172.21.15.45:0/2261790893 shutdown_connections 2024-08-17T02:26:01.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.154+0000 7f462da00640 1 -- 172.21.15.45:0/2261790893 wait complete. 2024-08-17T02:26:01.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.155+0000 7f462da00640 1 Processor -- start 2024-08-17T02:26:01.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.155+0000 7f462da00640 1 -- start start 2024-08-17T02:26:01.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.156+0000 7f462da00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46280b0270 0x7f462814aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.156+0000 7f462da00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4628155900 0x7f46280c7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.156+0000 7f462da00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4628157b20 0x7f46280c8310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.156+0000 7f462da00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46280cab00 con 0x7f4628155900 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.156+0000 7f462da00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46280aa970 con 0x7f46280b0270 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.156+0000 7f462da00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46281538a0 con 0x7f4628157b20 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.156+0000 7f461fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4628155900 0x7f46280c7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.156+0000 7f461fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4628155900 0x7f46280c7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37184/0 (socket says 172.21.15.45:37184) 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.156+0000 7f461fe00640 1 -- 172.21.15.45:0/1952975304 learned_addr learned my addr 172.21.15.45:0/1952975304 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.156+0000 7f4627e00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46280b0270 0x7f462814aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.156+0000 7f462d000640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4628157b20 0x7f46280c8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.157+0000 7f461fe00640 1 -- 172.21.15.45:0/1952975304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4628157b20 msgr2=0x7f46280c8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.157+0000 7f461fe00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4628157b20 0x7f46280c8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.157+0000 7f461fe00640 1 -- 172.21.15.45:0/1952975304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46280b0270 msgr2=0x7f462814aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.157+0000 7f461fe00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46280b0270 0x7f462814aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.157+0000 7f461fe00640 1 -- 172.21.15.45:0/1952975304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620009ae0 con 0x7f4628155900 2024-08-17T02:26:01.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.157+0000 7f461fe00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4628155900 0x7f46280c7dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f461000d890 tx=0x7f4610008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.157+0000 7f461f400640 1 -- 172.21.15.45:0/1952975304 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461000de80 con 0x7f4628155900 2024-08-17T02:26:01.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.157+0000 7f461f400640 1 -- 172.21.15.45:0/1952975304 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f461000b8d0 con 0x7f4628155900 2024-08-17T02:26:01.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.157+0000 7f461f400640 1 -- 172.21.15.45:0/1952975304 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f461000bc90 con 0x7f4628155900 2024-08-17T02:26:01.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.157+0000 7f462da00640 1 -- 172.21.15.45:0/1952975304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4628153b80 con 0x7f4628155900 2024-08-17T02:26:01.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.158+0000 7f462da00640 1 -- 172.21.15.45:0/1952975304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4628154140 con 0x7f4628155900 2024-08-17T02:26:01.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.159+0000 7f462da00640 1 -- 172.21.15.45:0/1952975304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4628071050 con 0x7f4628155900 2024-08-17T02:26:01.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.159+0000 7f461f400640 1 -- 172.21.15.45:0/1952975304 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f461001e460 con 0x7f4628155900 2024-08-17T02:26:01.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.160+0000 7f461f400640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4604065150 0x7f4604067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.161+0000 7f461f400640 1 -- 172.21.15.45:0/1952975304 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4610082760 con 0x7f4628155900 2024-08-17T02:26:01.161 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.161+0000 7f4627e00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4604065150 0x7f4604067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.161+0000 7f4627e00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4604065150 0x7f4604067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4618007ba0 tx=0x7f4618008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.165+0000 7f461f400640 1 -- 172.21.15.45:0/1952975304 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4610054610 con 0x7f4628155900 2024-08-17T02:26:01.414 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.413+0000 7f462da00640 1 -- 172.21.15.45:0/1952975304 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f46280b0af0 con 0x7f4628155900 2024-08-17T02:26:01.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.417+0000 7f461f400640 1 -- 172.21.15.45:0/1952975304 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f46100541a0 con 0x7f4628155900 2024-08-17T02:26:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.419+0000 7f462da00640 1 -- 172.21.15.45:0/1952975304 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4604065150 msgr2=0x7f4604067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.419+0000 7f462da00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4604065150 0x7f4604067600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4618007ba0 tx=0x7f4618008040 comp rx=0 tx=0).stop 2024-08-17T02:26:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.419+0000 7f462da00640 1 -- 172.21.15.45:0/1952975304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4628155900 msgr2=0x7f46280c7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.419+0000 7f462da00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4628155900 0x7f46280c7dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f461000d890 tx=0x7f4610008040 comp rx=0 tx=0).stop 2024-08-17T02:26:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.419+0000 7f462da00640 1 -- 172.21.15.45:0/1952975304 shutdown_connections 2024-08-17T02:26:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.419+0000 7f462da00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4604065150 0x7f4604067600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.419+0000 7f462da00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4628157b20 0x7f46280c8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.419+0000 7f462da00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4628155900 0x7f46280c7dd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.419+0000 7f462da00640 1 --2- 172.21.15.45:0/1952975304 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f46280b0270 0x7f462814aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.419+0000 7f462da00640 1 -- 172.21.15.45:0/1952975304 >> 172.21.15.45:0/1952975304 conn(0x7f4628067750 msgr2=0x7f462806e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.419+0000 7f462da00640 1 -- 172.21.15.45:0/1952975304 shutdown_connections 2024-08-17T02:26:01.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.420+0000 7f462da00640 1 -- 172.21.15.45:0/1952975304 wait complete. 2024-08-17T02:26:01.435 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-08-17T02:26:01.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.587+0000 7fc360400640 1 Processor -- start 2024-08-17T02:26:01.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.587+0000 7fc360400640 1 -- start start 2024-08-17T02:26:01.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.588+0000 7fc360400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc358158cb0 0x7fc3580af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.588+0000 7fc360400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3580ac820 0x7fc358159080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.588+0000 7fc360400640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3580abc80 con 0x7fc3580aa910 2024-08-17T02:26:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.588+0000 7fc360400640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3580ab070 con 0x7fc3580ac820 2024-08-17T02:26:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.588+0000 7fc360400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3580ab350 con 0x7fc358158cb0 2024-08-17T02:26:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.588+0000 7fc35e400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3580ac820 0x7fc358159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.589+0000 7fc35e400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3580ac820 0x7fc358159080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37200/0 (socket says 172.21.15.45:37200) 2024-08-17T02:26:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.589+0000 7fc35e400640 1 -- 172.21.15.45:0/805244289 learned_addr learned my addr 172.21.15.45:0/805244289 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.588+0000 7fc35d000640 1 --1- 172.21.15.45:0/805244289 >> v1:172.21.15.45:6789/0 conn(0x7fc3580aa910 0x7fc3580ac110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:54510/0 (socket says 172.21.15.45:54510) 2024-08-17T02:26:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.589+0000 7fc35da00640 1 --2- 172.21.15.45:0/805244289 >> v2:172.21.15.169:3300/0 conn(0x7fc358158cb0 0x7fc3580af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.589+0000 7fc35e400640 1 -- 172.21.15.45:0/805244289 >> v2:172.21.15.169:3300/0 conn(0x7fc358158cb0 msgr2=0x7fc3580af6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:01.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.589+0000 7fc35e400640 1 --2- 172.21.15.45:0/805244289 >> v2:172.21.15.169:3300/0 conn(0x7fc358158cb0 0x7fc3580af6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.589+0000 7fc35e400640 1 -- 172.21.15.45:0/805244289 >> v1:172.21.15.45:6789/0 conn(0x7fc3580aa910 legacy=0x7fc3580ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.589+0000 7fc357e00640 1 -- 172.21.15.45:0/805244289 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902339271 0 0) 0x7fc3580abc80 con 0x7fc3580aa910 2024-08-17T02:26:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.589+0000 7fc35e400640 1 -- 172.21.15.45:0/805244289 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3580ab630 con 0x7fc3580ac820 2024-08-17T02:26:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.590+0000 7fc35e400640 1 --2- 172.21.15.45:0/805244289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3580ac820 0x7fc358159080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc35806d930 tx=0x7fc350009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd1f4904ed86c93 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.590+0000 7fc357e00640 1 -- 172.21.15.45:0/805244289 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35002e050 con 0x7fc3580ac820 2024-08-17T02:26:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.590+0000 7fc357e00640 1 -- 172.21.15.45:0/805244289 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350007400 con 0x7fc3580ac820 2024-08-17T02:26:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.590+0000 7fc357e00640 1 -- 172.21.15.45:0/805244289 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3500077a0 con 0x7fc3580ac820 2024-08-17T02:26:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.591+0000 7fc360400640 1 -- 172.21.15.45:0/805244289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3580ac820 msgr2=0x7fc358159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.591+0000 7fc360400640 1 --2- 172.21.15.45:0/805244289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3580ac820 0x7fc358159080 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc35806d930 tx=0x7fc350009840 comp rx=0 tx=0).stop 2024-08-17T02:26:01.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.591+0000 7fc360400640 1 -- 172.21.15.45:0/805244289 shutdown_connections 2024-08-17T02:26:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.591+0000 7fc360400640 1 --2- 172.21.15.45:0/805244289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3580ac820 0x7fc358159080 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.591+0000 7fc360400640 1 --2- 172.21.15.45:0/805244289 >> v2:172.21.15.169:3300/0 conn(0x7fc358158cb0 0x7fc3580af6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.591+0000 7fc360400640 1 -- 172.21.15.45:0/805244289 >> 172.21.15.45:0/805244289 conn(0x7fc358096a70 msgr2=0x7fc358096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.591+0000 7fc360400640 1 -- 172.21.15.45:0/805244289 shutdown_connections 2024-08-17T02:26:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.591+0000 7fc360400640 1 -- 172.21.15.45:0/805244289 wait complete. 2024-08-17T02:26:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.593+0000 7fc360400640 1 Processor -- start 2024-08-17T02:26:01.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.593+0000 7fc360400640 1 -- start start 2024-08-17T02:26:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc360400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3580aa910 0x7fc358155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc360400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3580ac820 0x7fc3580b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc360400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc358158cb0 0x7fc3581532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc360400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc358156090 con 0x7fc358158cb0 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc360400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc358155db0 con 0x7fc3580aa910 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc360400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc35816c9b0 con 0x7fc3580ac820 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc35e400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc358158cb0 0x7fc3581532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc35e400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc358158cb0 0x7fc3581532c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37214/0 (socket says 172.21.15.45:37214) 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc35e400640 1 -- 172.21.15.45:0/1790389512 learned_addr learned my addr 172.21.15.45:0/1790389512 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc35da00640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3580aa910 0x7fc358155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc35d000640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3580ac820 0x7fc3580b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc35e400640 1 -- 172.21.15.45:0/1790389512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3580ac820 msgr2=0x7fc3580b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc35e400640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3580ac820 0x7fc3580b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc35e400640 1 -- 172.21.15.45:0/1790389512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3580aa910 msgr2=0x7fc358155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc35e400640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3580aa910 0x7fc358155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc35e400640 1 -- 172.21.15.45:0/1790389512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc350009ae0 con 0x7fc358158cb0 2024-08-17T02:26:01.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.594+0000 7fc35da00640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3580aa910 0x7fc358155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.595+0000 7fc35e400640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc358158cb0 0x7fc3581532c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc35002ad60 tx=0x7fc350037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.595+0000 7fc354c00640 1 -- 172.21.15.45:0/1790389512 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc350033ac0 con 0x7fc358158cb0 2024-08-17T02:26:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.595+0000 7fc354c00640 1 -- 172.21.15.45:0/1790389512 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc350033c40 con 0x7fc358158cb0 2024-08-17T02:26:01.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.595+0000 7fc360400640 1 -- 172.21.15.45:0/1790389512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc35816cc90 con 0x7fc358158cb0 2024-08-17T02:26:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.595+0000 7fc354c00640 1 -- 172.21.15.45:0/1790389512 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc35003c410 con 0x7fc358158cb0 2024-08-17T02:26:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.595+0000 7fc360400640 1 -- 172.21.15.45:0/1790389512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc358155aa0 con 0x7fc358158cb0 2024-08-17T02:26:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.596+0000 7fc360400640 1 -- 172.21.15.45:0/1790389512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc358064db0 con 0x7fc358158cb0 2024-08-17T02:26:01.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.597+0000 7fc354c00640 1 -- 172.21.15.45:0/1790389512 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc350039050 con 0x7fc358158cb0 2024-08-17T02:26:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.598+0000 7fc354c00640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc338065150 0x7fc338067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.598+0000 7fc354c00640 1 -- 172.21.15.45:0/1790389512 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc3500a29e0 con 0x7fc358158cb0 2024-08-17T02:26:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.599+0000 7fc35da00640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc338065150 0x7fc338067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:01.600 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.599+0000 7fc35da00640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc338065150 0x7fc338067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00bbb0 tx=0x7fc34c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:01.603 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.603+0000 7fc354c00640 1 -- 172.21.15.45:0/1790389512 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc350070e00 con 0x7fc358158cb0 2024-08-17T02:26:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.852+0000 7fc360400640 1 -- 172.21.15.45:0/1790389512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc35806b800 con 0x7fc358158cb0 2024-08-17T02:26:01.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.856+0000 7fc354c00640 1 -- 172.21.15.45:0/1790389512 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc350074420 con 0x7fc358158cb0 2024-08-17T02:26:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 -- 172.21.15.45:0/1790389512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc338065150 msgr2=0x7fc338067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc338065150 0x7fc338067600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc34c00bbb0 tx=0x7fc34c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 -- 172.21.15.45:0/1790389512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc358158cb0 msgr2=0x7fc3581532c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc358158cb0 0x7fc3581532c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc35002ad60 tx=0x7fc350037000 comp rx=0 tx=0).stop 2024-08-17T02:26:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 -- 172.21.15.45:0/1790389512 shutdown_connections 2024-08-17T02:26:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc358158cb0 0x7fc3581532c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc338065150 0x7fc338067600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc3580ac820 0x7fc3580b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 --2- 172.21.15.45:0/1790389512 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc3580aa910 0x7fc358155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:01.859 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 -- 172.21.15.45:0/1790389512 >> 172.21.15.45:0/1790389512 conn(0x7fc358096a70 msgr2=0x7fc35806bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:01.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 -- 172.21.15.45:0/1790389512 shutdown_connections 2024-08-17T02:26:01.860 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:01.858+0000 7fc360400640 1 -- 172.21.15.45:0/1790389512 wait complete. 2024-08-17T02:26:01.874 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-08-17T02:26:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.025+0000 7fe649000640 1 Processor -- start 2024-08-17T02:26:02.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.025+0000 7fe649000640 1 -- start start 2024-08-17T02:26:02.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.026+0000 7fe649000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe6440ce8a0 0x7fe6440ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.026+0000 7fe649000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6440c5c40 0x7fe6440cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.026+0000 7fe649000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6440cc890 con 0x7fe6440aed50 2024-08-17T02:26:02.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.026+0000 7fe649000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6440cb230 con 0x7fe6440ce8a0 2024-08-17T02:26:02.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.026+0000 7fe649000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440cb4c0 con 0x7fe6440c5c40 2024-08-17T02:26:02.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.026+0000 7fe643400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe6440aed50 0x7fe6440ce190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59356/0 (socket says 172.21.15.45:59356) 2024-08-17T02:26:02.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.026+0000 7fe643400640 1 -- 172.21.15.45:0/4194360551 learned_addr learned my addr 172.21.15.45:0/4194360551 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.026+0000 7fe63be00640 1 --2- 172.21.15.45:0/4194360551 >> v2:172.21.15.169:3300/0 conn(0x7fe6440ce8a0 0x7fe6440ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.026+0000 7fe643e00640 1 --2- 172.21.15.45:0/4194360551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6440c5c40 0x7fe6440cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.027+0000 7fe642a00640 1 -- 172.21.15.45:0/4194360551 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7752486 0 0) 0x7fe6440cc890 con 0x7fe6440aed50 2024-08-17T02:26:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.027+0000 7fe642a00640 1 -- 172.21.15.45:0/4194360551 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6280034e0 con 0x7fe6440aed50 2024-08-17T02:26:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.027+0000 7fe63be00640 1 -- 172.21.15.45:0/4194360551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6440c5c40 msgr2=0x7fe6440cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.027+0000 7fe63be00640 1 --2- 172.21.15.45:0/4194360551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6440c5c40 0x7fe6440cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.027+0000 7fe63be00640 1 -- 172.21.15.45:0/4194360551 >> v1:172.21.15.45:6789/0 conn(0x7fe6440aed50 legacy=0x7fe6440ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.027+0000 7fe63be00640 1 -- 172.21.15.45:0/4194360551 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6440cb7a0 con 0x7fe6440ce8a0 2024-08-17T02:26:02.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.028+0000 7fe63be00640 1 --2- 172.21.15.45:0/4194360551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6440ce8a0 0x7fe6440ca7b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009850 tx=0x7fe62c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94b6c8d0059ae036 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.028+0000 7fe642a00640 1 -- 172.21.15.45:0/4194360551 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c02ad80 con 0x7fe6440ce8a0 2024-08-17T02:26:02.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.029+0000 7fe642a00640 1 -- 172.21.15.45:0/4194360551 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62c032440 con 0x7fe6440ce8a0 2024-08-17T02:26:02.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.029+0000 7fe642a00640 1 -- 172.21.15.45:0/4194360551 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62c032820 con 0x7fe6440ce8a0 2024-08-17T02:26:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.029+0000 7fe649000640 1 -- 172.21.15.45:0/4194360551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6440ce8a0 msgr2=0x7fe6440ca7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.029+0000 7fe649000640 1 --2- 172.21.15.45:0/4194360551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6440ce8a0 0x7fe6440ca7b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009850 tx=0x7fe62c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.029+0000 7fe649000640 1 -- 172.21.15.45:0/4194360551 shutdown_connections 2024-08-17T02:26:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.029+0000 7fe649000640 1 --2- 172.21.15.45:0/4194360551 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6440c5c40 0x7fe6440cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.029+0000 7fe649000640 1 --2- 172.21.15.45:0/4194360551 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6440ce8a0 0x7fe6440ca7b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.029+0000 7fe649000640 1 -- 172.21.15.45:0/4194360551 >> 172.21.15.45:0/4194360551 conn(0x7fe644098e30 msgr2=0x7fe64406eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.029+0000 7fe649000640 1 -- 172.21.15.45:0/4194360551 shutdown_connections 2024-08-17T02:26:02.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.029+0000 7fe649000640 1 -- 172.21.15.45:0/4194360551 wait complete. 2024-08-17T02:26:02.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.031+0000 7fe649000640 1 Processor -- start 2024-08-17T02:26:02.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.031+0000 7fe649000640 1 -- start start 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe649000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6440aed50 0x7fe644150250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe649000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6440c5c40 0x7fe6440af120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe649000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6440ce8a0 0x7fe6440af660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe649000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440c7630 con 0x7fe6440aed50 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe649000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe644150790 con 0x7fe6440c5c40 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe649000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440c6d00 con 0x7fe6440ce8a0 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe643400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6440aed50 0x7fe644150250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe643400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6440aed50 0x7fe644150250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42698/0 (socket says 172.21.15.45:42698) 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe643400640 1 -- 172.21.15.45:0/2687049316 learned_addr learned my addr 172.21.15.45:0/2687049316 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe643e00640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6440ce8a0 0x7fe6440af660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe63be00640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6440c5c40 0x7fe6440af120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe643400640 1 -- 172.21.15.45:0/2687049316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6440ce8a0 msgr2=0x7fe6440af660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe643400640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6440ce8a0 0x7fe6440af660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe643400640 1 -- 172.21.15.45:0/2687049316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6440c5c40 msgr2=0x7fe6440af120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe643400640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6440c5c40 0x7fe6440af120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe643400640 1 -- 172.21.15.45:0/2687049316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe62c009390 con 0x7fe6440aed50 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe63be00640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6440c5c40 0x7fe6440af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.032+0000 7fe643e00640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6440ce8a0 0x7fe6440af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.033+0000 7fe643400640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6440aed50 0x7fe644150250 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe63400c590 tx=0x7fe634007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.033+0000 7fe63aa00640 1 -- 172.21.15.45:0/2687049316 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634005b70 con 0x7fe6440aed50 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.033+0000 7fe63aa00640 1 -- 172.21.15.45:0/2687049316 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe634005cf0 con 0x7fe6440aed50 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.033+0000 7fe63aa00640 1 -- 172.21.15.45:0/2687049316 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634007320 con 0x7fe6440aed50 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.033+0000 7fe649000640 1 -- 172.21.15.45:0/2687049316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6440c6fe0 con 0x7fe6440aed50 2024-08-17T02:26:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.033+0000 7fe649000640 1 -- 172.21.15.45:0/2687049316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe644155db0 con 0x7fe6440aed50 2024-08-17T02:26:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.034+0000 7fe649000640 1 -- 172.21.15.45:0/2687049316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe644071050 con 0x7fe6440aed50 2024-08-17T02:26:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.035+0000 7fe63aa00640 1 -- 172.21.15.45:0/2687049316 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe634012400 con 0x7fe6440aed50 2024-08-17T02:26:02.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.036+0000 7fe63aa00640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe620065150 0x7fe620067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.036+0000 7fe63aa00640 1 -- 172.21.15.45:0/2687049316 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe6340816e0 con 0x7fe6440aed50 2024-08-17T02:26:02.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.037+0000 7fe63be00640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe620065150 0x7fe620067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.037+0000 7fe63be00640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe620065150 0x7fe620067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe62c034000 tx=0x7fe62c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.040+0000 7fe63aa00640 1 -- 172.21.15.45:0/2687049316 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe63404fa50 con 0x7fe6440aed50 2024-08-17T02:26:02.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.293+0000 7fe649000640 1 -- 172.21.15.45:0/2687049316 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fe6440cdaf0 con 0x7fe6440aed50 2024-08-17T02:26:02.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.297+0000 7fe63aa00640 1 -- 172.21.15.45:0/2687049316 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe634053070 con 0x7fe6440aed50 2024-08-17T02:26:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 -- 172.21.15.45:0/2687049316 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe620065150 msgr2=0x7fe620067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe620065150 0x7fe620067600 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe62c034000 tx=0x7fe62c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 -- 172.21.15.45:0/2687049316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6440aed50 msgr2=0x7fe644150250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6440aed50 0x7fe644150250 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe63400c590 tx=0x7fe634007d70 comp rx=0 tx=0).stop 2024-08-17T02:26:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 -- 172.21.15.45:0/2687049316 shutdown_connections 2024-08-17T02:26:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe620065150 0x7fe620067600 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe6440ce8a0 0x7fe6440af660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe6440c5c40 0x7fe6440af120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 --2- 172.21.15.45:0/2687049316 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe6440aed50 0x7fe644150250 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 -- 172.21.15.45:0/2687049316 >> 172.21.15.45:0/2687049316 conn(0x7fe644098e30 msgr2=0x7fe6440d0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 -- 172.21.15.45:0/2687049316 shutdown_connections 2024-08-17T02:26:02.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.300+0000 7fe649000640 1 -- 172.21.15.45:0/2687049316 wait complete. 2024-08-17T02:26:02.315 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-08-17T02:26:02.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.468+0000 7f024b600640 1 Processor -- start 2024-08-17T02:26:02.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.468+0000 7f024b600640 1 -- start start 2024-08-17T02:26:02.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.469+0000 7f024b600640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0244155a20 0x7f02440adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.469+0000 7f024b600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f024406df00 0x7f02440ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.469+0000 7f024b600640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0244156670 con 0x7f0244155df0 2024-08-17T02:26:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.469+0000 7f024b600640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02440b0350 con 0x7f0244155a20 2024-08-17T02:26:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.469+0000 7f024b600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f024406e5e0 con 0x7f024406df00 2024-08-17T02:26:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.470+0000 7f0243e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0244155df0 0x7f024406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59358/0 (socket says 172.21.15.45:59358) 2024-08-17T02:26:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.470+0000 7f0243e00640 1 -- 172.21.15.45:0/111583728 learned_addr learned my addr 172.21.15.45:0/111583728 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.470+0000 7f0248c00640 1 --2- 172.21.15.45:0/111583728 >> v2:172.21.15.169:3300/0 conn(0x7f0244155a20 0x7f02440adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.470+0000 7f0249600640 1 --2- 172.21.15.45:0/111583728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f024406df00 0x7f02440ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.470+0000 7f0243400640 1 -- 172.21.15.45:0/111583728 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115144506 0 0) 0x7f0244156670 con 0x7f0244155df0 2024-08-17T02:26:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.470+0000 7f0243400640 1 -- 172.21.15.45:0/111583728 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f022c0034e0 con 0x7f0244155df0 2024-08-17T02:26:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.470+0000 7f0248c00640 1 -- 172.21.15.45:0/111583728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f024406df00 msgr2=0x7f02440ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.470+0000 7f0248c00640 1 --2- 172.21.15.45:0/111583728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f024406df00 0x7f02440ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.470+0000 7f0248c00640 1 -- 172.21.15.45:0/111583728 >> v1:172.21.15.45:6789/0 conn(0x7f0244155df0 legacy=0x7f024406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.470+0000 7f0248c00640 1 -- 172.21.15.45:0/111583728 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f024406e8c0 con 0x7f0244155a20 2024-08-17T02:26:02.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.472+0000 7f0248c00640 1 --2- 172.21.15.45:0/111583728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0244155a20 0x7f02440adf10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0238009850 tx=0x7f02380090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2858def923ca8ba9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.472+0000 7f0243400640 1 -- 172.21.15.45:0/111583728 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f023802ad90 con 0x7f0244155a20 2024-08-17T02:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.472+0000 7f0243400640 1 -- 172.21.15.45:0/111583728 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0238032440 con 0x7f0244155a20 2024-08-17T02:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.472+0000 7f0243400640 1 -- 172.21.15.45:0/111583728 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0238032820 con 0x7f0244155a20 2024-08-17T02:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.473+0000 7f024b600640 1 -- 172.21.15.45:0/111583728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0244155a20 msgr2=0x7f02440adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.473+0000 7f024b600640 1 --2- 172.21.15.45:0/111583728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0244155a20 0x7f02440adf10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0238009850 tx=0x7f02380090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.473+0000 7f024b600640 1 -- 172.21.15.45:0/111583728 shutdown_connections 2024-08-17T02:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.473+0000 7f024b600640 1 --2- 172.21.15.45:0/111583728 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f024406df00 0x7f02440ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.473+0000 7f024b600640 1 --2- 172.21.15.45:0/111583728 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0244155a20 0x7f02440adf10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.473+0000 7f024b600640 1 -- 172.21.15.45:0/111583728 >> 172.21.15.45:0/111583728 conn(0x7f02440cb9b0 msgr2=0x7f02440cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:02.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.473+0000 7f024b600640 1 -- 172.21.15.45:0/111583728 shutdown_connections 2024-08-17T02:26:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.473+0000 7f024b600640 1 -- 172.21.15.45:0/111583728 wait complete. 2024-08-17T02:26:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.474+0000 7f024b600640 1 Processor -- start 2024-08-17T02:26:02.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.475+0000 7f024b600640 1 -- start start 2024-08-17T02:26:02.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.475+0000 7f024b600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f024406df00 0x7f024414d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.475+0000 7f024b600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0244155a20 0x7f0244150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.475+0000 7f024b600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0244155df0 0x7f024414ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.475+0000 7f024b600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0244150180 con 0x7f0244155a20 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.475+0000 7f024b600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f024414f890 con 0x7f024406df00 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.475+0000 7f024b600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0244169bb0 con 0x7f0244155df0 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.476+0000 7f0243e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0244155a20 0x7f0244150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.476+0000 7f0243e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0244155a20 0x7f0244150610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42714/0 (socket says 172.21.15.45:42714) 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.476+0000 7f0243e00640 1 -- 172.21.15.45:0/2557888667 learned_addr learned my addr 172.21.15.45:0/2557888667 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.476+0000 7f0248c00640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f024406df00 0x7f024414d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.476+0000 7f0249600640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0244155df0 0x7f024414ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.476+0000 7f0243e00640 1 -- 172.21.15.45:0/2557888667 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0244155df0 msgr2=0x7f024414ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.476+0000 7f0243e00640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0244155df0 0x7f024414ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.476+0000 7f0243e00640 1 -- 172.21.15.45:0/2557888667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f024406df00 msgr2=0x7f024414d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.478 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.476+0000 7f0243e00640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f024406df00 0x7f024414d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.476+0000 7f0243e00640 1 -- 172.21.15.45:0/2557888667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0238009390 con 0x7f0244155a20 2024-08-17T02:26:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.476+0000 7f0243e00640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0244155a20 0x7f0244150610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f023000c4c0 tx=0x7f0230007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.477+0000 7f0237e00640 1 -- 172.21.15.45:0/2557888667 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0230005aa0 con 0x7f0244155a20 2024-08-17T02:26:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.477+0000 7f0237e00640 1 -- 172.21.15.45:0/2557888667 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0230005c00 con 0x7f0244155a20 2024-08-17T02:26:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.477+0000 7f0237e00640 1 -- 172.21.15.45:0/2557888667 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02300070d0 con 0x7f0244155a20 2024-08-17T02:26:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.477+0000 7f024b600640 1 -- 172.21.15.45:0/2557888667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f024414fb30 con 0x7f0244155a20 2024-08-17T02:26:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.477+0000 7f024b600640 1 -- 172.21.15.45:0/2557888667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f024414db70 con 0x7f0244155a20 2024-08-17T02:26:02.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.478+0000 7f024b600640 1 -- 172.21.15.45:0/2557888667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0244150330 con 0x7f0244155a20 2024-08-17T02:26:02.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.479+0000 7f0237e00640 1 -- 172.21.15.45:0/2557888667 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f02300074c0 con 0x7f0244155a20 2024-08-17T02:26:02.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.480+0000 7f0237e00640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0224065150 0x7f0224067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.480+0000 7f0237e00640 1 -- 172.21.15.45:0/2557888667 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0230081600 con 0x7f0244155a20 2024-08-17T02:26:02.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.480+0000 7f0248c00640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0224065150 0x7f0224067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.481+0000 7f0248c00640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0224065150 0x7f0224067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0238034000 tx=0x7f0238032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.484+0000 7f0237e00640 1 -- 172.21.15.45:0/2557888667 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0244150330 con 0x7f0244155a20 2024-08-17T02:26:02.736 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.735+0000 7f024b600640 1 -- 172.21.15.45:0/2557888667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f0244064db0 con 0x7f0244155a20 2024-08-17T02:26:02.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.739+0000 7f0237e00640 1 -- 172.21.15.45:0/2557888667 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f02300170a0 con 0x7f0244155a20 2024-08-17T02:26:02.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.741+0000 7f024b600640 1 -- 172.21.15.45:0/2557888667 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0224065150 msgr2=0x7f0224067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.741+0000 7f024b600640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0224065150 0x7f0224067600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0238034000 tx=0x7f0238032000 comp rx=0 tx=0).stop 2024-08-17T02:26:02.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.741+0000 7f024b600640 1 -- 172.21.15.45:0/2557888667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0244155a20 msgr2=0x7f0244150610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.741+0000 7f024b600640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0244155a20 0x7f0244150610 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f023000c4c0 tx=0x7f0230007d40 comp rx=0 tx=0).stop 2024-08-17T02:26:02.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.741+0000 7f024b600640 1 -- 172.21.15.45:0/2557888667 shutdown_connections 2024-08-17T02:26:02.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.741+0000 7f024b600640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0224065150 0x7f0224067600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.741+0000 7f024b600640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0244155df0 0x7f024414ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.741+0000 7f024b600640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0244155a20 0x7f0244150610 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.741+0000 7f024b600640 1 --2- 172.21.15.45:0/2557888667 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f024406df00 0x7f024414d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.741+0000 7f024b600640 1 -- 172.21.15.45:0/2557888667 >> 172.21.15.45:0/2557888667 conn(0x7f02440cb9b0 msgr2=0x7f02440add90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:02.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.742+0000 7f024b600640 1 -- 172.21.15.45:0/2557888667 shutdown_connections 2024-08-17T02:26:02.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.742+0000 7f024b600640 1 -- 172.21.15.45:0/2557888667 wait complete. 2024-08-17T02:26:02.758 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-08-17T02:26:02.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.909+0000 7f6f9a200640 1 Processor -- start 2024-08-17T02:26:02.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.909+0000 7f6f9a200640 1 -- start start 2024-08-17T02:26:02.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.910+0000 7f6f9a200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6f94155a20 0x7f6f940adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.910+0000 7f6f9a200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f94155df0 0x7f6f940ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.910+0000 7f6f9a200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f94156670 con 0x7f6f9406d7f0 2024-08-17T02:26:02.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.910+0000 7f6f9a200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f940b0350 con 0x7f6f94155a20 2024-08-17T02:26:02.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.910+0000 7f6f9a200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9406e5e0 con 0x7f6f94155df0 2024-08-17T02:26:02.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.911+0000 7f6f93e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f9406d7f0 0x7f6f940ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59362/0 (socket says 172.21.15.45:59362) 2024-08-17T02:26:02.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.911+0000 7f6f93e00640 1 -- 172.21.15.45:0/2472181029 learned_addr learned my addr 172.21.15.45:0/2472181029 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:02.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.911+0000 7f6f92a00640 1 --2- 172.21.15.45:0/2472181029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f94155df0 0x7f6f940ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.911+0000 7f6f93400640 1 --2- 172.21.15.45:0/2472181029 >> v2:172.21.15.169:3300/0 conn(0x7f6f94155a20 0x7f6f940adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.911+0000 7f6f92000640 1 -- 172.21.15.45:0/2472181029 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 945568862 0 0) 0x7f6f94156670 con 0x7f6f9406d7f0 2024-08-17T02:26:02.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.911+0000 7f6f92000640 1 -- 172.21.15.45:0/2472181029 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f780034e0 con 0x7f6f9406d7f0 2024-08-17T02:26:02.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.911+0000 7f6f93400640 1 -- 172.21.15.45:0/2472181029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f94155df0 msgr2=0x7f6f940ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:02.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.911+0000 7f6f93400640 1 --2- 172.21.15.45:0/2472181029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f94155df0 0x7f6f940ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.911+0000 7f6f93400640 1 -- 172.21.15.45:0/2472181029 >> v1:172.21.15.45:6789/0 conn(0x7f6f9406d7f0 legacy=0x7f6f940ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.911+0000 7f6f93400640 1 -- 172.21.15.45:0/2472181029 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9406e8c0 con 0x7f6f94155a20 2024-08-17T02:26:02.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.911+0000 7f6f92a00640 1 --2- 172.21.15.45:0/2472181029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f94155df0 0x7f6f940ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:02.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.913+0000 7f6f93400640 1 --2- 172.21.15.45:0/2472181029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f94155a20 0x7f6f940adf10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009850 tx=0x7f6f840090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=181c512575b7066 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.913+0000 7f6f92000640 1 -- 172.21.15.45:0/2472181029 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8402ad80 con 0x7f6f94155a20 2024-08-17T02:26:02.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.913+0000 7f6f92000640 1 -- 172.21.15.45:0/2472181029 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f84032440 con 0x7f6f94155a20 2024-08-17T02:26:02.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.913+0000 7f6f92000640 1 -- 172.21.15.45:0/2472181029 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84032820 con 0x7f6f94155a20 2024-08-17T02:26:02.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.913+0000 7f6f9a200640 1 -- 172.21.15.45:0/2472181029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f94155a20 msgr2=0x7f6f940adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.913+0000 7f6f9a200640 1 --2- 172.21.15.45:0/2472181029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f94155a20 0x7f6f940adf10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f84009850 tx=0x7f6f840090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.913+0000 7f6f9a200640 1 -- 172.21.15.45:0/2472181029 shutdown_connections 2024-08-17T02:26:02.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.913+0000 7f6f9a200640 1 --2- 172.21.15.45:0/2472181029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f94155df0 0x7f6f940ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.913+0000 7f6f9a200640 1 --2- 172.21.15.45:0/2472181029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f94155a20 0x7f6f940adf10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.913+0000 7f6f9a200640 1 -- 172.21.15.45:0/2472181029 >> 172.21.15.45:0/2472181029 conn(0x7f6f940cb9b0 msgr2=0x7f6f940cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:02.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.914+0000 7f6f9a200640 1 -- 172.21.15.45:0/2472181029 shutdown_connections 2024-08-17T02:26:02.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.914+0000 7f6f9a200640 1 -- 172.21.15.45:0/2472181029 wait complete. 2024-08-17T02:26:02.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.915+0000 7f6f9a200640 1 Processor -- start 2024-08-17T02:26:02.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.915+0000 7f6f9a200640 1 -- start start 2024-08-17T02:26:02.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.916+0000 7f6f9a200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f9406d7f0 0x7f6f94138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.916+0000 7f6f9a200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f94155a20 0x7f6f9416a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.916+0000 7f6f9a200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94155df0 0x7f6f9416ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.916+0000 7f6f9a200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9413a530 con 0x7f6f94155df0 2024-08-17T02:26:02.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.916+0000 7f6f9a200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9413a810 con 0x7f6f9406d7f0 2024-08-17T02:26:02.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.916+0000 7f6f9a200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9413aaf0 con 0x7f6f94155a20 2024-08-17T02:26:02.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.916+0000 7f6f93e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94155df0 0x7f6f9416ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.916+0000 7f6f93e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94155df0 0x7f6f9416ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42716/0 (socket says 172.21.15.45:42716) 2024-08-17T02:26:02.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.916+0000 7f6f93e00640 1 -- 172.21.15.45:0/3549267617 learned_addr learned my addr 172.21.15.45:0/3549267617 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:02.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f92a00640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f94155a20 0x7f6f9416a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f93400640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f9406d7f0 0x7f6f94138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f93e00640 1 -- 172.21.15.45:0/3549267617 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f94155a20 msgr2=0x7f6f9416a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f93e00640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f94155a20 0x7f6f9416a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f93e00640 1 -- 172.21.15.45:0/3549267617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f9406d7f0 msgr2=0x7f6f94138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:02.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f93e00640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f9406d7f0 0x7f6f94138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:02.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f93e00640 1 -- 172.21.15.45:0/3549267617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f80009390 con 0x7f6f94155df0 2024-08-17T02:26:02.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f93e00640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94155df0 0x7f6f9416ab40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c001460 tx=0x7f6f8c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f8aa00640 1 -- 172.21.15.45:0/3549267617 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c00ce90 con 0x7f6f94155df0 2024-08-17T02:26:02.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f8aa00640 1 -- 172.21.15.45:0/3549267617 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c00a850 con 0x7f6f94155df0 2024-08-17T02:26:02.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f8aa00640 1 -- 172.21.15.45:0/3549267617 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c00ac50 con 0x7f6f94155df0 2024-08-17T02:26:02.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.917+0000 7f6f9a200640 1 -- 172.21.15.45:0/3549267617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f84009390 con 0x7f6f94155df0 2024-08-17T02:26:02.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.918+0000 7f6f9a200640 1 -- 172.21.15.45:0/3549267617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f9413b0b0 con 0x7f6f94155df0 2024-08-17T02:26:02.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.918+0000 7f6f9a200640 1 -- 172.21.15.45:0/3549267617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9413b2d0 con 0x7f6f94155df0 2024-08-17T02:26:02.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.919+0000 7f6f8aa00640 1 -- 172.21.15.45:0/3549267617 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6f8c007300 con 0x7f6f94155df0 2024-08-17T02:26:02.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.920+0000 7f6f8aa00640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f74065150 0x7f6f74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:02.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.920+0000 7f6f8aa00640 1 -- 172.21.15.45:0/3549267617 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6f8c082250 con 0x7f6f94155df0 2024-08-17T02:26:02.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.920+0000 7f6f93400640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f74065150 0x7f6f74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:02.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.921+0000 7f6f93400640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f74065150 0x7f6f74067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f84034000 tx=0x7f6f84032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:02.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:02.924+0000 7f6f8aa00640 1 -- 172.21.15.45:0/3549267617 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6f8c050720 con 0x7f6f94155df0 2024-08-17T02:26:03.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.171+0000 7f6f9a200640 1 -- 172.21.15.45:0/3549267617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f6f94064db0 con 0x7f6f94155df0 2024-08-17T02:26:03.175 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.174+0000 7f6f8aa00640 1 -- 172.21.15.45:0/3549267617 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6f8c053d40 con 0x7f6f94155df0 2024-08-17T02:26:03.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.176+0000 7f6f9a200640 1 -- 172.21.15.45:0/3549267617 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f74065150 msgr2=0x7f6f74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.176+0000 7f6f9a200640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f74065150 0x7f6f74067600 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6f84034000 tx=0x7f6f84032000 comp rx=0 tx=0).stop 2024-08-17T02:26:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.176+0000 7f6f9a200640 1 -- 172.21.15.45:0/3549267617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94155df0 msgr2=0x7f6f9416ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.176+0000 7f6f9a200640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94155df0 0x7f6f9416ab40 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c001460 tx=0x7f6f8c001ae0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.177+0000 7f6f9a200640 1 -- 172.21.15.45:0/3549267617 shutdown_connections 2024-08-17T02:26:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.177+0000 7f6f9a200640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94155df0 0x7f6f9416ab40 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.177+0000 7f6f9a200640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6f74065150 0x7f6f74067600 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.177+0000 7f6f9a200640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6f94155a20 0x7f6f9416a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.177+0000 7f6f9a200640 1 --2- 172.21.15.45:0/3549267617 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6f9406d7f0 0x7f6f94138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.177+0000 7f6f9a200640 1 -- 172.21.15.45:0/3549267617 >> 172.21.15.45:0/3549267617 conn(0x7f6f940cb9b0 msgr2=0x7f6f9406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.177+0000 7f6f9a200640 1 -- 172.21.15.45:0/3549267617 shutdown_connections 2024-08-17T02:26:03.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.177+0000 7f6f9a200640 1 -- 172.21.15.45:0/3549267617 wait complete. 2024-08-17T02:26:03.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:03.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.344+0000 7fcdbfe00640 1 Processor -- start 2024-08-17T02:26:03.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.344+0000 7fcdbfe00640 1 -- start start 2024-08-17T02:26:03.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.345+0000 7fcdbfe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc0069710 0x7fcdc00ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.345+0000 7fcdbfe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fcdc00ac540 0x7fcdc00af0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.345+0000 7fcdbfe00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc00aec20 con 0x7fcdc0158bd0 2024-08-17T02:26:03.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.345+0000 7fcdbfe00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc00ae330 con 0x7fcdc00ac540 2024-08-17T02:26:03.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.345+0000 7fcdbfe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc00acd30 con 0x7fcdc0069710 2024-08-17T02:26:03.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.345+0000 7fcdbea00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcdc0158bd0 0x7fcdc0069000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59372/0 (socket says 172.21.15.45:59372) 2024-08-17T02:26:03.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.345+0000 7fcdbea00640 1 -- 172.21.15.45:0/1189247280 learned_addr learned my addr 172.21.15.45:0/1189247280 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:03.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.346+0000 7fcdbf400640 1 --2- 172.21.15.45:0/1189247280 >> v2:172.21.15.169:3300/0 conn(0x7fcdc00ac540 0x7fcdc00af0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.346+0000 7fcdbe000640 1 --2- 172.21.15.45:0/1189247280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc0069710 0x7fcdc00ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.346+0000 7fcdbd600640 1 -- 172.21.15.45:0/1189247280 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723256724 0 0) 0x7fcdc00aec20 con 0x7fcdc0158bd0 2024-08-17T02:26:03.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.346+0000 7fcdbd600640 1 -- 172.21.15.45:0/1189247280 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcda40034e0 con 0x7fcdc0158bd0 2024-08-17T02:26:03.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.346+0000 7fcdbf400640 1 -- 172.21.15.45:0/1189247280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc0069710 msgr2=0x7fcdc00ac000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:03.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.346+0000 7fcdbf400640 1 --2- 172.21.15.45:0/1189247280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc0069710 0x7fcdc00ac000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.346+0000 7fcdbf400640 1 -- 172.21.15.45:0/1189247280 >> v1:172.21.15.45:6789/0 conn(0x7fcdc0158bd0 legacy=0x7fcdc0069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.346+0000 7fcdbd600640 1 -- 172.21.15.45:0/1189247280 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 550041989 0 0) 0x7fcda40034e0 con 0x7fcdc0158bd0 2024-08-17T02:26:03.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.346+0000 7fcdbf400640 1 -- 172.21.15.45:0/1189247280 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc00ae5d0 con 0x7fcdc00ac540 2024-08-17T02:26:03.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.347+0000 7fcdbf400640 1 --2- 172.21.15.45:0/1189247280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc00ac540 0x7fcdc00af0b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009e60 tx=0x7fcdb8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2af543dbecd8cef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.348+0000 7fcdbd600640 1 -- 172.21.15.45:0/1189247280 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0001470 con 0x7fcdc00ac540 2024-08-17T02:26:03.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.348+0000 7fcdbd600640 1 -- 172.21.15.45:0/1189247280 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb802d050 con 0x7fcdc00ac540 2024-08-17T02:26:03.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.348+0000 7fcdbd600640 1 -- 172.21.15.45:0/1189247280 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8031630 con 0x7fcdc00ac540 2024-08-17T02:26:03.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.348+0000 7fcdbfe00640 1 -- 172.21.15.45:0/1189247280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc00ac540 msgr2=0x7fcdc00af0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.348+0000 7fcdbfe00640 1 --2- 172.21.15.45:0/1189247280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc00ac540 0x7fcdc00af0b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8009e60 tx=0x7fcdb8009780 comp rx=0 tx=0).stop 2024-08-17T02:26:03.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.348+0000 7fcdbfe00640 1 -- 172.21.15.45:0/1189247280 shutdown_connections 2024-08-17T02:26:03.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.348+0000 7fcdbfe00640 1 --2- 172.21.15.45:0/1189247280 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc00ac540 0x7fcdc00af0b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.348+0000 7fcdbfe00640 1 --2- 172.21.15.45:0/1189247280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc0069710 0x7fcdc00ac000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.348+0000 7fcdbfe00640 1 -- 172.21.15.45:0/1189247280 >> 172.21.15.45:0/1189247280 conn(0x7fcdc0096a70 msgr2=0x7fcdc00cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:03.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.348+0000 7fcdbfe00640 1 -- 172.21.15.45:0/1189247280 shutdown_connections 2024-08-17T02:26:03.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.348+0000 7fcdbfe00640 1 -- 172.21.15.45:0/1189247280 wait complete. 2024-08-17T02:26:03.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.350+0000 7fcdbfe00640 1 Processor -- start 2024-08-17T02:26:03.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.350+0000 7fcdbfe00640 1 -- start start 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbfe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc0069710 0x7fcdc015cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbfe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdc00ac540 0x7fcdc0155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbfe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc0158bd0 0x7fcdc0155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbfe00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc015d150 con 0x7fcdc00ac540 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbfe00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0155fb0 con 0x7fcdc0069710 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbfe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc015df90 con 0x7fcdc0158bd0 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbe000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdc00ac540 0x7fcdc0155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbe000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdc00ac540 0x7fcdc0155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42722/0 (socket says 172.21.15.45:42722) 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbe000640 1 -- 172.21.15.45:0/3570741861 learned_addr learned my addr 172.21.15.45:0/3570741861 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbea00640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc0069710 0x7fcdc015cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbf400640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc0158bd0 0x7fcdc0155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbe000640 1 -- 172.21.15.45:0/3570741861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc0158bd0 msgr2=0x7fcdc0155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbe000640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc0158bd0 0x7fcdc0155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbe000640 1 -- 172.21.15.45:0/3570741861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc0069710 msgr2=0x7fcdc015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.351+0000 7fcdbe000640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc0069710 0x7fcdc015cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.352+0000 7fcdbe000640 1 -- 172.21.15.45:0/3570741861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb8009a20 con 0x7fcdc00ac540 2024-08-17T02:26:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.352+0000 7fcdbe000640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdc00ac540 0x7fcdc0155530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009fd0 tx=0x7fcdac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.352+0000 7fcdb6000640 1 -- 172.21.15.45:0/3570741861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac00c940 con 0x7fcdc00ac540 2024-08-17T02:26:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.352+0000 7fcdb6000640 1 -- 172.21.15.45:0/3570741861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdac00caa0 con 0x7fcdc00ac540 2024-08-17T02:26:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.352+0000 7fcdb6000640 1 -- 172.21.15.45:0/3570741861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdac00ce40 con 0x7fcdc00ac540 2024-08-17T02:26:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.352+0000 7fcdbfe00640 1 -- 172.21.15.45:0/3570741861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc015d380 con 0x7fcdc00ac540 2024-08-17T02:26:03.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.352+0000 7fcdbfe00640 1 -- 172.21.15.45:0/3570741861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc015dc20 con 0x7fcdc00ac540 2024-08-17T02:26:03.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.353+0000 7fcdbfe00640 1 -- 172.21.15.45:0/3570741861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc0071050 con 0x7fcdc00ac540 2024-08-17T02:26:03.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.354+0000 7fcdb6000640 1 -- 172.21.15.45:0/3570741861 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fcdac013680 con 0x7fcdc00ac540 2024-08-17T02:26:03.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.355+0000 7fcdb6000640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcda0065180 0x7fcda0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.355+0000 7fcdb6000640 1 -- 172.21.15.45:0/3570741861 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcdac0823f0 con 0x7fcdc00ac540 2024-08-17T02:26:03.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.355+0000 7fcdbea00640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcda0065180 0x7fcda0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.356 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.356+0000 7fcdbea00640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcda0065180 0x7fcda0067630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00011e0 tx=0x7fcdb0001560 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.359 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.359+0000 7fcdb6000640 1 -- 172.21.15.45:0/3570741861 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fcdac050760 con 0x7fcdc00ac540 2024-08-17T02:26:03.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.540+0000 7fcdbfe00640 1 -- 172.21.15.45:0/3570741861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdc015e0d0 con 0x7fcdc00ac540 2024-08-17T02:26:03.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.541+0000 7fcdb6000640 1 -- 172.21.15.45:0/3570741861 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12134 (secure 0 0 0) 0x7fcdac053d80 con 0x7fcdc00ac540 2024-08-17T02:26:03.541 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:03.542 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:26:00.098815+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.542+0000 7fcdbfe00640 1 -- 172.21.15.45:0/3570741861 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcda0065180 msgr2=0x7fcda0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.542+0000 7fcdbfe00640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcda0065180 0x7fcda0067630 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00011e0 tx=0x7fcdb0001560 comp rx=0 tx=0).stop 2024-08-17T02:26:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.542+0000 7fcdbfe00640 1 -- 172.21.15.45:0/3570741861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdc00ac540 msgr2=0x7fcdc0155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.542+0000 7fcdbfe00640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdc00ac540 0x7fcdc0155530 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fcdac009fd0 tx=0x7fcdac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.543+0000 7fcdbfe00640 1 -- 172.21.15.45:0/3570741861 shutdown_connections 2024-08-17T02:26:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.543+0000 7fcdbfe00640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fcda0065180 0x7fcda0067630 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.543+0000 7fcdbfe00640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcdc0158bd0 0x7fcdc0155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.543+0000 7fcdbfe00640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdc00ac540 0x7fcdc0155530 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.543+0000 7fcdbfe00640 1 --2- 172.21.15.45:0/3570741861 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcdc0069710 0x7fcdc015cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.543+0000 7fcdbfe00640 1 -- 172.21.15.45:0/3570741861 >> 172.21.15.45:0/3570741861 conn(0x7fcdc0096a70 msgr2=0x7fcdc00aa5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.543+0000 7fcdbfe00640 1 -- 172.21.15.45:0/3570741861 shutdown_connections 2024-08-17T02:26:03.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.543+0000 7fcdbfe00640 1 -- 172.21.15.45:0/3570741861 wait complete. 2024-08-17T02:26:03.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-08-17T02:26:03.559 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:26:03.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.713+0000 7f0ea7c00640 1 Processor -- start 2024-08-17T02:26:03.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.713+0000 7f0ea7c00640 1 -- start start 2024-08-17T02:26:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.714+0000 7f0ea7c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ea00afd90 0x7f0ea00b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.714+0000 7f0ea7c00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0ea0159610 0x7f0ea0157690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.714+0000 7f0ea7c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ea00ae540 con 0x7f0ea00accf0 2024-08-17T02:26:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.714+0000 7f0ea7c00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea00ad930 con 0x7f0ea00afd90 2024-08-17T02:26:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.714+0000 7f0ea7c00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ea00adc10 con 0x7f0ea0159610 2024-08-17T02:26:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.714+0000 7f0e9fe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0ea00afd90 0x7f0ea00b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.714+0000 7f0ea5200640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0ea00accf0 0x7f0ea00af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59374/0 (socket says 172.21.15.45:59374) 2024-08-17T02:26:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.714+0000 7f0ea5200640 1 -- 172.21.15.45:0/3348285847 learned_addr learned my addr 172.21.15.45:0/3348285847 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:03.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.715+0000 7f0ea5c00640 1 --2- 172.21.15.45:0/3348285847 >> v2:172.21.15.169:3300/0 conn(0x7f0ea0159610 0x7f0ea0157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.715+0000 7f0e9f400640 1 -- 172.21.15.45:0/3348285847 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3312293474 0 0) 0x7f0ea00ae540 con 0x7f0ea00accf0 2024-08-17T02:26:03.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.715+0000 7f0e9fe00640 1 -- 172.21.15.45:0/3348285847 >> v2:172.21.15.169:3300/0 conn(0x7f0ea0159610 msgr2=0x7f0ea0157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:03.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.715+0000 7f0e9fe00640 1 --2- 172.21.15.45:0/3348285847 >> v2:172.21.15.169:3300/0 conn(0x7f0ea0159610 0x7f0ea0157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.715+0000 7f0e9fe00640 1 -- 172.21.15.45:0/3348285847 >> v1:172.21.15.45:6789/0 conn(0x7f0ea00accf0 legacy=0x7f0ea00af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.715+0000 7f0e9fe00640 1 -- 172.21.15.45:0/3348285847 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea00adef0 con 0x7f0ea00afd90 2024-08-17T02:26:03.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.715+0000 7f0ea5c00640 1 --2- 172.21.15.45:0/3348285847 >> v2:172.21.15.169:3300/0 conn(0x7f0ea0159610 0x7f0ea0157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.716+0000 7f0e9fe00640 1 --2- 172.21.15.45:0/3348285847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea00afd90 0x7f0ea00b1670 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0157040 tx=0x7f0e8c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c7a2a135ee0c83 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.716+0000 7f0e9f400640 1 -- 172.21.15.45:0/3348285847 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c02adb0 con 0x7f0ea00afd90 2024-08-17T02:26:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.716+0000 7f0e9f400640 1 -- 172.21.15.45:0/3348285847 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8c032440 con 0x7f0ea00afd90 2024-08-17T02:26:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.716+0000 7f0e9f400640 1 -- 172.21.15.45:0/3348285847 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0327e0 con 0x7f0ea00afd90 2024-08-17T02:26:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.717+0000 7f0ea7c00640 1 -- 172.21.15.45:0/3348285847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea00afd90 msgr2=0x7f0ea00b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.717+0000 7f0ea7c00640 1 --2- 172.21.15.45:0/3348285847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea00afd90 0x7f0ea00b1670 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0157040 tx=0x7f0e8c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.717+0000 7f0ea7c00640 1 -- 172.21.15.45:0/3348285847 shutdown_connections 2024-08-17T02:26:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.717+0000 7f0ea7c00640 1 --2- 172.21.15.45:0/3348285847 >> v2:172.21.15.169:3300/0 conn(0x7f0ea0159610 0x7f0ea0157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.717+0000 7f0ea7c00640 1 --2- 172.21.15.45:0/3348285847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea00afd90 0x7f0ea00b1670 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.717+0000 7f0ea7c00640 1 -- 172.21.15.45:0/3348285847 >> 172.21.15.45:0/3348285847 conn(0x7f0ea0067750 msgr2=0x7f0ea00cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:03.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.717+0000 7f0ea7c00640 1 -- 172.21.15.45:0/3348285847 shutdown_connections 2024-08-17T02:26:03.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.717+0000 7f0ea7c00640 1 -- 172.21.15.45:0/3348285847 wait complete. 2024-08-17T02:26:03.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.718+0000 7f0ea7c00640 1 Processor -- start 2024-08-17T02:26:03.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.718+0000 7f0ea7c00640 1 -- start start 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.719+0000 7f0ea7c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea00accf0 0x7f0ea013ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.719+0000 7f0ea7c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ea00afd90 0x7f0ea015c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.719+0000 7f0ea7c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ea0159610 0x7f0ea01539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.719+0000 7f0ea7c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea015dc50 con 0x7f0ea00accf0 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.719+0000 7f0ea7c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea015d040 con 0x7f0ea00afd90 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.719+0000 7f0ea7c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea015d320 con 0x7f0ea0159610 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.719+0000 7f0ea5200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea00accf0 0x7f0ea013ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.719+0000 7f0ea5200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea00accf0 0x7f0ea013ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42746/0 (socket says 172.21.15.45:42746) 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.719+0000 7f0ea5200640 1 -- 172.21.15.45:0/1385191847 learned_addr learned my addr 172.21.15.45:0/1385191847 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0ea5200640 1 -- 172.21.15.45:0/1385191847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ea0159610 msgr2=0x7f0ea01539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0ea5200640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ea0159610 0x7f0ea01539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0ea5200640 1 -- 172.21.15.45:0/1385191847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ea00afd90 msgr2=0x7f0ea015c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0e9fe00640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ea00afd90 0x7f0ea015c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0ea5200640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ea00afd90 0x7f0ea015c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0ea5200640 1 -- 172.21.15.45:0/1385191847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c009390 con 0x7f0ea00accf0 2024-08-17T02:26:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0e9fe00640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ea00afd90 0x7f0ea015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0ea5200640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea00accf0 0x7f0ea013ef40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400c510 tx=0x7f0e9400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0e93e00640 1 -- 172.21.15.45:0/1385191847 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e94005aa0 con 0x7f0ea00accf0 2024-08-17T02:26:03.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0e93e00640 1 -- 172.21.15.45:0/1385191847 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e94005c00 con 0x7f0ea00accf0 2024-08-17T02:26:03.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0e93e00640 1 -- 172.21.15.45:0/1385191847 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e940070d0 con 0x7f0ea00accf0 2024-08-17T02:26:03.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.720+0000 7f0ea7c00640 1 -- 172.21.15.45:0/1385191847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea015d600 con 0x7f0ea00accf0 2024-08-17T02:26:03.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.721+0000 7f0ea7c00640 1 -- 172.21.15.45:0/1385191847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea015e790 con 0x7f0ea00accf0 2024-08-17T02:26:03.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.722+0000 7f0ea7c00640 1 -- 172.21.15.45:0/1385191847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ea0064db0 con 0x7f0ea00accf0 2024-08-17T02:26:03.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.722+0000 7f0e93e00640 1 -- 172.21.15.45:0/1385191847 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0e94007500 con 0x7f0ea00accf0 2024-08-17T02:26:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.723+0000 7f0e93e00640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0e80065150 0x7f0e80067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.723+0000 7f0e93e00640 1 -- 172.21.15.45:0/1385191847 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0e94081740 con 0x7f0ea00accf0 2024-08-17T02:26:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.723+0000 7f0e9fe00640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0e80065150 0x7f0e80067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.724+0000 7f0e9fe00640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0e80065150 0x7f0e80067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c034000 tx=0x7f0e8c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:03.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.727+0000 7f0e93e00640 1 -- 172.21.15.45:0/1385191847 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0e9404fab0 con 0x7f0ea00accf0 2024-08-17T02:26:03.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.908+0000 7f0ea7c00640 1 -- 172.21.15.45:0/1385191847 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ea0063da0 con 0x7f0ea00accf0 2024-08-17T02:26:03.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.909+0000 7f0e93e00640 1 -- 172.21.15.45:0/1385191847 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e94017020 con 0x7f0ea00accf0 2024-08-17T02:26:03.910 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:26:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 -- 172.21.15.45:0/1385191847 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0e80065150 msgr2=0x7f0e80067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0e80065150 0x7f0e80067600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c034000 tx=0x7f0e8c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 -- 172.21.15.45:0/1385191847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea00accf0 msgr2=0x7f0ea013ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea00accf0 0x7f0ea013ef40 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0e9400c510 tx=0x7f0e9400c910 comp rx=0 tx=0).stop 2024-08-17T02:26:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 -- 172.21.15.45:0/1385191847 shutdown_connections 2024-08-17T02:26:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0e80065150 0x7f0e80067600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0ea0159610 0x7f0ea01539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0ea00afd90 0x7f0ea015c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 --2- 172.21.15.45:0/1385191847 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0ea00accf0 0x7f0ea013ef40 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:03.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 -- 172.21.15.45:0/1385191847 >> 172.21.15.45:0/1385191847 conn(0x7f0ea0067750 msgr2=0x7f0ea00af660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:03.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 -- 172.21.15.45:0/1385191847 shutdown_connections 2024-08-17T02:26:03.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:03.911+0000 7f0ea7c00640 1 -- 172.21.15.45:0/1385191847 wait complete. 2024-08-17T02:26:03.927 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-08-17T02:26:04.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.077+0000 7fac66200640 1 Processor -- start 2024-08-17T02:26:04.078 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.077+0000 7fac66200640 1 -- start start 2024-08-17T02:26:04.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.078+0000 7fac66200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac60159350 0x7fac600ad550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.078+0000 7fac66200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac600cb560 con 0x7fac60158f80 2024-08-17T02:26:04.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.079+0000 7fac66200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac600cf7e0 con 0x7fac600caa40 2024-08-17T02:26:04.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.079+0000 7fac66200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac600cfac0 con 0x7fac60159350 2024-08-17T02:26:04.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.079+0000 7fac5f400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fac60158f80 0x7fac600ca330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59390/0 (socket says 172.21.15.45:59390) 2024-08-17T02:26:04.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.079+0000 7fac5f400640 1 -- 172.21.15.45:0/669586115 learned_addr learned my addr 172.21.15.45:0/669586115 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:04.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.079+0000 7fac5fe00640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac60159350 0x7fac600ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.079+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105864397 0 0) 0x7fac600cb560 con 0x7fac60158f80 2024-08-17T02:26:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.079+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac440034e0 con 0x7fac60158f80 2024-08-17T02:26:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.079+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2162173082 0 0) 0x7fac440034e0 con 0x7fac60158f80 2024-08-17T02:26:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.079+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac60159350 msgr2=0x7fac600ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5ea00640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac60159350 0x7fac600ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 >> v1:172.21.15.169:6789/0 conn(0x7fac600caa40 legacy=0x7fac600ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac600caf10 con 0x7fac60158f80 2024-08-17T02:26:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7fac50001470 con 0x7fac60158f80 2024-08-17T02:26:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 >> v1:172.21.15.45:6789/0 conn(0x7fac60158f80 legacy=0x7fac600ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5ea00640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac44003a00 0x7fac44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5ea00640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac44004780 0x7fac44004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5ea00640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac60159350 0x7fac44005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac600cfac0 con 0x7fac44003a00 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac4400ba80 con 0x7fac44004780 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac4400bc40 con 0x7fac60159350 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5f400640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac44003a00 0x7fac44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5fe00640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac60159350 0x7fac44005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac56a00640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac44004780 0x7fac44004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5f400640 1 -- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac60159350 msgr2=0x7fac44005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5f400640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac60159350 0x7fac44005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5f400640 1 -- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac44004780 msgr2=0x7fac44004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5f400640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac44004780 0x7fac44004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5f400640 1 -- 172.21.15.45:0/669586115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440034e0 con 0x7fac44003a00 2024-08-17T02:26:04.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.080+0000 7fac5fe00640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac60159350 0x7fac44005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.081+0000 7fac5f400640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac44003a00 0x7fac44003dd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c2d0 tx=0x7fac50001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64afd38f144153e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.082+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50005890 con 0x7fac44003a00 2024-08-17T02:26:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.082+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac50005a10 con 0x7fac44003a00 2024-08-17T02:26:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.082+0000 7fac5ea00640 1 -- 172.21.15.45:0/669586115 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac50005dd0 con 0x7fac44003a00 2024-08-17T02:26:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.082+0000 7fac66200640 1 -- 172.21.15.45:0/669586115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac44003a00 msgr2=0x7fac44003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.082+0000 7fac66200640 1 --2- 172.21.15.45:0/669586115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac44003a00 0x7fac44003dd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fac5000c2d0 tx=0x7fac50001e70 comp rx=0 tx=0).stop 2024-08-17T02:26:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.082+0000 7fac5fe00640 1 -- 172.21.15.45:0/669586115 reap_dead start 2024-08-17T02:26:04.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.082+0000 7fac66200640 1 -- 172.21.15.45:0/669586115 shutdown_connections 2024-08-17T02:26:04.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.082+0000 7fac66200640 1 -- 172.21.15.45:0/669586115 >> 172.21.15.45:0/669586115 conn(0x7fac600cfd90 msgr2=0x7fac600d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.082+0000 7fac66200640 1 -- 172.21.15.45:0/669586115 shutdown_connections 2024-08-17T02:26:04.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.082+0000 7fac66200640 1 -- 172.21.15.45:0/669586115 wait complete. 2024-08-17T02:26:04.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.084+0000 7fac66200640 1 Processor -- start 2024-08-17T02:26:04.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.084+0000 7fac66200640 1 -- start start 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac66200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac44003a00 0x7fac600b4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac66200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac60155690 0x7fac6015b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac66200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac6015bde0 0x7fac600b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac66200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6015c250 con 0x7fac60155690 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac66200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac600b4710 con 0x7fac44003a00 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac66200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac600b3a70 con 0x7fac6015bde0 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac56a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac60155690 0x7fac6015b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac56a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac60155690 0x7fac6015b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42762/0 (socket says 172.21.15.45:42762) 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac56a00640 1 -- 172.21.15.45:0/2875537266 learned_addr learned my addr 172.21.15.45:0/2875537266 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac5f400640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac44003a00 0x7fac600b4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac56a00640 1 -- 172.21.15.45:0/2875537266 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac6015bde0 msgr2=0x7fac600b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.088 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac56a00640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac6015bde0 0x7fac600b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac56a00640 1 -- 172.21.15.45:0/2875537266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac44003a00 msgr2=0x7fac600b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac56a00640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac44003a00 0x7fac600b4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac56a00640 1 -- 172.21.15.45:0/2875537266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac600b3de0 con 0x7fac60155690 2024-08-17T02:26:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.085+0000 7fac5f400640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac44003a00 0x7fac600b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.086+0000 7fac56a00640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac60155690 0x7fac6015b8a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fac4800e860 tx=0x7fac48009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.086+0000 7fac57400640 1 -- 172.21.15.45:0/2875537266 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4800c660 con 0x7fac60155690 2024-08-17T02:26:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.086+0000 7fac57400640 1 -- 172.21.15.45:0/2875537266 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4800c7c0 con 0x7fac60155690 2024-08-17T02:26:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.086+0000 7fac57400640 1 -- 172.21.15.45:0/2875537266 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4800cb80 con 0x7fac60155690 2024-08-17T02:26:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.086+0000 7fac66200640 1 -- 172.21.15.45:0/2875537266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac600b40c0 con 0x7fac60155690 2024-08-17T02:26:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.086+0000 7fac66200640 1 -- 172.21.15.45:0/2875537266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac60155ae0 con 0x7fac60155690 2024-08-17T02:26:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.087+0000 7fac66200640 1 -- 172.21.15.45:0/2875537266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac600b4540 con 0x7fac60155690 2024-08-17T02:26:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.088+0000 7fac57400640 1 -- 172.21.15.45:0/2875537266 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fac48013420 con 0x7fac60155690 2024-08-17T02:26:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.089+0000 7fac57400640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac3c065180 0x7fac3c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.089+0000 7fac57400640 1 -- 172.21.15.45:0/2875537266 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fac480826d0 con 0x7fac60155690 2024-08-17T02:26:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.089+0000 7fac5f400640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac3c065180 0x7fac3c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.090+0000 7fac5f400640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac3c065180 0x7fac3c067630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fac50033000 tx=0x7fac50034000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.093+0000 7fac57400640 1 -- 172.21.15.45:0/2875537266 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fac48050b00 con 0x7fac60155690 2024-08-17T02:26:04.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.279+0000 7fac66200640 1 -- 172.21.15.45:0/2875537266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fac60064db0 con 0x7fac60155690 2024-08-17T02:26:04.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.280+0000 7fac57400640 1 -- 172.21.15.45:0/2875537266 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fac48017090 con 0x7fac60155690 2024-08-17T02:26:04.281 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:04.281 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2024-08-17T02:26:04.281 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:04.281 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2024-08-17T02:26:04.281 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2024-08-17T02:26:04.281 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:04.282 INFO:teuthology.orchestra.run.smithi045.stdout:] 2024-08-17T02:26:04.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.282+0000 7fac66200640 1 -- 172.21.15.45:0/2875537266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac3c065180 msgr2=0x7fac3c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.282+0000 7fac66200640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac3c065180 0x7fac3c067630 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fac50033000 tx=0x7fac50034000 comp rx=0 tx=0).stop 2024-08-17T02:26:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.282+0000 7fac66200640 1 -- 172.21.15.45:0/2875537266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac60155690 msgr2=0x7fac6015b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.282+0000 7fac66200640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac60155690 0x7fac6015b8a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fac4800e860 tx=0x7fac48009040 comp rx=0 tx=0).stop 2024-08-17T02:26:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.282+0000 7fac66200640 1 -- 172.21.15.45:0/2875537266 shutdown_connections 2024-08-17T02:26:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.282+0000 7fac66200640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fac3c065180 0x7fac3c067630 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.282+0000 7fac66200640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fac6015bde0 0x7fac600b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.282+0000 7fac66200640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac60155690 0x7fac6015b8a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.282+0000 7fac66200640 1 --2- 172.21.15.45:0/2875537266 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fac44003a00 0x7fac600b4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.282+0000 7fac66200640 1 -- 172.21.15.45:0/2875537266 >> 172.21.15.45:0/2875537266 conn(0x7fac600cfd90 msgr2=0x7fac600ce070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.283+0000 7fac66200640 1 -- 172.21.15.45:0/2875537266 shutdown_connections 2024-08-17T02:26:04.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.283+0000 7fac66200640 1 -- 172.21.15.45:0/2875537266 wait complete. 2024-08-17T02:26:04.299 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-17T02:26:04.299 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-17T02:26:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.454+0000 7f9125600640 1 Processor -- start 2024-08-17T02:26:04.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.454+0000 7f9125600640 1 -- start start 2024-08-17T02:26:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.455+0000 7f9125600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91200cedb0 0x7f91200cab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.455+0000 7f9125600640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91200c5530 con 0x7f91200ce960 2024-08-17T02:26:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.455+0000 7f9125600640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91200c5af0 con 0x7f91200b21d0 2024-08-17T02:26:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.455+0000 7f9125600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91200b3250 con 0x7f91200cedb0 2024-08-17T02:26:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.455+0000 7f9117e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f91200ce960 0x7f91200c5f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59400/0 (socket says 172.21.15.45:59400) 2024-08-17T02:26:04.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.456+0000 7f9117e00640 1 -- 172.21.15.45:0/1055576293 learned_addr learned my addr 172.21.15.45:0/1055576293 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:04.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.456+0000 7f911f400640 1 --2- 172.21.15.45:0/1055576293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91200cedb0 0x7f91200cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.456+0000 7f911e000640 1 -- 172.21.15.45:0/1055576293 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143382573 0 0) 0x7f91200c5530 con 0x7f91200ce960 2024-08-17T02:26:04.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.456+0000 7f911e000640 1 -- 172.21.15.45:0/1055576293 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91040034e0 con 0x7f91200ce960 2024-08-17T02:26:04.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.456+0000 7f911e000640 1 -- 172.21.15.45:0/1055576293 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117744711 0 0) 0x7f91200c5af0 con 0x7f91200b21d0 2024-08-17T02:26:04.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.456+0000 7f911e000640 1 -- 172.21.15.45:0/1055576293 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91200c5530 con 0x7f91200b21d0 2024-08-17T02:26:04.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.456+0000 7f911f400640 1 -- 172.21.15.45:0/1055576293 >> v1:172.21.15.169:6789/0 conn(0x7f91200b21d0 legacy=0x7f91200b2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.456+0000 7f911e000640 1 -- 172.21.15.45:0/1055576293 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 311487173 0 0) 0x7f91040034e0 con 0x7f91200ce960 2024-08-17T02:26:04.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.456+0000 7f911f400640 1 -- 172.21.15.45:0/1055576293 >> v1:172.21.15.45:6789/0 conn(0x7f91200ce960 legacy=0x7f91200c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.456+0000 7f911f400640 1 -- 172.21.15.45:0/1055576293 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91200cba80 con 0x7f91200cedb0 2024-08-17T02:26:04.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.457+0000 7f911f400640 1 --2- 172.21.15.45:0/1055576293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91200cedb0 0x7f91200cab60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9118009e90 tx=0x7f9118009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcfab47bead66ee1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.458+0000 7f911e000640 1 -- 172.21.15.45:0/1055576293 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9108001470 con 0x7f91200cedb0 2024-08-17T02:26:04.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.458+0000 7f911e000640 1 -- 172.21.15.45:0/1055576293 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911802d050 con 0x7f91200cedb0 2024-08-17T02:26:04.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.458+0000 7f911e000640 1 -- 172.21.15.45:0/1055576293 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118031630 con 0x7f91200cedb0 2024-08-17T02:26:04.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.458+0000 7f9125600640 1 -- 172.21.15.45:0/1055576293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91200cedb0 msgr2=0x7f91200cab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.458+0000 7f9125600640 1 --2- 172.21.15.45:0/1055576293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91200cedb0 0x7f91200cab60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9118009e90 tx=0x7f9118009780 comp rx=0 tx=0).stop 2024-08-17T02:26:04.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.458+0000 7f9125600640 1 -- 172.21.15.45:0/1055576293 shutdown_connections 2024-08-17T02:26:04.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.458+0000 7f9125600640 1 --2- 172.21.15.45:0/1055576293 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91200cedb0 0x7f91200cab60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.458+0000 7f9125600640 1 -- 172.21.15.45:0/1055576293 >> 172.21.15.45:0/1055576293 conn(0x7f912006eb90 msgr2=0x7f91200cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:04.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.458+0000 7f9125600640 1 -- 172.21.15.45:0/1055576293 shutdown_connections 2024-08-17T02:26:04.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.458+0000 7f9125600640 1 -- 172.21.15.45:0/1055576293 wait complete. 2024-08-17T02:26:04.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.460+0000 7f9125600640 1 Processor -- start 2024-08-17T02:26:04.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.460+0000 7f9125600640 1 -- start start 2024-08-17T02:26:04.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f9125600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91200b21d0 0x7f91200b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f9125600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91200ce960 0x7f9120149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f9125600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91200cedb0 0x7f91200b4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f9125600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9120149dc0 con 0x7f91200b21d0 2024-08-17T02:26:04.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f9125600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9120153570 con 0x7f91200ce960 2024-08-17T02:26:04.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f9125600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9120153b30 con 0x7f91200cedb0 2024-08-17T02:26:04.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f911ea00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91200b21d0 0x7f91200b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f911ea00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91200b21d0 0x7f91200b5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42776/0 (socket says 172.21.15.45:42776) 2024-08-17T02:26:04.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f911ea00640 1 -- 172.21.15.45:0/1373582004 learned_addr learned my addr 172.21.15.45:0/1373582004 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f911ea00640 1 -- 172.21.15.45:0/1373582004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91200cedb0 msgr2=0x7f91200b4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f911ea00640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91200cedb0 0x7f91200b4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f911ea00640 1 -- 172.21.15.45:0/1373582004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91200ce960 msgr2=0x7f9120149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f911ea00640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91200ce960 0x7f9120149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.461+0000 7f911ea00640 1 -- 172.21.15.45:0/1373582004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118009a20 con 0x7f91200b21d0 2024-08-17T02:26:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.462+0000 7f911ea00640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91200b21d0 0x7f91200b5740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f911000c590 tx=0x7f9110007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.462+0000 7f9116000640 1 -- 172.21.15.45:0/1373582004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110012630 con 0x7f91200b21d0 2024-08-17T02:26:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.462+0000 7f9116000640 1 -- 172.21.15.45:0/1373582004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91100127b0 con 0x7f91200b21d0 2024-08-17T02:26:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.462+0000 7f9125600640 1 -- 172.21.15.45:0/1373582004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91200c96f0 con 0x7f91200b21d0 2024-08-17T02:26:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.462+0000 7f9116000640 1 -- 172.21.15.45:0/1373582004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110012bb0 con 0x7f91200b21d0 2024-08-17T02:26:04.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.462+0000 7f9125600640 1 -- 172.21.15.45:0/1373582004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91200c9cb0 con 0x7f91200b21d0 2024-08-17T02:26:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.463+0000 7f9125600640 1 -- 172.21.15.45:0/1373582004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9120064db0 con 0x7f91200b21d0 2024-08-17T02:26:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.464+0000 7f9116000640 1 -- 172.21.15.45:0/1373582004 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f911001a3b0 con 0x7f91200b21d0 2024-08-17T02:26:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.465+0000 7f9116000640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f90fc065180 0x7f90fc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.465+0000 7f9116000640 1 -- 172.21.15.45:0/1373582004 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f91100820b0 con 0x7f91200b21d0 2024-08-17T02:26:04.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.465+0000 7f9117e00640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f90fc065180 0x7f90fc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:04.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.466+0000 7f9117e00640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f90fc065180 0x7f90fc067630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9108001380 tx=0x7f9108001000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:04.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.468+0000 7f9116000640 1 -- 172.21.15.45:0/1373582004 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f9110050420 con 0x7f91200b21d0 2024-08-17T02:26:04.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:04.650+0000 7f9125600640 1 -- 172.21.15.45:0/1373582004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f91200ce460 con 0x7f91200b21d0 2024-08-17T02:26:05.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.183+0000 7f9116000640 1 -- 172.21.15.45:0/1373582004 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f9110053a40 con 0x7f91200b21d0 2024-08-17T02:26:05.184 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2024-08-17T02:26:05.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.187+0000 7f9125600640 1 -- 172.21.15.45:0/1373582004 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f90fc065180 msgr2=0x7f90fc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.187+0000 7f9125600640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f90fc065180 0x7f90fc067630 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9108001380 tx=0x7f9108001000 comp rx=0 tx=0).stop 2024-08-17T02:26:05.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.187+0000 7f9125600640 1 -- 172.21.15.45:0/1373582004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91200b21d0 msgr2=0x7f91200b5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.187+0000 7f9125600640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91200b21d0 0x7f91200b5740 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f911000c590 tx=0x7f9110007d80 comp rx=0 tx=0).stop 2024-08-17T02:26:05.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.188+0000 7f9125600640 1 -- 172.21.15.45:0/1373582004 shutdown_connections 2024-08-17T02:26:05.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.188+0000 7f9125600640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f90fc065180 0x7f90fc067630 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.188+0000 7f9125600640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f91200cedb0 0x7f91200b4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.188+0000 7f9125600640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f91200ce960 0x7f9120149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.188+0000 7f9125600640 1 --2- 172.21.15.45:0/1373582004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91200b21d0 0x7f91200b5740 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.188+0000 7f9125600640 1 -- 172.21.15.45:0/1373582004 >> 172.21.15.45:0/1373582004 conn(0x7f912006eb90 msgr2=0x7f9120067ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.189+0000 7f9125600640 1 -- 172.21.15.45:0/1373582004 shutdown_connections 2024-08-17T02:26:05.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.189+0000 7f9125600640 1 -- 172.21.15.45:0/1373582004 wait complete. 2024-08-17T02:26:05.207 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-08-17T02:26:05.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.364+0000 7f0439400640 1 Processor -- start 2024-08-17T02:26:05.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.364+0000 7f0439400640 1 -- start start 2024-08-17T02:26:05.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.365+0000 7f0439400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0434156890 0x7f043406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.365+0000 7f0439400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04340c8840 0x7f043406e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.365+0000 7f0439400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04340ae9b0 con 0x7f0434156c60 2024-08-17T02:26:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.365+0000 7f0439400640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04340aa730 con 0x7f04340c8840 2024-08-17T02:26:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.365+0000 7f0439400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04340aa9f0 con 0x7f0434156890 2024-08-17T02:26:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.365+0000 7f0433200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04340c8840 0x7f043406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.366+0000 7f0433200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04340c8840 0x7f043406e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42788/0 (socket says 172.21.15.45:42788) 2024-08-17T02:26:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.366+0000 7f0433200640 1 -- 172.21.15.45:0/2184759314 learned_addr learned my addr 172.21.15.45:0/2184759314 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:05.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.366+0000 7f0432800640 1 --2- 172.21.15.45:0/2184759314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0434156890 0x7f043406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.366+0000 7f0433200640 1 -- 172.21.15.45:0/2184759314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0434156890 msgr2=0x7f043406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.366+0000 7f0433200640 1 --2- 172.21.15.45:0/2184759314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0434156890 0x7f043406dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.366+0000 7f0433200640 1 -- 172.21.15.45:0/2184759314 >> v1:172.21.15.169:6789/0 conn(0x7f0434156c60 legacy=0x7f04340c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.366+0000 7f0433200640 1 -- 172.21.15.45:0/2184759314 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04340ab320 con 0x7f04340c8840 2024-08-17T02:26:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.367+0000 7f0433200640 1 --2- 172.21.15.45:0/2184759314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04340c8840 0x7f043406e420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f042c009f20 tx=0x7f042c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd75ac751b471c0f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.367+0000 7f0431400640 1 -- 172.21.15.45:0/2184759314 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c031400 con 0x7f04340c8840 2024-08-17T02:26:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.367+0000 7f0431400640 1 -- 172.21.15.45:0/2184759314 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c02d050 con 0x7f04340c8840 2024-08-17T02:26:05.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.367+0000 7f0431400640 1 -- 172.21.15.45:0/2184759314 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c0317d0 con 0x7f04340c8840 2024-08-17T02:26:05.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.368+0000 7f0439400640 1 -- 172.21.15.45:0/2184759314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04340c8840 msgr2=0x7f043406e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.368+0000 7f0439400640 1 --2- 172.21.15.45:0/2184759314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04340c8840 0x7f043406e420 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f042c009f20 tx=0x7f042c009840 comp rx=0 tx=0).stop 2024-08-17T02:26:05.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.368+0000 7f0439400640 1 -- 172.21.15.45:0/2184759314 shutdown_connections 2024-08-17T02:26:05.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.368+0000 7f0439400640 1 --2- 172.21.15.45:0/2184759314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04340c8840 0x7f043406e420 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.368+0000 7f0439400640 1 --2- 172.21.15.45:0/2184759314 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0434156890 0x7f043406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.368+0000 7f0439400640 1 -- 172.21.15.45:0/2184759314 >> 172.21.15.45:0/2184759314 conn(0x7f0434067750 msgr2=0x7f043406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:05.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.368+0000 7f0439400640 1 -- 172.21.15.45:0/2184759314 shutdown_connections 2024-08-17T02:26:05.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.368+0000 7f0439400640 1 -- 172.21.15.45:0/2184759314 wait complete. 2024-08-17T02:26:05.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.369+0000 7f0439400640 1 Processor -- start 2024-08-17T02:26:05.370 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.370+0000 7f0439400640 1 -- start start 2024-08-17T02:26:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0439400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04340c8840 0x7f04341454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0439400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0434156890 0x7f04340abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0439400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0434156c60 0x7f04340ac3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0439400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043415e4d0 con 0x7f0434156890 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0439400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043415d8c0 con 0x7f0434156c60 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0439400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043415dba0 con 0x7f04340c8840 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0431e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0434156890 0x7f04340abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0431e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0434156890 0x7f04340abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42792/0 (socket says 172.21.15.45:42792) 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0431e00640 1 -- 172.21.15.45:0/1851902118 learned_addr learned my addr 172.21.15.45:0/1851902118 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0433200640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0434156c60 0x7f04340ac3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0432800640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04340c8840 0x7f04341454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0431e00640 1 -- 172.21.15.45:0/1851902118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04340c8840 msgr2=0x7f04341454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0431e00640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04340c8840 0x7f04341454c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0431e00640 1 -- 172.21.15.45:0/1851902118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0434156c60 msgr2=0x7f04340ac3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0431e00640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0434156c60 0x7f04340ac3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0431e00640 1 -- 172.21.15.45:0/1851902118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c009ae0 con 0x7f0434156890 2024-08-17T02:26:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.371+0000 7f0432800640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04340c8840 0x7f04341454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.372+0000 7f0431e00640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0434156890 0x7f04340abeb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f042000c4c0 tx=0x7f0420007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.372+0000 7f042a000640 1 -- 172.21.15.45:0/1851902118 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420011590 con 0x7f0434156890 2024-08-17T02:26:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.372+0000 7f042a000640 1 -- 172.21.15.45:0/1851902118 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420011710 con 0x7f0434156890 2024-08-17T02:26:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.372+0000 7f042a000640 1 -- 172.21.15.45:0/1851902118 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420011ad0 con 0x7f0434156890 2024-08-17T02:26:05.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.372+0000 7f0439400640 1 -- 172.21.15.45:0/1851902118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043415de80 con 0x7f0434156890 2024-08-17T02:26:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.372+0000 7f0439400640 1 -- 172.21.15.45:0/1851902118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043416a4f0 con 0x7f0434156890 2024-08-17T02:26:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.373+0000 7f0439400640 1 -- 172.21.15.45:0/1851902118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043415e640 con 0x7f0434156890 2024-08-17T02:26:05.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.374+0000 7f042a000640 1 -- 172.21.15.45:0/1851902118 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f042001b3b0 con 0x7f0434156890 2024-08-17T02:26:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.375+0000 7f042a000640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0414065150 0x7f0414067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.375+0000 7f042a000640 1 -- 172.21.15.45:0/1851902118 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f04200817d0 con 0x7f0434156890 2024-08-17T02:26:05.376 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.375+0000 7f0432800640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0414065150 0x7f0414067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:05.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.376+0000 7f0432800640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0414065150 0x7f0414067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0434064fe0 tx=0x7f0424008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:05.380 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.380+0000 7f042a000640 1 -- 172.21.15.45:0/1851902118 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f042004f9d0 con 0x7f0434156890 2024-08-17T02:26:05.562 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:05.562+0000 7f0439400640 1 -- 172.21.15.45:0/1851902118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f04340710c0 con 0x7f0434156890 2024-08-17T02:26:06.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.190+0000 7f042a000640 1 -- 172.21.15.45:0/1851902118 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0420017020 con 0x7f0434156890 2024-08-17T02:26:06.191 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2024-08-17T02:26:06.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.195+0000 7f0439400640 1 -- 172.21.15.45:0/1851902118 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0414065150 msgr2=0x7f0414067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.195+0000 7f0439400640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0414065150 0x7f0414067600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0434064fe0 tx=0x7f0424008040 comp rx=0 tx=0).stop 2024-08-17T02:26:06.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.195+0000 7f0439400640 1 -- 172.21.15.45:0/1851902118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0434156890 msgr2=0x7f04340abeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.195+0000 7f0439400640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0434156890 0x7f04340abeb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f042000c4c0 tx=0x7f0420007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.196+0000 7f0439400640 1 -- 172.21.15.45:0/1851902118 shutdown_connections 2024-08-17T02:26:06.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.196+0000 7f0439400640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0434156c60 0x7f04340ac3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.196+0000 7f0439400640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0434156890 0x7f04340abeb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.196+0000 7f0439400640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0414065150 0x7f0414067600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.196+0000 7f0439400640 1 --2- 172.21.15.45:0/1851902118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f04340c8840 0x7f04341454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.196+0000 7f0439400640 1 -- 172.21.15.45:0/1851902118 >> 172.21.15.45:0/1851902118 conn(0x7f0434067750 msgr2=0x7f04340c7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.196+0000 7f0439400640 1 -- 172.21.15.45:0/1851902118 shutdown_connections 2024-08-17T02:26:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.196+0000 7f0439400640 1 -- 172.21.15.45:0/1851902118 wait complete. 2024-08-17T02:26:06.228 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-17T02:26:06.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.384+0000 7fe174200640 1 Processor -- start 2024-08-17T02:26:06.385 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.384+0000 7fe174200640 1 -- start start 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe174200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c155a80 0x7fe16c06dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe174200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe16c0c7db0 0x7fe16c0c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe174200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe16c155e50 0x7fe16c0c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe174200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c1598f0 con 0x7fe16c155e50 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe174200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16c159bd0 con 0x7fe16c0c7db0 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe174200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c159eb0 con 0x7fe16c155a80 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe172200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe16c155e50 0x7fe16c0c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe172200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe16c155e50 0x7fe16c0c9110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42796/0 (socket says 172.21.15.45:42796) 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe172200640 1 -- 172.21.15.45:0/1721413324 learned_addr learned my addr 172.21.15.45:0/1721413324 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe171800640 1 --2- 172.21.15.45:0/1721413324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c155a80 0x7fe16c06dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.387 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe170e00640 1 --2- 172.21.15.45:0/1721413324 >> v2:172.21.15.169:3300/0 conn(0x7fe16c0c7db0 0x7fe16c0c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe172200640 1 -- 172.21.15.45:0/1721413324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c155a80 msgr2=0x7fe16c06dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe172200640 1 --2- 172.21.15.45:0/1721413324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c155a80 0x7fe16c06dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe172200640 1 -- 172.21.15.45:0/1721413324 >> v2:172.21.15.169:3300/0 conn(0x7fe16c0c7db0 msgr2=0x7fe16c0c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe172200640 1 --2- 172.21.15.45:0/1721413324 >> v2:172.21.15.169:3300/0 conn(0x7fe16c0c7db0 0x7fe16c0c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.386+0000 7fe172200640 1 -- 172.21.15.45:0/1721413324 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c15a190 con 0x7fe16c155e50 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.387+0000 7fe172200640 1 --2- 172.21.15.45:0/1721413324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16c155e50 0x7fe16c0c9110 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe16c068570 tx=0x7fe164009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51466acc07029cef server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.388+0000 7fe16be00640 1 -- 172.21.15.45:0/1721413324 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe164032470 con 0x7fe16c155e50 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.388+0000 7fe16be00640 1 -- 172.21.15.45:0/1721413324 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1640325d0 con 0x7fe16c155e50 2024-08-17T02:26:06.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.388+0000 7fe16be00640 1 -- 172.21.15.45:0/1721413324 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1640329b0 con 0x7fe16c155e50 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.388+0000 7fe174200640 1 -- 172.21.15.45:0/1721413324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16c155e50 msgr2=0x7fe16c0c9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.388+0000 7fe174200640 1 --2- 172.21.15.45:0/1721413324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16c155e50 0x7fe16c0c9110 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe16c068570 tx=0x7fe164009840 comp rx=0 tx=0).stop 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.388+0000 7fe174200640 1 -- 172.21.15.45:0/1721413324 shutdown_connections 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.388+0000 7fe174200640 1 --2- 172.21.15.45:0/1721413324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16c155e50 0x7fe16c0c9110 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.388+0000 7fe174200640 1 --2- 172.21.15.45:0/1721413324 >> v2:172.21.15.169:3300/0 conn(0x7fe16c0c7db0 0x7fe16c0c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.388+0000 7fe174200640 1 --2- 172.21.15.45:0/1721413324 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c155a80 0x7fe16c06dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.388+0000 7fe174200640 1 -- 172.21.15.45:0/1721413324 >> 172.21.15.45:0/1721413324 conn(0x7fe16c067750 msgr2=0x7fe16c0c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.388+0000 7fe174200640 1 -- 172.21.15.45:0/1721413324 shutdown_connections 2024-08-17T02:26:06.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.389+0000 7fe174200640 1 -- 172.21.15.45:0/1721413324 wait complete. 2024-08-17T02:26:06.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.390+0000 7fe174200640 1 Processor -- start 2024-08-17T02:26:06.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.390+0000 7fe174200640 1 -- start start 2024-08-17T02:26:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.391+0000 7fe174200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0c7db0 0x7fe16c1490a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.391+0000 7fe174200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16c155a80 0x7fe16c1690f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.391+0000 7fe174200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe16c155e50 0x7fe16c0a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.391+0000 7fe174200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c156450 con 0x7fe16c155a80 2024-08-17T02:26:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.391+0000 7fe174200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c1495e0 con 0x7fe16c155e50 2024-08-17T02:26:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.391+0000 7fe174200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16c151f00 con 0x7fe16c0c7db0 2024-08-17T02:26:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.391+0000 7fe170e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16c155a80 0x7fe16c1690f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.392+0000 7fe170e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16c155a80 0x7fe16c1690f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42806/0 (socket says 172.21.15.45:42806) 2024-08-17T02:26:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.392+0000 7fe170e00640 1 -- 172.21.15.45:0/48545747 learned_addr learned my addr 172.21.15.45:0/48545747 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.392+0000 7fe171800640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0c7db0 0x7fe16c1490a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.392+0000 7fe172200640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe16c155e50 0x7fe16c0a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.392+0000 7fe170e00640 1 -- 172.21.15.45:0/48545747 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0c7db0 msgr2=0x7fe16c1490a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.392+0000 7fe170e00640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0c7db0 0x7fe16c1490a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.392+0000 7fe170e00640 1 -- 172.21.15.45:0/48545747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe16c155e50 msgr2=0x7fe16c0a9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.392+0000 7fe170e00640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe16c155e50 0x7fe16c0a9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.392+0000 7fe170e00640 1 -- 172.21.15.45:0/48545747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe164009ae0 con 0x7fe16c155a80 2024-08-17T02:26:06.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.392+0000 7fe170e00640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16c155a80 0x7fe16c1690f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe15800ea20 tx=0x7fe1580090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.393+0000 7fe168c00640 1 -- 172.21.15.45:0/48545747 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15800caa0 con 0x7fe16c155a80 2024-08-17T02:26:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.393+0000 7fe168c00640 1 -- 172.21.15.45:0/48545747 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15800cc00 con 0x7fe16c155a80 2024-08-17T02:26:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.393+0000 7fe168c00640 1 -- 172.21.15.45:0/48545747 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe158013470 con 0x7fe16c155a80 2024-08-17T02:26:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.393+0000 7fe174200640 1 -- 172.21.15.45:0/48545747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe16c169a60 con 0x7fe16c155a80 2024-08-17T02:26:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.393+0000 7fe174200640 1 -- 172.21.15.45:0/48545747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe16c1521a0 con 0x7fe16c155a80 2024-08-17T02:26:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.394+0000 7fe174200640 1 -- 172.21.15.45:0/48545747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16c071050 con 0x7fe16c155a80 2024-08-17T02:26:06.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.395+0000 7fe168c00640 1 -- 172.21.15.45:0/48545747 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe158013860 con 0x7fe16c155a80 2024-08-17T02:26:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.395+0000 7fe168c00640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe14c065150 0x7fe14c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.395+0000 7fe168c00640 1 -- 172.21.15.45:0/48545747 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fe158082770 con 0x7fe16c155a80 2024-08-17T02:26:06.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.396+0000 7fe171800640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe14c065150 0x7fe14c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:06.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.396+0000 7fe171800640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe14c065150 0x7fe14c067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe160009d20 tx=0x7fe1600090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:06.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.400+0000 7fe168c00640 1 -- 172.21.15.45:0/48545747 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe1580508a0 con 0x7fe16c155a80 2024-08-17T02:26:06.619 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:06.618+0000 7fe174200640 1 -- 172.21.15.45:0/48545747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe16c16a080 con 0x7fe16c155a80 2024-08-17T02:26:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.193+0000 7fe168c00640 1 -- 172.21.15.45:0/48545747 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe158053ec0 con 0x7fe16c155a80 2024-08-17T02:26:07.194 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 4 and data pool 5 2024-08-17T02:26:07.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.198+0000 7fe174200640 1 -- 172.21.15.45:0/48545747 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe14c065150 msgr2=0x7fe14c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.198+0000 7fe174200640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe14c065150 0x7fe14c067600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe160009d20 tx=0x7fe1600090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.198+0000 7fe174200640 1 -- 172.21.15.45:0/48545747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16c155a80 msgr2=0x7fe16c1690f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.198+0000 7fe174200640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16c155a80 0x7fe16c1690f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe15800ea20 tx=0x7fe1580090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.199+0000 7fe174200640 1 -- 172.21.15.45:0/48545747 shutdown_connections 2024-08-17T02:26:07.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.199+0000 7fe174200640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe16c155e50 0x7fe16c0a9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.199+0000 7fe174200640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe16c155a80 0x7fe16c1690f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.199+0000 7fe174200640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe14c065150 0x7fe14c067600 secure :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe160009d20 tx=0x7fe1600090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.199+0000 7fe174200640 1 --2- 172.21.15.45:0/48545747 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe16c0c7db0 0x7fe16c1490a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.199+0000 7fe174200640 1 -- 172.21.15.45:0/48545747 >> 172.21.15.45:0/48545747 conn(0x7fe16c067750 msgr2=0x7fe16c14f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.199+0000 7fe174200640 1 -- 172.21.15.45:0/48545747 shutdown_connections 2024-08-17T02:26:07.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.200+0000 7fe174200640 1 -- 172.21.15.45:0/48545747 wait complete. 2024-08-17T02:26:07.232 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:07.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.385+0000 7f31f3000640 1 Processor -- start 2024-08-17T02:26:07.386 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.385+0000 7f31f3000640 1 -- start start 2024-08-17T02:26:07.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f3000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ec156ad0 0x7f31ec0cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f3000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31ec156ea0 0x7f31ec06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f3000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31ec0caaf0 con 0x7f31ec06dab0 2024-08-17T02:26:07.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f3000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31ec0ca900 con 0x7f31ec156ad0 2024-08-17T02:26:07.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f3000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec0cc560 con 0x7f31ec156ea0 2024-08-17T02:26:07.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f1c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ec156ad0 0x7f31ec0cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f1c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31ec156ad0 0x7f31ec0cbea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42812/0 (socket says 172.21.15.45:42812) 2024-08-17T02:26:07.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f1c00640 1 -- 172.21.15.45:0/2119518590 learned_addr learned my addr 172.21.15.45:0/2119518590 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:07.388 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f1200640 1 --2- 172.21.15.45:0/2119518590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31ec156ea0 0x7f31ec06d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f1c00640 1 -- 172.21.15.45:0/2119518590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31ec156ea0 msgr2=0x7f31ec06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:07.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f1c00640 1 --2- 172.21.15.45:0/2119518590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31ec156ea0 0x7f31ec06d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f1c00640 1 -- 172.21.15.45:0/2119518590 >> v1:172.21.15.169:6789/0 conn(0x7f31ec06dab0 legacy=0x7f31ec0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.387+0000 7f31f1c00640 1 -- 172.21.15.45:0/2119518590 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec0cad90 con 0x7f31ec156ad0 2024-08-17T02:26:07.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.388+0000 7f31f1c00640 1 --2- 172.21.15.45:0/2119518590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31ec156ad0 0x7f31ec0cbea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009940 tx=0x7f31e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b2da7903805bf7 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.389+0000 7f31ebe00640 1 -- 172.21.15.45:0/2119518590 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e002ae40 con 0x7f31ec156ad0 2024-08-17T02:26:07.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.389+0000 7f31ebe00640 1 -- 172.21.15.45:0/2119518590 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e0032440 con 0x7f31ec156ad0 2024-08-17T02:26:07.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.389+0000 7f31ebe00640 1 -- 172.21.15.45:0/2119518590 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e0032820 con 0x7f31ec156ad0 2024-08-17T02:26:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.389+0000 7f31f3000640 1 -- 172.21.15.45:0/2119518590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31ec156ad0 msgr2=0x7f31ec0cbea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.389+0000 7f31f3000640 1 --2- 172.21.15.45:0/2119518590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31ec156ad0 0x7f31ec0cbea0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f31e0009940 tx=0x7f31e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.389+0000 7f31f3000640 1 -- 172.21.15.45:0/2119518590 shutdown_connections 2024-08-17T02:26:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.389+0000 7f31f3000640 1 --2- 172.21.15.45:0/2119518590 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31ec156ea0 0x7f31ec06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.389+0000 7f31f3000640 1 --2- 172.21.15.45:0/2119518590 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31ec156ad0 0x7f31ec0cbea0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.389+0000 7f31f3000640 1 -- 172.21.15.45:0/2119518590 >> 172.21.15.45:0/2119518590 conn(0x7f31ec067750 msgr2=0x7f31ec0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.389+0000 7f31f3000640 1 -- 172.21.15.45:0/2119518590 shutdown_connections 2024-08-17T02:26:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.389+0000 7f31f3000640 1 -- 172.21.15.45:0/2119518590 wait complete. 2024-08-17T02:26:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.391+0000 7f31f3000640 1 Processor -- start 2024-08-17T02:26:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.391+0000 7f31f3000640 1 -- start start 2024-08-17T02:26:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f3000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31ec06dab0 0x7f31ec0c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f3000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31ec156ad0 0x7f31ec151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f3000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31ec156ea0 0x7f31ec13f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f3000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec151910 con 0x7f31ec156ea0 2024-08-17T02:26:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f3000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec13f840 con 0x7f31ec156ad0 2024-08-17T02:26:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f3000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec157c60 con 0x7f31ec06dab0 2024-08-17T02:26:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f2600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31ec156ea0 0x7f31ec13f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f1c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31ec06dab0 0x7f31ec0c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f2600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31ec156ea0 0x7f31ec13f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42816/0 (socket says 172.21.15.45:42816) 2024-08-17T02:26:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f2600640 1 -- 172.21.15.45:0/1731033482 learned_addr learned my addr 172.21.15.45:0/1731033482 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f1c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31ec06dab0 0x7f31ec0c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:40124/0 (socket says 172.21.15.45:40124) 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.392+0000 7f31f1200640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31ec156ad0 0x7f31ec151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.393+0000 7f31f2600640 1 -- 172.21.15.45:0/1731033482 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31ec06dab0 msgr2=0x7f31ec0c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.393+0000 7f31f2600640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31ec06dab0 0x7f31ec0c50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.393+0000 7f31f2600640 1 -- 172.21.15.45:0/1731033482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31ec156ad0 msgr2=0x7f31ec151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.393+0000 7f31f2600640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31ec156ad0 0x7f31ec151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.393+0000 7f31f2600640 1 -- 172.21.15.45:0/1731033482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0009450 con 0x7f31ec156ea0 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.393+0000 7f31f2600640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31ec156ea0 0x7f31ec13f300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31e400c860 tx=0x7f31e4001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.393+0000 7f31e8c00640 1 -- 172.21.15.45:0/1731033482 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e400ce50 con 0x7f31ec156ea0 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.393+0000 7f31e8c00640 1 -- 172.21.15.45:0/1731033482 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e400a850 con 0x7f31ec156ea0 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.393+0000 7f31e8c00640 1 -- 172.21.15.45:0/1731033482 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e400ac10 con 0x7f31ec156ea0 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.393+0000 7f31f3000640 1 -- 172.21.15.45:0/1731033482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec157f40 con 0x7f31ec156ea0 2024-08-17T02:26:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.393+0000 7f31f3000640 1 -- 172.21.15.45:0/1731033482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec1515a0 con 0x7f31ec156ea0 2024-08-17T02:26:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.394+0000 7f31f3000640 1 -- 172.21.15.45:0/1731033482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec071050 con 0x7f31ec156ea0 2024-08-17T02:26:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.395+0000 7f31e8c00640 1 -- 172.21.15.45:0/1731033482 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f31e4012630 con 0x7f31ec156ea0 2024-08-17T02:26:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.396+0000 7f31e8c00640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31cc065150 0x7f31cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.397+0000 7f31e8c00640 1 -- 172.21.15.45:0/1731033482 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31e40825d0 con 0x7f31ec156ea0 2024-08-17T02:26:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.397+0000 7f31f1c00640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31cc065150 0x7f31cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.397+0000 7f31f1c00640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31cc065150 0x7f31cc067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f31e0034000 tx=0x7f31e0032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.401+0000 7f31e8c00640 1 -- 172.21.15.45:0/1731033482 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f31e40506a0 con 0x7f31ec156ea0 2024-08-17T02:26:07.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.588+0000 7f31f3000640 1 -- 172.21.15.45:0/1731033482 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31ec06f480 con 0x7f31ec156ea0 2024-08-17T02:26:07.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.589+0000 7f31e8c00640 1 -- 172.21.15.45:0/1731033482 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f31e4053cc0 con 0x7f31ec156ea0 2024-08-17T02:26:07.590 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:07.590 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":31,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:26:06.619809+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:04.691522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:05.604365+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 -- 172.21.15.45:0/1731033482 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31cc065150 msgr2=0x7f31cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31cc065150 0x7f31cc067600 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f31e0034000 tx=0x7f31e0032000 comp rx=0 tx=0).stop 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 -- 172.21.15.45:0/1731033482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31ec156ea0 msgr2=0x7f31ec13f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31ec156ea0 0x7f31ec13f300 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f31e400c860 tx=0x7f31e4001690 comp rx=0 tx=0).stop 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 -- 172.21.15.45:0/1731033482 shutdown_connections 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31ec156ea0 0x7f31ec13f300 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31ec156ad0 0x7f31ec151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31cc065150 0x7f31cc067600 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 --2- 172.21.15.45:0/1731033482 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31ec06dab0 0x7f31ec0c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 -- 172.21.15.45:0/1731033482 >> 172.21.15.45:0/1731033482 conn(0x7f31ec067750 msgr2=0x7f31ec155b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 -- 172.21.15.45:0/1731033482 shutdown_connections 2024-08-17T02:26:07.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.592+0000 7f31f3000640 1 -- 172.21.15.45:0/1731033482 wait complete. 2024-08-17T02:26:07.608 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.759+0000 7f4e43c00640 1 Processor -- start 2024-08-17T02:26:07.760 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.759+0000 7f4e43c00640 1 -- start start 2024-08-17T02:26:07.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.760+0000 7f4e43c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e3c140580 0x7f4e3c0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.760+0000 7f4e43c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c0caa80 con 0x7f4e3c0b1440 2024-08-17T02:26:07.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.760+0000 7f4e43c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e3c0c9e70 con 0x7f4e3c1401b0 2024-08-17T02:26:07.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.760+0000 7f4e43c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0c9c90 con 0x7f4e3c140580 2024-08-17T02:26:07.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.761+0000 7f4e3be00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4e3c0b1440 0x7f4e3c0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59410/0 (socket says 172.21.15.45:59410) 2024-08-17T02:26:07.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.761+0000 7f4e3be00640 1 -- 172.21.15.45:0/424415533 learned_addr learned my addr 172.21.15.45:0/424415533 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:07.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.761+0000 7f4e41c00640 1 --2- 172.21.15.45:0/424415533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e3c140580 0x7f4e3c0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.761+0000 7f4e3b400640 1 -- 172.21.15.45:0/424415533 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995437023 0 0) 0x7f4e3c0caa80 con 0x7f4e3c0b1440 2024-08-17T02:26:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.761+0000 7f4e3b400640 1 -- 172.21.15.45:0/424415533 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e240034e0 con 0x7f4e3c0b1440 2024-08-17T02:26:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.761+0000 7f4e3b400640 1 -- 172.21.15.45:0/424415533 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2186128505 0 0) 0x7f4e3c0c9e70 con 0x7f4e3c1401b0 2024-08-17T02:26:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.761+0000 7f4e3b400640 1 -- 172.21.15.45:0/424415533 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e3c0caa80 con 0x7f4e3c1401b0 2024-08-17T02:26:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.761+0000 7f4e41c00640 1 -- 172.21.15.45:0/424415533 >> v1:172.21.15.169:6789/0 conn(0x7f4e3c1401b0 legacy=0x7f4e3c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.761+0000 7f4e41c00640 1 -- 172.21.15.45:0/424415533 >> v1:172.21.15.45:6789/0 conn(0x7f4e3c0b1440 legacy=0x7f4e3c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.761+0000 7f4e41c00640 1 -- 172.21.15.45:0/424415533 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c0ca150 con 0x7f4e3c140580 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.762+0000 7f4e41c00640 1 --2- 172.21.15.45:0/424415533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e3c140580 0x7f4e3c0c9750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009e90 tx=0x7f4e34009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=664d911fc3b0c2c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.763+0000 7f4e3b400640 1 -- 172.21.15.45:0/424415533 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34007550 con 0x7f4e3c140580 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.763+0000 7f4e3b400640 1 -- 172.21.15.45:0/424415533 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3402d050 con 0x7f4e3c140580 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.763+0000 7f4e3b400640 1 -- 172.21.15.45:0/424415533 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e340078c0 con 0x7f4e3c140580 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.763+0000 7f4e43c00640 1 -- 172.21.15.45:0/424415533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e3c140580 msgr2=0x7f4e3c0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.763+0000 7f4e43c00640 1 --2- 172.21.15.45:0/424415533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e3c140580 0x7f4e3c0c9750 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009e90 tx=0x7f4e34009780 comp rx=0 tx=0).stop 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.763+0000 7f4e43c00640 1 -- 172.21.15.45:0/424415533 shutdown_connections 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.763+0000 7f4e43c00640 1 --2- 172.21.15.45:0/424415533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e3c140580 0x7f4e3c0c9750 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.763+0000 7f4e43c00640 1 -- 172.21.15.45:0/424415533 >> 172.21.15.45:0/424415533 conn(0x7f4e3c0cb9b0 msgr2=0x7f4e3c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.763+0000 7f4e43c00640 1 -- 172.21.15.45:0/424415533 shutdown_connections 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.763+0000 7f4e43c00640 1 -- 172.21.15.45:0/424415533 wait complete. 2024-08-17T02:26:07.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.765+0000 7f4e43c00640 1 Processor -- start 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.765+0000 7f4e43c00640 1 -- start start 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.766+0000 7f4e43c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e3c0b1440 0x7f4e3c0aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.766+0000 7f4e43c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e3c1401b0 0x7f4e3c13f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.766+0000 7f4e43c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e3c140580 0x7f4e3c0aa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.766+0000 7f4e43c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0ab4c0 con 0x7f4e3c140580 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.766+0000 7f4e43c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c0c6b90 con 0x7f4e3c1401b0 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.766+0000 7f4e43c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c168df0 con 0x7f4e3c0b1440 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.766+0000 7f4e41c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e3c140580 0x7f4e3c0aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.766+0000 7f4e41c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e3c140580 0x7f4e3c0aa320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42818/0 (socket says 172.21.15.45:42818) 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.766+0000 7f4e41c00640 1 -- 172.21.15.45:0/3724107236 learned_addr learned my addr 172.21.15.45:0/3724107236 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.766+0000 7f4e3be00640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e3c1401b0 0x7f4e3c13f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.766+0000 7f4e41200640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e3c0b1440 0x7f4e3c0aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.767+0000 7f4e41c00640 1 -- 172.21.15.45:0/3724107236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e3c0b1440 msgr2=0x7f4e3c0aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.767+0000 7f4e41c00640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e3c0b1440 0x7f4e3c0aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.767+0000 7f4e41c00640 1 -- 172.21.15.45:0/3724107236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e3c1401b0 msgr2=0x7f4e3c13f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.767+0000 7f4e41c00640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e3c1401b0 0x7f4e3c13f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.767+0000 7f4e41c00640 1 -- 172.21.15.45:0/3724107236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e34009a20 con 0x7f4e3c140580 2024-08-17T02:26:07.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.767+0000 7f4e41c00640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e3c140580 0x7f4e3c0aa320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009e90 tx=0x7f4e34037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.767+0000 7f4e2fe00640 1 -- 172.21.15.45:0/3724107236 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34031ac0 con 0x7f4e3c140580 2024-08-17T02:26:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.767+0000 7f4e2fe00640 1 -- 172.21.15.45:0/3724107236 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e34031c20 con 0x7f4e3c140580 2024-08-17T02:26:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.767+0000 7f4e2fe00640 1 -- 172.21.15.45:0/3724107236 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3403c420 con 0x7f4e3c140580 2024-08-17T02:26:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.767+0000 7f4e43c00640 1 -- 172.21.15.45:0/3724107236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3c0aaf00 con 0x7f4e3c140580 2024-08-17T02:26:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.768+0000 7f4e43c00640 1 -- 172.21.15.45:0/3724107236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c0c6de0 con 0x7f4e3c140580 2024-08-17T02:26:07.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.768+0000 7f4e43c00640 1 -- 172.21.15.45:0/3724107236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3c064db0 con 0x7f4e3c140580 2024-08-17T02:26:07.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.769+0000 7f4e2fe00640 1 -- 172.21.15.45:0/3724107236 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4e34003040 con 0x7f4e3c140580 2024-08-17T02:26:07.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.770+0000 7f4e2fe00640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4e1c065180 0x7f4e1c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:07.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.770+0000 7f4e2fe00640 1 -- 172.21.15.45:0/3724107236 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4e340a3ac0 con 0x7f4e3c140580 2024-08-17T02:26:07.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.770+0000 7f4e41200640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4e1c065180 0x7f4e1c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:07.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.771+0000 7f4e41200640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4e1c065180 0x7f4e1c067630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0b0800 tx=0x7f4e30007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:07.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.775+0000 7f4e2fe00640 1 -- 172.21.15.45:0/3724107236 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4e34071b90 con 0x7f4e3c140580 2024-08-17T02:26:07.960 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.960+0000 7f4e43c00640 1 -- 172.21.15.45:0/3724107236 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e3c0addb0 con 0x7f4e3c140580 2024-08-17T02:26:07.961 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.961+0000 7f4e2fe00640 1 -- 172.21.15.45:0/3724107236 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15363 (secure 0 0 0) 0x7f4e340751b0 con 0x7f4e3c140580 2024-08-17T02:26:07.962 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:07.962 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":31,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:26:06.619809+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:04.691522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:05.604365+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 -- 172.21.15.45:0/3724107236 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4e1c065180 msgr2=0x7f4e1c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4e1c065180 0x7f4e1c067630 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c0b0800 tx=0x7f4e30007cc0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 -- 172.21.15.45:0/3724107236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e3c140580 msgr2=0x7f4e3c0aa320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e3c140580 0x7f4e3c0aa320 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4e34009e90 tx=0x7f4e34037000 comp rx=0 tx=0).stop 2024-08-17T02:26:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 -- 172.21.15.45:0/3724107236 shutdown_connections 2024-08-17T02:26:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e3c140580 0x7f4e3c0aa320 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4e3c1401b0 0x7f4e3c13f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4e1c065180 0x7f4e1c067630 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 --2- 172.21.15.45:0/3724107236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4e3c0b1440 0x7f4e3c0aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 -- 172.21.15.45:0/3724107236 >> 172.21.15.45:0/3724107236 conn(0x7f4e3c0cb9b0 msgr2=0x7f4e3c0c0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 -- 172.21.15.45:0/3724107236 shutdown_connections 2024-08-17T02:26:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:07.963+0000 7f4e43c00640 1 -- 172.21.15.45:0/3724107236 wait complete. 2024-08-17T02:26:07.979 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-08-17T02:26:08.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.133+0000 7f5105000640 1 Processor -- start 2024-08-17T02:26:08.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.133+0000 7f5105000640 1 -- start start 2024-08-17T02:26:08.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.134+0000 7f5105000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5100156c50 0x7f51000c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.134+0000 7f5105000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51000c8bd0 0x7f51000c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.134+0000 7f5105000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51000ab130 con 0x7f51000adcf0 2024-08-17T02:26:08.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.134+0000 7f5105000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51000c9530 con 0x7f51000c8bd0 2024-08-17T02:26:08.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.134+0000 7f5105000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51000ae5a0 con 0x7f5100156c50 2024-08-17T02:26:08.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.135+0000 7f50fe800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51000c8bd0 0x7f51000c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.135+0000 7f50fe800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51000c8bd0 0x7f51000c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42824/0 (socket says 172.21.15.45:42824) 2024-08-17T02:26:08.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.135+0000 7f50fe800640 1 -- 172.21.15.45:0/1119988493 learned_addr learned my addr 172.21.15.45:0/1119988493 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:08.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.135+0000 7f50fde00640 1 --2- 172.21.15.45:0/1119988493 >> v2:172.21.15.169:3300/0 conn(0x7f5100156c50 0x7f51000c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.135+0000 7f50fe800640 1 -- 172.21.15.45:0/1119988493 >> v2:172.21.15.169:3300/0 conn(0x7f5100156c50 msgr2=0x7f51000c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:08.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.135+0000 7f50fe800640 1 --2- 172.21.15.45:0/1119988493 >> v2:172.21.15.169:3300/0 conn(0x7f5100156c50 0x7f51000c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.135+0000 7f50fe800640 1 -- 172.21.15.45:0/1119988493 >> v1:172.21.15.169:6789/0 conn(0x7f51000adcf0 legacy=0x7f51000ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.135+0000 7f50fe800640 1 -- 172.21.15.45:0/1119988493 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51000ae2c0 con 0x7f51000c8bd0 2024-08-17T02:26:08.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.135+0000 7f50fde00640 1 --2- 172.21.15.45:0/1119988493 >> v2:172.21.15.169:3300/0 conn(0x7f5100156c50 0x7f51000c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:08.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.136+0000 7f50fe800640 1 --2- 172.21.15.45:0/1119988493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51000c8bd0 0x7f51000c8ff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f510006efd0 tx=0x7f50f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d652bb9e49f83a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.136+0000 7f50fd400640 1 -- 172.21.15.45:0/1119988493 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8031400 con 0x7f51000c8bd0 2024-08-17T02:26:08.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.136+0000 7f50fd400640 1 -- 172.21.15.45:0/1119988493 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f802d050 con 0x7f51000c8bd0 2024-08-17T02:26:08.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.136+0000 7f50fd400640 1 -- 172.21.15.45:0/1119988493 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f80317d0 con 0x7f51000c8bd0 2024-08-17T02:26:08.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.137+0000 7f5105000640 1 -- 172.21.15.45:0/1119988493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51000c8bd0 msgr2=0x7f51000c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.137+0000 7f5105000640 1 --2- 172.21.15.45:0/1119988493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51000c8bd0 0x7f51000c8ff0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f510006efd0 tx=0x7f50f8009840 comp rx=0 tx=0).stop 2024-08-17T02:26:08.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.137+0000 7f5105000640 1 -- 172.21.15.45:0/1119988493 shutdown_connections 2024-08-17T02:26:08.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.137+0000 7f5105000640 1 --2- 172.21.15.45:0/1119988493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51000c8bd0 0x7f51000c8ff0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.137+0000 7f5105000640 1 --2- 172.21.15.45:0/1119988493 >> v2:172.21.15.169:3300/0 conn(0x7f5100156c50 0x7f51000c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.137+0000 7f5105000640 1 -- 172.21.15.45:0/1119988493 >> 172.21.15.45:0/1119988493 conn(0x7f5100067750 msgr2=0x7f51000c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:08.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.137+0000 7f5105000640 1 -- 172.21.15.45:0/1119988493 shutdown_connections 2024-08-17T02:26:08.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.137+0000 7f5105000640 1 -- 172.21.15.45:0/1119988493 wait complete. 2024-08-17T02:26:08.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.138+0000 7f5105000640 1 Processor -- start 2024-08-17T02:26:08.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.139+0000 7f5105000640 1 -- start start 2024-08-17T02:26:08.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.139+0000 7f5105000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51000adcf0 0x7f510006d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.139+0000 7f5105000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51000c8bd0 0x7f510014e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.139+0000 7f5105000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5100156c50 0x7f510014bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.139+0000 7f5105000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510014efd0 con 0x7f51000adcf0 2024-08-17T02:26:08.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.139+0000 7f5105000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510014eac0 con 0x7f5100156c50 2024-08-17T02:26:08.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.139+0000 7f5105000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510014ecf0 con 0x7f51000c8bd0 2024-08-17T02:26:08.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50fde00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51000adcf0 0x7f510006d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50fde00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51000adcf0 0x7f510006d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42834/0 (socket says 172.21.15.45:42834) 2024-08-17T02:26:08.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50fde00640 1 -- 172.21.15.45:0/3900391644 learned_addr learned my addr 172.21.15.45:0/3900391644 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:08.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50fde00640 1 -- 172.21.15.45:0/3900391644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51000c8bd0 msgr2=0x7f510014e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50f7e00640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51000c8bd0 0x7f510014e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50fe800640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5100156c50 0x7f510014bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50fde00640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51000c8bd0 0x7f510014e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50fde00640 1 -- 172.21.15.45:0/3900391644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5100156c50 msgr2=0x7f510014bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50fde00640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5100156c50 0x7f510014bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50fde00640 1 -- 172.21.15.45:0/3900391644 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f8009ae0 con 0x7f51000adcf0 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50fe800640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5100156c50 0x7f510014bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50f7e00640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51000c8bd0 0x7f510014e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.140+0000 7f50fde00640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51000adcf0 0x7f510006d970 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f50f000d810 tx=0x7f50f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.141+0000 7f50f5600640 1 -- 172.21.15.45:0/3900391644 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f000de00 con 0x7f51000adcf0 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.141+0000 7f50f5600640 1 -- 172.21.15.45:0/3900391644 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00098b0 con 0x7f51000adcf0 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.141+0000 7f50f5600640 1 -- 172.21.15.45:0/3900391644 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f0009c70 con 0x7f51000adcf0 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.141+0000 7f5105000640 1 -- 172.21.15.45:0/3900391644 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5100157890 con 0x7f51000adcf0 2024-08-17T02:26:08.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.141+0000 7f5105000640 1 -- 172.21.15.45:0/3900391644 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5100157e50 con 0x7f51000adcf0 2024-08-17T02:26:08.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.142+0000 7f5105000640 1 -- 172.21.15.45:0/3900391644 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51001576f0 con 0x7f51000adcf0 2024-08-17T02:26:08.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.143+0000 7f50f5600640 1 -- 172.21.15.45:0/3900391644 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f50f0014640 con 0x7f51000adcf0 2024-08-17T02:26:08.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.144+0000 7f50f5600640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f50dc065150 0x7f50dc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:08.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.144+0000 7f50f5600640 1 -- 172.21.15.45:0/3900391644 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50f0082890 con 0x7f51000adcf0 2024-08-17T02:26:08.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.144+0000 7f50f7e00640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f50dc065150 0x7f50dc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:08.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.145+0000 7f50f7e00640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f50dc065150 0x7f50dc067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f51001526d0 tx=0x7f50e8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:08.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.148+0000 7f50f5600640 1 -- 172.21.15.45:0/3900391644 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f51001576f0 con 0x7f51000adcf0 2024-08-17T02:26:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:08.371+0000 7f5105000640 1 -- 172.21.15.45:0/3900391644 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f51001576f0 con 0x7f51000adcf0 2024-08-17T02:26:09.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.215+0000 7f50f5600640 1 -- 172.21.15.45:0/3900391644 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f51001576f0 con 0x7f51000adcf0 2024-08-17T02:26:09.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 -- 172.21.15.45:0/3900391644 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f50dc065150 msgr2=0x7f50dc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f50dc065150 0x7f50dc067600 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f51001526d0 tx=0x7f50e8009040 comp rx=0 tx=0).stop 2024-08-17T02:26:09.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 -- 172.21.15.45:0/3900391644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51000adcf0 msgr2=0x7f510006d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51000adcf0 0x7f510006d970 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f50f000d810 tx=0x7f50f0008040 comp rx=0 tx=0).stop 2024-08-17T02:26:09.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 -- 172.21.15.45:0/3900391644 shutdown_connections 2024-08-17T02:26:09.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5100156c50 0x7f510014bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f50dc065150 0x7f50dc067600 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f51000c8bd0 0x7f510014e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 --2- 172.21.15.45:0/3900391644 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51000adcf0 0x7f510006d970 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 -- 172.21.15.45:0/3900391644 >> 172.21.15.45:0/3900391644 conn(0x7f5100067750 msgr2=0x7f510006e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 -- 172.21.15.45:0/3900391644 shutdown_connections 2024-08-17T02:26:09.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.217+0000 7f5105000640 1 -- 172.21.15.45:0/3900391644 wait complete. 2024-08-17T02:26:09.234 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-08-17T02:26:09.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.388+0000 7f7a7a800640 1 Processor -- start 2024-08-17T02:26:09.389 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.388+0000 7f7a7a800640 1 -- start start 2024-08-17T02:26:09.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.390+0000 7f7a7a800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7a741612b0 0x7f7a7406c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.390+0000 7f7a7a800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a7415d1a0 0x7f7a740af760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.390+0000 7f7a7a800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a740ab1a0 con 0x7f7a7415cdd0 2024-08-17T02:26:09.391 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.390+0000 7f7a7a800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a740ad140 con 0x7f7a741612b0 2024-08-17T02:26:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.390+0000 7f7a7a800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a740b00e0 con 0x7f7a7415d1a0 2024-08-17T02:26:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.390+0000 7f7a79400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7a7415cdd0 0x7f7a74160ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59422/0 (socket says 172.21.15.45:59422) 2024-08-17T02:26:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.390+0000 7f7a79400640 1 -- 172.21.15.45:0/1268603331 learned_addr learned my addr 172.21.15.45:0/1268603331 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.390+0000 7f7a79e00640 1 --2- 172.21.15.45:0/1268603331 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a7415d1a0 0x7f7a740af760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.390+0000 7f7a78a00640 1 --2- 172.21.15.45:0/1268603331 >> v2:172.21.15.169:3300/0 conn(0x7f7a741612b0 0x7f7a7406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.390+0000 7f7a73e00640 1 -- 172.21.15.45:0/1268603331 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1076228103 0 0) 0x7f7a740ab1a0 con 0x7f7a7415cdd0 2024-08-17T02:26:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.391+0000 7f7a73e00640 1 -- 172.21.15.45:0/1268603331 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a5c0034e0 con 0x7f7a7415cdd0 2024-08-17T02:26:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.391+0000 7f7a79e00640 1 -- 172.21.15.45:0/1268603331 >> v2:172.21.15.169:3300/0 conn(0x7f7a741612b0 msgr2=0x7f7a7406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.391+0000 7f7a79e00640 1 --2- 172.21.15.45:0/1268603331 >> v2:172.21.15.169:3300/0 conn(0x7f7a741612b0 0x7f7a7406c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.391+0000 7f7a79e00640 1 -- 172.21.15.45:0/1268603331 >> v1:172.21.15.45:6789/0 conn(0x7f7a7415cdd0 legacy=0x7f7a74160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.391+0000 7f7a79e00640 1 -- 172.21.15.45:0/1268603331 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a740ab3f0 con 0x7f7a7415d1a0 2024-08-17T02:26:09.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.392+0000 7f7a79e00640 1 --2- 172.21.15.45:0/1268603331 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a7415d1a0 0x7f7a740af760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009e60 tx=0x7f7a6c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4a491c74e2dae98 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.393 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.392+0000 7f7a73e00640 1 -- 172.21.15.45:0/1268603331 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c007550 con 0x7f7a7415d1a0 2024-08-17T02:26:09.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.392+0000 7f7a73e00640 1 -- 172.21.15.45:0/1268603331 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c02d050 con 0x7f7a7415d1a0 2024-08-17T02:26:09.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.392+0000 7f7a73e00640 1 -- 172.21.15.45:0/1268603331 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c007920 con 0x7f7a7415d1a0 2024-08-17T02:26:09.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.393+0000 7f7a7a800640 1 -- 172.21.15.45:0/1268603331 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a7415d1a0 msgr2=0x7f7a740af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.393+0000 7f7a7a800640 1 --2- 172.21.15.45:0/1268603331 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a7415d1a0 0x7f7a740af760 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c009e60 tx=0x7f7a6c009780 comp rx=0 tx=0).stop 2024-08-17T02:26:09.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.393+0000 7f7a7a800640 1 -- 172.21.15.45:0/1268603331 shutdown_connections 2024-08-17T02:26:09.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.393+0000 7f7a7a800640 1 --2- 172.21.15.45:0/1268603331 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a7415d1a0 0x7f7a740af760 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.393+0000 7f7a7a800640 1 --2- 172.21.15.45:0/1268603331 >> v2:172.21.15.169:3300/0 conn(0x7f7a741612b0 0x7f7a7406c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.393+0000 7f7a7a800640 1 -- 172.21.15.45:0/1268603331 >> 172.21.15.45:0/1268603331 conn(0x7f7a74066cd0 msgr2=0x7f7a740670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:09.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.393+0000 7f7a7a800640 1 -- 172.21.15.45:0/1268603331 shutdown_connections 2024-08-17T02:26:09.394 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.393+0000 7f7a7a800640 1 -- 172.21.15.45:0/1268603331 wait complete. 2024-08-17T02:26:09.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.394+0000 7f7a7a800640 1 Processor -- start 2024-08-17T02:26:09.395 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.394+0000 7f7a7a800640 1 -- start start 2024-08-17T02:26:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.395+0000 7f7a7a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7415cdd0 0x7f7a741546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.395+0000 7f7a7a800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a7415d1a0 0x7f7a74155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.395+0000 7f7a7a800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a741612b0 0x7f7a74153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.395+0000 7f7a7a800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a74156320 con 0x7f7a7415cdd0 2024-08-17T02:26:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.395+0000 7f7a7a800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a74154d70 con 0x7f7a7415d1a0 2024-08-17T02:26:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.395+0000 7f7a7a800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a74155050 con 0x7f7a741612b0 2024-08-17T02:26:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.395+0000 7f7a79400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7415cdd0 0x7f7a741546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.395+0000 7f7a79400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7415cdd0 0x7f7a741546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42840/0 (socket says 172.21.15.45:42840) 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.395+0000 7f7a79400640 1 -- 172.21.15.45:0/315114749 learned_addr learned my addr 172.21.15.45:0/315114749 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.396+0000 7f7a79e00640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a741612b0 0x7f7a74153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.396+0000 7f7a78a00640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a7415d1a0 0x7f7a74155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.396+0000 7f7a79400640 1 -- 172.21.15.45:0/315114749 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a741612b0 msgr2=0x7f7a74153aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.396+0000 7f7a79400640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a741612b0 0x7f7a74153aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.396+0000 7f7a79400640 1 -- 172.21.15.45:0/315114749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a7415d1a0 msgr2=0x7f7a74155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.396+0000 7f7a79400640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a7415d1a0 0x7f7a74155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.396+0000 7f7a79400640 1 -- 172.21.15.45:0/315114749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a6c009a20 con 0x7f7a7415cdd0 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.396+0000 7f7a78a00640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a7415d1a0 0x7f7a74155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.396+0000 7f7a79400640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7415cdd0 0x7f7a741546e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800c5b0 tx=0x7f7a68007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.396+0000 7f7a70c00640 1 -- 172.21.15.45:0/315114749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68005b70 con 0x7f7a7415cdd0 2024-08-17T02:26:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.397+0000 7f7a70c00640 1 -- 172.21.15.45:0/315114749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a68005cf0 con 0x7f7a7415cdd0 2024-08-17T02:26:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.397+0000 7f7a70c00640 1 -- 172.21.15.45:0/315114749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68007340 con 0x7f7a7415cdd0 2024-08-17T02:26:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.397+0000 7f7a7a800640 1 -- 172.21.15.45:0/315114749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a74155330 con 0x7f7a7415cdd0 2024-08-17T02:26:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.397+0000 7f7a7a800640 1 -- 172.21.15.45:0/315114749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a74159d60 con 0x7f7a7415cdd0 2024-08-17T02:26:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.398+0000 7f7a7a800640 1 -- 172.21.15.45:0/315114749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a74159bc0 con 0x7f7a7415cdd0 2024-08-17T02:26:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.398+0000 7f7a70c00640 1 -- 172.21.15.45:0/315114749 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7a6801b400 con 0x7f7a7415cdd0 2024-08-17T02:26:09.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.399+0000 7f7a70c00640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a54065150 0x7f7a54067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:09.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.399+0000 7f7a70c00640 1 -- 172.21.15.45:0/315114749 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7a68081fe0 con 0x7f7a7415cdd0 2024-08-17T02:26:09.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.399+0000 7f7a78a00640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a54065150 0x7f7a54067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:09.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.400+0000 7f7a78a00640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a54065150 0x7f7a54067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7a60006e70 tx=0x7f7a60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.403+0000 7f7a70c00640 1 -- 172.21.15.45:0/315114749 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7a74159bc0 con 0x7f7a7415cdd0 2024-08-17T02:26:09.620 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:09.620+0000 7f7a7a800640 1 -- 172.21.15.45:0/315114749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7a74159bc0 con 0x7f7a7415cdd0 2024-08-17T02:26:10.088 INFO:tasks.ceph.mds.c.smithi045.stderr:2024-08-17T02:26:10.087+0000 7f6fb3e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:10.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.222+0000 7f7a70c00640 1 -- 172.21.15.45:0/315114749 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7a74159bc0 con 0x7f7a7415cdd0 2024-08-17T02:26:10.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.224+0000 7f7a7a800640 1 -- 172.21.15.45:0/315114749 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a54065150 msgr2=0x7f7a54067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.224+0000 7f7a7a800640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a54065150 0x7f7a54067600 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7a60006e70 tx=0x7f7a60008040 comp rx=0 tx=0).stop 2024-08-17T02:26:10.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.224+0000 7f7a7a800640 1 -- 172.21.15.45:0/315114749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7415cdd0 msgr2=0x7f7a741546e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.224+0000 7f7a7a800640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7415cdd0 0x7f7a741546e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800c5b0 tx=0x7f7a68007d70 comp rx=0 tx=0).stop 2024-08-17T02:26:10.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.224+0000 7f7a7a800640 1 -- 172.21.15.45:0/315114749 shutdown_connections 2024-08-17T02:26:10.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.224+0000 7f7a7a800640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a54065150 0x7f7a54067600 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.224+0000 7f7a7a800640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7a741612b0 0x7f7a74153aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.224+0000 7f7a7a800640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7a7415d1a0 0x7f7a74155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.224+0000 7f7a7a800640 1 --2- 172.21.15.45:0/315114749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a7415cdd0 0x7f7a741546e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.224+0000 7f7a7a800640 1 -- 172.21.15.45:0/315114749 >> 172.21.15.45:0/315114749 conn(0x7f7a74066cd0 msgr2=0x7f7a740aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.225+0000 7f7a7a800640 1 -- 172.21.15.45:0/315114749 shutdown_connections 2024-08-17T02:26:10.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.225+0000 7f7a7a800640 1 -- 172.21.15.45:0/315114749 wait complete. 2024-08-17T02:26:10.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:10.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.399+0000 7fa1a1000640 1 Processor -- start 2024-08-17T02:26:10.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.399+0000 7fa1a1000640 1 -- start start 2024-08-17T02:26:10.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.400+0000 7fa1a1000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa19c140580 0x7fa19c0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.400+0000 7fa1a1000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c0caa80 con 0x7fa19c1401b0 2024-08-17T02:26:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.400+0000 7fa1a1000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19c0c9e70 con 0x7fa19c0b1440 2024-08-17T02:26:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.400+0000 7fa1a1000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa19c0c9c90 con 0x7fa19c140580 2024-08-17T02:26:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.401+0000 7fa199e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa19c1401b0 0x7fa19c0b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59432/0 (socket says 172.21.15.45:59432) 2024-08-17T02:26:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.401+0000 7fa199e00640 1 -- 172.21.15.45:0/3929277679 learned_addr learned my addr 172.21.15.45:0/3929277679 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:10.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.401+0000 7fa19a800640 1 --2- 172.21.15.45:0/3929277679 >> v2:172.21.15.45:3300/0 conn(0x7fa19c140580 0x7fa19c0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.401+0000 7fa199400640 1 -- 172.21.15.45:0/3929277679 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412281746 0 0) 0x7fa19c0caa80 con 0x7fa19c1401b0 2024-08-17T02:26:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.401+0000 7fa199400640 1 -- 172.21.15.45:0/3929277679 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1800034e0 con 0x7fa19c1401b0 2024-08-17T02:26:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.401+0000 7fa19a800640 1 -- 172.21.15.45:0/3929277679 >> v1:172.21.15.169:6789/0 conn(0x7fa19c0b1440 legacy=0x7fa19c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.401+0000 7fa19a800640 1 -- 172.21.15.45:0/3929277679 >> v1:172.21.15.45:6789/0 conn(0x7fa19c1401b0 legacy=0x7fa19c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.401+0000 7fa19a800640 1 -- 172.21.15.45:0/3929277679 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19c0ca150 con 0x7fa19c140580 2024-08-17T02:26:10.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.402+0000 7fa19a800640 1 --2- 172.21.15.45:0/3929277679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa19c140580 0x7fa19c0c9750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa194009e60 tx=0x7fa194009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e558bde434d64d4b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.403+0000 7fa199400640 1 -- 172.21.15.45:0/3929277679 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194007550 con 0x7fa19c140580 2024-08-17T02:26:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.403+0000 7fa199400640 1 -- 172.21.15.45:0/3929277679 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa19402d050 con 0x7fa19c140580 2024-08-17T02:26:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.403+0000 7fa199400640 1 -- 172.21.15.45:0/3929277679 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa194007900 con 0x7fa19c140580 2024-08-17T02:26:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.403+0000 7fa1a1000640 1 -- 172.21.15.45:0/3929277679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa19c140580 msgr2=0x7fa19c0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.403+0000 7fa1a1000640 1 --2- 172.21.15.45:0/3929277679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa19c140580 0x7fa19c0c9750 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa194009e60 tx=0x7fa194009780 comp rx=0 tx=0).stop 2024-08-17T02:26:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.403+0000 7fa1a1000640 1 -- 172.21.15.45:0/3929277679 shutdown_connections 2024-08-17T02:26:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.403+0000 7fa1a1000640 1 --2- 172.21.15.45:0/3929277679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa19c140580 0x7fa19c0c9750 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.403+0000 7fa1a1000640 1 -- 172.21.15.45:0/3929277679 >> 172.21.15.45:0/3929277679 conn(0x7fa19c0cb9b0 msgr2=0x7fa19c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.405 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.403+0000 7fa1a1000640 1 -- 172.21.15.45:0/3929277679 shutdown_connections 2024-08-17T02:26:10.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.403+0000 7fa1a1000640 1 -- 172.21.15.45:0/3929277679 wait complete. 2024-08-17T02:26:10.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.405+0000 7fa1a1000640 1 Processor -- start 2024-08-17T02:26:10.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.405+0000 7fa1a1000640 1 -- start start 2024-08-17T02:26:10.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa1a1000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa19c0b1440 0x7fa19c15aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa1a1000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa19c1401b0 0x7fa19c0a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa1a1000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c140580 0x7fa19c0a7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa1a1000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0a6ac0 con 0x7fa19c1401b0 2024-08-17T02:26:10.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa1a1000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c15af60 con 0x7fa19c140580 2024-08-17T02:26:10.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa1a1000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19c0a5eb0 con 0x7fa19c0b1440 2024-08-17T02:26:10.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa193e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa19c1401b0 0x7fa19c0a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa193e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa19c1401b0 0x7fa19c0a54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42858/0 (socket says 172.21.15.45:42858) 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa193e00640 1 -- 172.21.15.45:0/170487658 learned_addr learned my addr 172.21.15.45:0/170487658 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa19a800640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c140580 0x7fa19c0a7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa199e00640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa19c0b1440 0x7fa19c15aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa193e00640 1 -- 172.21.15.45:0/170487658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa19c0b1440 msgr2=0x7fa19c15aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa193e00640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa19c0b1440 0x7fa19c15aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa193e00640 1 -- 172.21.15.45:0/170487658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c140580 msgr2=0x7fa19c0a7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa193e00640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c140580 0x7fa19c0a7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa193e00640 1 -- 172.21.15.45:0/170487658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa194009a20 con 0x7fa19c1401b0 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.406+0000 7fa19a800640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c140580 0x7fa19c0a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.407+0000 7fa193e00640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa19c1401b0 0x7fa19c0a54d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c560 tx=0x7fa184007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.407+0000 7fa191600640 1 -- 172.21.15.45:0/170487658 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184011590 con 0x7fa19c1401b0 2024-08-17T02:26:10.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.407+0000 7fa191600640 1 -- 172.21.15.45:0/170487658 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184011710 con 0x7fa19c1401b0 2024-08-17T02:26:10.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.407+0000 7fa191600640 1 -- 172.21.15.45:0/170487658 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa184011ad0 con 0x7fa19c1401b0 2024-08-17T02:26:10.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.407+0000 7fa1a1000640 1 -- 172.21.15.45:0/170487658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19c0a6190 con 0x7fa19c1401b0 2024-08-17T02:26:10.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.407+0000 7fa1a1000640 1 -- 172.21.15.45:0/170487658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19c0a6750 con 0x7fa19c1401b0 2024-08-17T02:26:10.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.408+0000 7fa1a1000640 1 -- 172.21.15.45:0/170487658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa19c064db0 con 0x7fa19c1401b0 2024-08-17T02:26:10.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.409+0000 7fa191600640 1 -- 172.21.15.45:0/170487658 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa18401b3b0 con 0x7fa19c1401b0 2024-08-17T02:26:10.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.410+0000 7fa191600640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa178065150 0x7fa178067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.410+0000 7fa191600640 1 -- 172.21.15.45:0/170487658 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa184081a90 con 0x7fa19c1401b0 2024-08-17T02:26:10.411 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.411+0000 7fa199e00640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa178065150 0x7fa178067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.411+0000 7fa199e00640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa178065150 0x7fa178067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa18c005840 tx=0x7fa18c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.415 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.414+0000 7fa191600640 1 -- 172.21.15.45:0/170487658 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa18404fab0 con 0x7fa19c1401b0 2024-08-17T02:26:10.634 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.634+0000 7fa1a1000640 1 -- 172.21.15.45:0/170487658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa19c06dd00 con 0x7fa19c1401b0 2024-08-17T02:26:10.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.634+0000 7fa191600640 1 -- 172.21.15.45:0/170487658 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fa184017070 con 0x7fa19c1401b0 2024-08-17T02:26:10.635 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:10.635 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2570743735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2570743735},{"type":"v1","addr":"172.21.15.169:6834","nonce":2570743735}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1704272549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1704272549},{"type":"v1","addr":"172.21.15.169:6835","nonce":1704272549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/569206503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":569206503},{"type":"v1","addr":"172.21.15.45:6837","nonce":569206503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:06.620196+0000","modified":"2024-08-17T02:26:10.215482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6836/618002034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":618002034},{"type":"v1","addr":"172.21.15.45:6836","nonce":618002034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:26:10.636 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2024-08-17T02:26:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.636+0000 7fa1a1000640 1 -- 172.21.15.45:0/170487658 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa178065150 msgr2=0x7fa178067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.636+0000 7fa1a1000640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa178065150 0x7fa178067600 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa18c005840 tx=0x7fa18c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:10.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.636+0000 7fa1a1000640 1 -- 172.21.15.45:0/170487658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa19c1401b0 msgr2=0x7fa19c0a54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.636+0000 7fa1a1000640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa19c1401b0 0x7fa19c0a54d0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa18400c560 tx=0x7fa184007ef0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.636+0000 7fa1a1000640 1 -- 172.21.15.45:0/170487658 shutdown_connections 2024-08-17T02:26:10.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.636+0000 7fa1a1000640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa19c140580 0x7fa19c0a7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.636+0000 7fa1a1000640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa19c1401b0 0x7fa19c0a54d0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.636+0000 7fa1a1000640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa178065150 0x7fa178067600 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.636+0000 7fa1a1000640 1 --2- 172.21.15.45:0/170487658 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa19c0b1440 0x7fa19c15aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.636+0000 7fa1a1000640 1 -- 172.21.15.45:0/170487658 >> 172.21.15.45:0/170487658 conn(0x7fa19c0cb9b0 msgr2=0x7fa19c13f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.637+0000 7fa1a1000640 1 -- 172.21.15.45:0/170487658 shutdown_connections 2024-08-17T02:26:10.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.637+0000 7fa1a1000640 1 -- 172.21.15.45:0/170487658 wait complete. 2024-08-17T02:26:10.653 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:26:10.804 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.804+0000 7f2e35600640 1 Processor -- start 2024-08-17T02:26:10.805 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.804+0000 7f2e35600640 1 -- start start 2024-08-17T02:26:10.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.805+0000 7f2e35600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e30155a20 0x7f2e300adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.805+0000 7f2e35600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e30155df0 0x7f2e300ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.805+0000 7f2e35600640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e30156670 con 0x7f2e3006d7f0 2024-08-17T02:26:10.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.805+0000 7f2e35600640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e300b0350 con 0x7f2e30155a20 2024-08-17T02:26:10.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.805+0000 7f2e35600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3006e5e0 con 0x7f2e30155df0 2024-08-17T02:26:10.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.805+0000 7f2e2ea00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e30155a20 0x7f2e300adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.806 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.805+0000 7f2e2ea00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2e30155a20 0x7f2e300adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42864/0 (socket says 172.21.15.45:42864) 2024-08-17T02:26:10.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.805+0000 7f2e2ea00640 1 -- 172.21.15.45:0/530794766 learned_addr learned my addr 172.21.15.45:0/530794766 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:10.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.805+0000 7f2e2f400640 1 --1- 172.21.15.45:0/530794766 >> v1:172.21.15.45:6789/0 conn(0x7f2e3006d7f0 0x7f2e300ac790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59448/0 (socket says 172.21.15.45:59448) 2024-08-17T02:26:10.807 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.806+0000 7f2e27e00640 1 --2- 172.21.15.45:0/530794766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e30155df0 0x7f2e300ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.806+0000 7f2e2ea00640 1 -- 172.21.15.45:0/530794766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e30155df0 msgr2=0x7f2e300ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.806+0000 7f2e2ea00640 1 --2- 172.21.15.45:0/530794766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e30155df0 0x7f2e300ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.806+0000 7f2e2ea00640 1 -- 172.21.15.45:0/530794766 >> v1:172.21.15.45:6789/0 conn(0x7f2e3006d7f0 legacy=0x7f2e300ac790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.806+0000 7f2e2ea00640 1 -- 172.21.15.45:0/530794766 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e3006e8c0 con 0x7f2e30155a20 2024-08-17T02:26:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.806+0000 7f2e2e000640 1 -- 172.21.15.45:0/530794766 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1794004295 0 0) 0x7f2e30156670 con 0x7f2e3006d7f0 2024-08-17T02:26:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.807+0000 7f2e2ea00640 1 --2- 172.21.15.45:0/530794766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e30155a20 0x7f2e300adf10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009910 tx=0x7f2e200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b89d5e49e4bfe9f3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.807+0000 7f2e2e000640 1 -- 172.21.15.45:0/530794766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2002ae40 con 0x7f2e30155a20 2024-08-17T02:26:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.807+0000 7f2e2e000640 1 -- 172.21.15.45:0/530794766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e20032440 con 0x7f2e30155a20 2024-08-17T02:26:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.807+0000 7f2e2e000640 1 -- 172.21.15.45:0/530794766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e200327e0 con 0x7f2e30155a20 2024-08-17T02:26:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.808+0000 7f2e35600640 1 -- 172.21.15.45:0/530794766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e30155a20 msgr2=0x7f2e300adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.808+0000 7f2e35600640 1 --2- 172.21.15.45:0/530794766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e30155a20 0x7f2e300adf10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2e20009910 tx=0x7f2e200091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.808+0000 7f2e35600640 1 -- 172.21.15.45:0/530794766 shutdown_connections 2024-08-17T02:26:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.808+0000 7f2e35600640 1 --2- 172.21.15.45:0/530794766 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e30155df0 0x7f2e300ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.808+0000 7f2e35600640 1 --2- 172.21.15.45:0/530794766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e30155a20 0x7f2e300adf10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.808+0000 7f2e35600640 1 -- 172.21.15.45:0/530794766 >> 172.21.15.45:0/530794766 conn(0x7f2e300cb9b0 msgr2=0x7f2e300cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:10.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.808+0000 7f2e35600640 1 -- 172.21.15.45:0/530794766 shutdown_connections 2024-08-17T02:26:10.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.808+0000 7f2e35600640 1 -- 172.21.15.45:0/530794766 wait complete. 2024-08-17T02:26:10.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.809+0000 7f2e35600640 1 Processor -- start 2024-08-17T02:26:10.810 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.809+0000 7f2e35600640 1 -- start start 2024-08-17T02:26:10.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.810+0000 7f2e35600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e3006d7f0 0x7f2e300ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.810+0000 7f2e35600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e30155a20 0x7f2e301699e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.810+0000 7f2e35600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e30155df0 0x7f2e30069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.811 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.810+0000 7f2e35600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e30169550 con 0x7f2e30155df0 2024-08-17T02:26:10.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.810+0000 7f2e35600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3015c310 con 0x7f2e3006d7f0 2024-08-17T02:26:10.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.810+0000 7f2e35600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e3015c5f0 con 0x7f2e30155a20 2024-08-17T02:26:10.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.811+0000 7f2e2f400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e30155df0 0x7f2e30069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.811+0000 7f2e2f400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e30155df0 0x7f2e30069cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42880/0 (socket says 172.21.15.45:42880) 2024-08-17T02:26:10.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.811+0000 7f2e2f400640 1 -- 172.21.15.45:0/1346072916 learned_addr learned my addr 172.21.15.45:0/1346072916 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:10.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.811+0000 7f2e2ea00640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e3006d7f0 0x7f2e300ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.812 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.811+0000 7f2e27e00640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e30155a20 0x7f2e301699e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.811+0000 7f2e2f400640 1 -- 172.21.15.45:0/1346072916 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e30155a20 msgr2=0x7f2e301699e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.811+0000 7f2e2f400640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e30155a20 0x7f2e301699e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.811+0000 7f2e2f400640 1 -- 172.21.15.45:0/1346072916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e3006d7f0 msgr2=0x7f2e300ab990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.811+0000 7f2e2f400640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e3006d7f0 0x7f2e300ab990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.811+0000 7f2e2f400640 1 -- 172.21.15.45:0/1346072916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e20009450 con 0x7f2e30155df0 2024-08-17T02:26:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.812+0000 7f2e2f400640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e30155df0 0x7f2e30069cf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c960 tx=0x7f2e280016c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.812+0000 7f2e26000640 1 -- 172.21.15.45:0/1346072916 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e28005d60 con 0x7f2e30155df0 2024-08-17T02:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.812+0000 7f2e26000640 1 -- 172.21.15.45:0/1346072916 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e2800a640 con 0x7f2e30155df0 2024-08-17T02:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.812+0000 7f2e35600640 1 -- 172.21.15.45:0/1346072916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e3015c8d0 con 0x7f2e30155df0 2024-08-17T02:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.812+0000 7f2e26000640 1 -- 172.21.15.45:0/1346072916 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e2800aa00 con 0x7f2e30155df0 2024-08-17T02:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.812+0000 7f2e35600640 1 -- 172.21.15.45:0/1346072916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e301691a0 con 0x7f2e30155df0 2024-08-17T02:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.813+0000 7f2e35600640 1 -- 172.21.15.45:0/1346072916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e301696c0 con 0x7f2e30155df0 2024-08-17T02:26:10.814 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.814+0000 7f2e26000640 1 -- 172.21.15.45:0/1346072916 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2e280070f0 con 0x7f2e30155df0 2024-08-17T02:26:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.814+0000 7f2e26000640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2e0c065150 0x7f2e0c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.815+0000 7f2e26000640 1 -- 172.21.15.45:0/1346072916 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2e28082150 con 0x7f2e30155df0 2024-08-17T02:26:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.815+0000 7f2e2ea00640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2e0c065150 0x7f2e0c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:10.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.815+0000 7f2e2ea00640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2e0c065150 0x7f2e0c067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2e20034000 tx=0x7f2e20032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:10.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:10.819+0000 7f2e26000640 1 -- 172.21.15.45:0/1346072916 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2e280502a0 con 0x7f2e30155df0 2024-08-17T02:26:11.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.000+0000 7f2e35600640 1 -- 172.21.15.45:0/1346072916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e30064db0 con 0x7f2e30155df0 2024-08-17T02:26:11.002 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.001+0000 7f2e26000640 1 -- 172.21.15.45:0/1346072916 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15350 (secure 0 0 0) 0x7f2e280538c0 con 0x7f2e30155df0 2024-08-17T02:26:11.002 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:11.002 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":32,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:26:08.189892+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:04.691522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:05.604365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:26:11.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 -- 172.21.15.45:0/1346072916 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2e0c065150 msgr2=0x7f2e0c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2e0c065150 0x7f2e0c067600 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2e20034000 tx=0x7f2e20032000 comp rx=0 tx=0).stop 2024-08-17T02:26:11.004 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 -- 172.21.15.45:0/1346072916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e30155df0 msgr2=0x7f2e30069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e30155df0 0x7f2e30069cf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2e2800c960 tx=0x7f2e280016c0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 -- 172.21.15.45:0/1346072916 shutdown_connections 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2e30155df0 0x7f2e30069cf0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2e0c065150 0x7f2e0c067600 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2e30155a20 0x7f2e301699e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 --2- 172.21.15.45:0/1346072916 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2e3006d7f0 0x7f2e300ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 -- 172.21.15.45:0/1346072916 >> 172.21.15.45:0/1346072916 conn(0x7f2e300cb9b0 msgr2=0x7f2e30158790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 -- 172.21.15.45:0/1346072916 shutdown_connections 2024-08-17T02:26:11.005 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.003+0000 7f2e35600640 1 -- 172.21.15.45:0/1346072916 wait complete. 2024-08-17T02:26:11.020 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-08-17T02:26:11.020 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.171+0000 7f60a9c00640 1 Processor -- start 2024-08-17T02:26:11.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.172+0000 7f60a9c00640 1 -- start start 2024-08-17T02:26:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.173+0000 7f60a9c00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f60a40b0270 0x7f60a41563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.173+0000 7f60a9c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a4158b30 0x7f60a40ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.173+0000 7f60a9c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60a4157690 con 0x7f60a4155900 2024-08-17T02:26:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.173+0000 7f60a9c00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60a4156a80 con 0x7f60a40b0270 2024-08-17T02:26:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.173+0000 7f60a9c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a4156d60 con 0x7f60a4158b30 2024-08-17T02:26:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.173+0000 7f60a3e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f60a4155900 0x7f60a4155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59454/0 (socket says 172.21.15.45:59454) 2024-08-17T02:26:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.173+0000 7f60a3e00640 1 -- 172.21.15.45:0/940515628 learned_addr learned my addr 172.21.15.45:0/940515628 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.173+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649769459 0 0) 0x7f60a4157690 con 0x7f60a4155900 2024-08-17T02:26:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.173+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60880034e0 con 0x7f60a4155900 2024-08-17T02:26:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.173+0000 7f60a9200640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a4158b30 0x7f60a40ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.173+0000 7f609be00640 1 --2- 172.21.15.45:0/940515628 >> v2:172.21.15.169:3300/0 conn(0x7f60a40b0270 0x7f60a41563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4155287236 0 0) 0x7f60880034e0 con 0x7f60a4155900 2024-08-17T02:26:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a4158b30 msgr2=0x7f60a40ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a4158b30 0x7f60a40ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 >> v2:172.21.15.169:3300/0 conn(0x7f60a40b0270 msgr2=0x7f60a41563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 --2- 172.21.15.45:0/940515628 >> v2:172.21.15.169:3300/0 conn(0x7f60a40b0270 0x7f60a41563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4157040 con 0x7f60a4155900 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7f6094001470 con 0x7f60a4155900 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 >> v1:172.21.15.45:6789/0 conn(0x7f60a4155900 legacy=0x7f60a4155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60880039d0 0x7f6088003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a4158b30 0x7f6088004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6088004cc0 0x7f6088005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a4156a80 con 0x7f6088004cc0 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a4156d60 con 0x7f60880039d0 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f608800dbe0 con 0x7f60a4158b30 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a9200640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6088004cc0 0x7f6088005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f60a3e00640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60880039d0 0x7f6088003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.174+0000 7f609be00640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a4158b30 0x7f6088004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.175+0000 7f60a9200640 1 -- 172.21.15.45:0/940515628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a4158b30 msgr2=0x7f6088004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.175+0000 7f60a9200640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a4158b30 0x7f6088004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.175+0000 7f60a9200640 1 -- 172.21.15.45:0/940515628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60880039d0 msgr2=0x7f6088003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.175+0000 7f60a9200640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f60880039d0 0x7f6088003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.175+0000 7f60a9200640 1 -- 172.21.15.45:0/940515628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60880034e0 con 0x7f6088004cc0 2024-08-17T02:26:11.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.176+0000 7f60a9200640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6088004cc0 0x7f6088005130 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f609c00e210 tx=0x7f609c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0997deff7d3ae3f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.176+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c031460 con 0x7f6088004cc0 2024-08-17T02:26:11.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.176+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c00f040 con 0x7f6088004cc0 2024-08-17T02:26:11.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.176+0000 7f60a3400640 1 -- 172.21.15.45:0/940515628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c0317f0 con 0x7f6088004cc0 2024-08-17T02:26:11.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.176+0000 7f60a9c00640 1 -- 172.21.15.45:0/940515628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6088004cc0 msgr2=0x7f6088005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.176+0000 7f60a9c00640 1 --2- 172.21.15.45:0/940515628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6088004cc0 0x7f6088005130 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f609c00e210 tx=0x7f609c00b040 comp rx=0 tx=0).stop 2024-08-17T02:26:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.176+0000 7f60a9200640 1 -- 172.21.15.45:0/940515628 reap_dead start 2024-08-17T02:26:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.177+0000 7f60a9c00640 1 -- 172.21.15.45:0/940515628 shutdown_connections 2024-08-17T02:26:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.177+0000 7f60a9c00640 1 -- 172.21.15.45:0/940515628 >> 172.21.15.45:0/940515628 conn(0x7f60a4067750 msgr2=0x7f60a40cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.177+0000 7f60a9c00640 1 -- 172.21.15.45:0/940515628 shutdown_connections 2024-08-17T02:26:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.177+0000 7f60a9c00640 1 -- 172.21.15.45:0/940515628 wait complete. 2024-08-17T02:26:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.178+0000 7f60a9c00640 1 Processor -- start 2024-08-17T02:26:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.178+0000 7f60a9c00640 1 -- start start 2024-08-17T02:26:11.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.179+0000 7f60a9c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6088004cc0 0x7f60a41402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.179+0000 7f60a9c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60a40ab500 0x7f60a41698d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.179+0000 7f60a9c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a414f7c0 0x7f60a414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.179+0000 7f60a9c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a416a050 con 0x7f60a40ab500 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.179+0000 7f60a9c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60a4150170 con 0x7f6088004cc0 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.179+0000 7f60a9c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60a414b260 con 0x7f60a414f7c0 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.180+0000 7f609be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60a40ab500 0x7f60a41698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.180+0000 7f609be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60a40ab500 0x7f60a41698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42908/0 (socket says 172.21.15.45:42908) 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.180+0000 7f609be00640 1 -- 172.21.15.45:0/1316822748 learned_addr learned my addr 172.21.15.45:0/1316822748 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.180+0000 7f60a3e00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6088004cc0 0x7f60a41402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.180+0000 7f60a9200640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a414f7c0 0x7f60a414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.180+0000 7f609be00640 1 -- 172.21.15.45:0/1316822748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a414f7c0 msgr2=0x7f60a414fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.180+0000 7f609be00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a414f7c0 0x7f60a414fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.180+0000 7f609be00640 1 -- 172.21.15.45:0/1316822748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6088004cc0 msgr2=0x7f60a41402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.180+0000 7f609be00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6088004cc0 0x7f60a41402e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.180+0000 7f609be00640 1 -- 172.21.15.45:0/1316822748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a414b820 con 0x7f60a40ab500 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.180+0000 7f609be00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60a40ab500 0x7f60a41698d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f608c011b40 tx=0x7f608c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.181+0000 7f609b400640 1 -- 172.21.15.45:0/1316822748 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c00fb00 con 0x7f60a40ab500 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.181+0000 7f609b400640 1 -- 172.21.15.45:0/1316822748 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608c00fc60 con 0x7f60a40ab500 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.181+0000 7f60a9c00640 1 -- 172.21.15.45:0/1316822748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a4169e10 con 0x7f60a40ab500 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.181+0000 7f609b400640 1 -- 172.21.15.45:0/1316822748 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608c014440 con 0x7f60a40ab500 2024-08-17T02:26:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.181+0000 7f60a9c00640 1 -- 172.21.15.45:0/1316822748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60a40ab0c0 con 0x7f60a40ab500 2024-08-17T02:26:11.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.182+0000 7f60a9c00640 1 -- 172.21.15.45:0/1316822748 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60a414b9b0 con 0x7f60a40ab500 2024-08-17T02:26:11.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.183+0000 7f609b400640 1 -- 172.21.15.45:0/1316822748 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f608c0147b0 con 0x7f60a40ab500 2024-08-17T02:26:11.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.184+0000 7f609b400640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6080065180 0x7f6080067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.184+0000 7f609b400640 1 -- 172.21.15.45:0/1316822748 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f608c018030 con 0x7f60a40ab500 2024-08-17T02:26:11.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.184+0000 7f60a3e00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6080065180 0x7f6080067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.184+0000 7f60a3e00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6080065180 0x7f6080067630 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6094001200 tx=0x7f6094001e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.188+0000 7f609b400640 1 -- 172.21.15.45:0/1316822748 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f608c054a90 con 0x7f60a40ab500 2024-08-17T02:26:11.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.367+0000 7f60a9c00640 1 -- 172.21.15.45:0/1316822748 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f60a4071050 con 0x7f6080065180 2024-08-17T02:26:11.377 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.376+0000 7f609b400640 1 -- 172.21.15.45:0/1316822748 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288922 (secure 0 0 0) 0x7f60a4071050 con 0x7f6080065180 2024-08-17T02:26:11.380 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:11.382 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:26:11.383 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 -- 172.21.15.45:0/1316822748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6080065180 msgr2=0x7f6080067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6080065180 0x7f6080067630 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6094001200 tx=0x7f6094001e90 comp rx=0 tx=0).stop 2024-08-17T02:26:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 -- 172.21.15.45:0/1316822748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60a40ab500 msgr2=0x7f60a41698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60a40ab500 0x7f60a41698d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f608c011b40 tx=0x7f608c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 -- 172.21.15.45:0/1316822748 shutdown_connections 2024-08-17T02:26:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6080065180 0x7f6080067630 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f60a414f7c0 0x7f60a414fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60a40ab500 0x7f60a41698d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 --2- 172.21.15.45:0/1316822748 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6088004cc0 0x7f60a41402e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 -- 172.21.15.45:0/1316822748 >> 172.21.15.45:0/1316822748 conn(0x7f60a4067750 msgr2=0x7f60a4069b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 -- 172.21.15.45:0/1316822748 shutdown_connections 2024-08-17T02:26:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.380+0000 7f60a9c00640 1 -- 172.21.15.45:0/1316822748 wait complete. 2024-08-17T02:26:11.396 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-08-17T02:26:09.668072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399408,"kb_used_data":3888,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575312,"statfs":{"total":773094113280,"available":770637119488,"internally_reserved":0,"allocated":3981312,"data_stored":2236505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.485550"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.215184+0000","last_change":"2024-08-17T02:26:07.215184+0000","last_active":"2024-08-17T02:26:07.215184+0000","last_peered":"2024-08-17T02:26:07.215184+0000","last_clean":"2024-08-17T02:26:07.215184+0000","last_became_active":"2024-08-17T02:26:07.214953+0000","last_became_peered":"2024-08-17T02:26:07.214953+0000","last_unstale":"2024-08-17T02:26:07.215184+0000","last_undegraded":"2024-08-17T02:26:07.215184+0000","last_fullsized":"2024-08-17T02:26:07.215184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:57.679849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.221506+0000","last_change":"2024-08-17T02:26:07.221506+0000","last_active":"2024-08-17T02:26:07.221506+0000","last_peered":"2024-08-17T02:26:07.221506+0000","last_clean":"2024-08-17T02:26:07.221506+0000","last_became_active":"2024-08-17T02:26:07.220699+0000","last_became_peered":"2024-08-17T02:26:07.220699+0000","last_unstale":"2024-08-17T02:26:07.221506+0000","last_undegraded":"2024-08-17T02:26:07.221506+0000","last_fullsized":"2024-08-17T02:26:07.221506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:33:48.116630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.228394+0000","last_change":"2024-08-17T02:26:07.228394+0000","last_active":"2024-08-17T02:26:07.228394+0000","last_peered":"2024-08-17T02:26:07.228394+0000","last_clean":"2024-08-17T02:26:07.228394+0000","last_became_active":"2024-08-17T02:26:07.228120+0000","last_became_peered":"2024-08-17T02:26:07.228120+0000","last_unstale":"2024-08-17T02:26:07.228394+0000","last_undegraded":"2024-08-17T02:26:07.228394+0000","last_fullsized":"2024-08-17T02:26:07.228394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:33:48.116630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.216610+0000","last_change":"2024-08-17T02:26:07.216610+0000","last_active":"2024-08-17T02:26:07.216610+0000","last_peered":"2024-08-17T02:26:07.216610+0000","last_clean":"2024-08-17T02:26:07.216610+0000","last_became_active":"2024-08-17T02:26:07.212767+0000","last_became_peered":"2024-08-17T02:26:07.212767+0000","last_unstale":"2024-08-17T02:26:07.216610+0000","last_undegraded":"2024-08-17T02:26:07.216610+0000","last_fullsized":"2024-08-17T02:26:07.216610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:03.321036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.207734+0000","last_change":"2024-08-17T02:26:07.207734+0000","last_active":"2024-08-17T02:26:07.207734+0000","last_peered":"2024-08-17T02:26:07.207734+0000","last_clean":"2024-08-17T02:26:07.207734+0000","last_became_active":"2024-08-17T02:26:07.207445+0000","last_became_peered":"2024-08-17T02:26:07.207445+0000","last_unstale":"2024-08-17T02:26:07.207734+0000","last_undegraded":"2024-08-17T02:26:07.207734+0000","last_fullsized":"2024-08-17T02:26:07.207734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:13:34.078537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.219873+0000","last_change":"2024-08-17T02:26:07.219873+0000","last_active":"2024-08-17T02:26:07.219873+0000","last_peered":"2024-08-17T02:26:07.219873+0000","last_clean":"2024-08-17T02:26:07.219873+0000","last_became_active":"2024-08-17T02:26:07.219594+0000","last_became_peered":"2024-08-17T02:26:07.219594+0000","last_unstale":"2024-08-17T02:26:07.219873+0000","last_undegraded":"2024-08-17T02:26:07.219873+0000","last_fullsized":"2024-08-17T02:26:07.219873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:30.687363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.214249+0000","last_change":"2024-08-17T02:26:07.214249+0000","last_active":"2024-08-17T02:26:07.214249+0000","last_peered":"2024-08-17T02:26:07.214249+0000","last_clean":"2024-08-17T02:26:07.214249+0000","last_became_active":"2024-08-17T02:26:07.213978+0000","last_became_peered":"2024-08-17T02:26:07.213978+0000","last_unstale":"2024-08-17T02:26:07.214249+0000","last_undegraded":"2024-08-17T02:26:07.214249+0000","last_fullsized":"2024-08-17T02:26:07.214249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:54.523133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.217378+0000","last_change":"2024-08-17T02:26:07.217378+0000","last_active":"2024-08-17T02:26:07.217378+0000","last_peered":"2024-08-17T02:26:07.217378+0000","last_clean":"2024-08-17T02:26:07.217378+0000","last_became_active":"2024-08-17T02:26:07.217082+0000","last_became_peered":"2024-08-17T02:26:07.217082+0000","last_unstale":"2024-08-17T02:26:07.217378+0000","last_undegraded":"2024-08-17T02:26:07.217378+0000","last_fullsized":"2024-08-17T02:26:07.217378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:30.687363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.222195+0000","last_change":"2024-08-17T02:26:07.222195+0000","last_active":"2024-08-17T02:26:07.222195+0000","last_peered":"2024-08-17T02:26:07.222195+0000","last_clean":"2024-08-17T02:26:07.222195+0000","last_became_active":"2024-08-17T02:26:07.221912+0000","last_became_peered":"2024-08-17T02:26:07.221912+0000","last_unstale":"2024-08-17T02:26:07.222195+0000","last_undegraded":"2024-08-17T02:26:07.222195+0000","last_fullsized":"2024-08-17T02:26:07.222195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:03.321036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.234675+0000","last_change":"2024-08-17T02:26:07.234675+0000","last_active":"2024-08-17T02:26:07.234675+0000","last_peered":"2024-08-17T02:26:07.234675+0000","last_clean":"2024-08-17T02:26:07.234675+0000","last_became_active":"2024-08-17T02:26:07.234414+0000","last_became_peered":"2024-08-17T02:26:07.234414+0000","last_unstale":"2024-08-17T02:26:07.234675+0000","last_undegraded":"2024-08-17T02:26:07.234675+0000","last_fullsized":"2024-08-17T02:26:07.234675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:40:31.952730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.228480+0000","last_change":"2024-08-17T02:26:07.228480+0000","last_active":"2024-08-17T02:26:07.228480+0000","last_peered":"2024-08-17T02:26:07.228480+0000","last_clean":"2024-08-17T02:26:07.228480+0000","last_became_active":"2024-08-17T02:26:07.228129+0000","last_became_peered":"2024-08-17T02:26:07.228129+0000","last_unstale":"2024-08-17T02:26:07.228480+0000","last_undegraded":"2024-08-17T02:26:07.228480+0000","last_fullsized":"2024-08-17T02:26:07.228480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:43.584516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.219144+0000","last_change":"2024-08-17T02:26:07.219144+0000","last_active":"2024-08-17T02:26:07.219144+0000","last_peered":"2024-08-17T02:26:07.219144+0000","last_clean":"2024-08-17T02:26:07.219144+0000","last_became_active":"2024-08-17T02:26:07.216076+0000","last_became_peered":"2024-08-17T02:26:07.216076+0000","last_unstale":"2024-08-17T02:26:07.219144+0000","last_undegraded":"2024-08-17T02:26:07.219144+0000","last_fullsized":"2024-08-17T02:26:07.219144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:11.892494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.223836+0000","last_change":"2024-08-17T02:26:07.223836+0000","last_active":"2024-08-17T02:26:07.223836+0000","last_peered":"2024-08-17T02:26:07.223836+0000","last_clean":"2024-08-17T02:26:07.223836+0000","last_became_active":"2024-08-17T02:26:07.223583+0000","last_became_peered":"2024-08-17T02:26:07.223583+0000","last_unstale":"2024-08-17T02:26:07.223836+0000","last_undegraded":"2024-08-17T02:26:07.223836+0000","last_fullsized":"2024-08-17T02:26:07.223836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:26.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.232613+0000","last_change":"2024-08-17T02:26:07.232613+0000","last_active":"2024-08-17T02:26:07.232613+0000","last_peered":"2024-08-17T02:26:07.232613+0000","last_clean":"2024-08-17T02:26:07.232613+0000","last_became_active":"2024-08-17T02:26:07.232027+0000","last_became_peered":"2024-08-17T02:26:07.232027+0000","last_unstale":"2024-08-17T02:26:07.232613+0000","last_undegraded":"2024-08-17T02:26:07.232613+0000","last_fullsized":"2024-08-17T02:26:07.232613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:10:22.670697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.207180+0000","last_change":"2024-08-17T02:26:07.207180+0000","last_active":"2024-08-17T02:26:07.207180+0000","last_peered":"2024-08-17T02:26:07.207180+0000","last_clean":"2024-08-17T02:26:07.207180+0000","last_became_active":"2024-08-17T02:26:07.206870+0000","last_became_peered":"2024-08-17T02:26:07.206870+0000","last_unstale":"2024-08-17T02:26:07.207180+0000","last_undegraded":"2024-08-17T02:26:07.207180+0000","last_fullsized":"2024-08-17T02:26:07.207180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:44.430002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.226818+0000","last_change":"2024-08-17T02:26:07.226818+0000","last_active":"2024-08-17T02:26:07.226818+0000","last_peered":"2024-08-17T02:26:07.226818+0000","last_clean":"2024-08-17T02:26:07.226818+0000","last_became_active":"2024-08-17T02:26:07.226499+0000","last_became_peered":"2024-08-17T02:26:07.226499+0000","last_unstale":"2024-08-17T02:26:07.226818+0000","last_undegraded":"2024-08-17T02:26:07.226818+0000","last_fullsized":"2024-08-17T02:26:07.226818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:09.394997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.217782+0000","last_change":"2024-08-17T02:26:07.217782+0000","last_active":"2024-08-17T02:26:07.217782+0000","last_peered":"2024-08-17T02:26:07.217782+0000","last_clean":"2024-08-17T02:26:07.217782+0000","last_became_active":"2024-08-17T02:26:07.217514+0000","last_became_peered":"2024-08-17T02:26:07.217514+0000","last_unstale":"2024-08-17T02:26:07.217782+0000","last_undegraded":"2024-08-17T02:26:07.217782+0000","last_fullsized":"2024-08-17T02:26:07.217782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:11.892494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.234791+0000","last_change":"2024-08-17T02:26:07.234791+0000","last_active":"2024-08-17T02:26:07.234791+0000","last_peered":"2024-08-17T02:26:07.234791+0000","last_clean":"2024-08-17T02:26:07.234791+0000","last_became_active":"2024-08-17T02:26:07.234416+0000","last_became_peered":"2024-08-17T02:26:07.234416+0000","last_unstale":"2024-08-17T02:26:07.234791+0000","last_undegraded":"2024-08-17T02:26:07.234791+0000","last_fullsized":"2024-08-17T02:26:07.234791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:09.394997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.236483+0000","last_change":"2024-08-17T02:26:07.236483+0000","last_active":"2024-08-17T02:26:07.236483+0000","last_peered":"2024-08-17T02:26:07.236483+0000","last_clean":"2024-08-17T02:26:07.236483+0000","last_became_active":"2024-08-17T02:26:07.234686+0000","last_became_peered":"2024-08-17T02:26:07.234686+0000","last_unstale":"2024-08-17T02:26:07.236483+0000","last_undegraded":"2024-08-17T02:26:07.236483+0000","last_fullsized":"2024-08-17T02:26:07.236483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:08.200210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.201164+0000","last_change":"2024-08-17T02:26:07.201164+0000","last_active":"2024-08-17T02:26:07.201164+0000","last_peered":"2024-08-17T02:26:07.201164+0000","last_clean":"2024-08-17T02:26:07.201164+0000","last_became_active":"2024-08-17T02:26:07.200895+0000","last_became_peered":"2024-08-17T02:26:07.200895+0000","last_unstale":"2024-08-17T02:26:07.201164+0000","last_undegraded":"2024-08-17T02:26:07.201164+0000","last_fullsized":"2024-08-17T02:26:07.201164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:23.314496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.211907+0000","last_change":"2024-08-17T02:26:07.211907+0000","last_active":"2024-08-17T02:26:07.211907+0000","last_peered":"2024-08-17T02:26:07.211907+0000","last_clean":"2024-08-17T02:26:07.211907+0000","last_became_active":"2024-08-17T02:26:07.211611+0000","last_became_peered":"2024-08-17T02:26:07.211611+0000","last_unstale":"2024-08-17T02:26:07.211907+0000","last_undegraded":"2024-08-17T02:26:07.211907+0000","last_fullsized":"2024-08-17T02:26:07.211907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:08.776031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.225464+0000","last_change":"2024-08-17T02:26:07.225464+0000","last_active":"2024-08-17T02:26:07.225464+0000","last_peered":"2024-08-17T02:26:07.225464+0000","last_clean":"2024-08-17T02:26:07.225464+0000","last_became_active":"2024-08-17T02:26:07.225196+0000","last_became_peered":"2024-08-17T02:26:07.225196+0000","last_unstale":"2024-08-17T02:26:07.225464+0000","last_undegraded":"2024-08-17T02:26:07.225464+0000","last_fullsized":"2024-08-17T02:26:07.225464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:17:24.045737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.209958+0000","last_change":"2024-08-17T02:26:07.209958+0000","last_active":"2024-08-17T02:26:07.209958+0000","last_peered":"2024-08-17T02:26:07.209958+0000","last_clean":"2024-08-17T02:26:07.209958+0000","last_became_active":"2024-08-17T02:26:07.209703+0000","last_became_peered":"2024-08-17T02:26:07.209703+0000","last_unstale":"2024-08-17T02:26:07.209958+0000","last_undegraded":"2024-08-17T02:26:07.209958+0000","last_fullsized":"2024-08-17T02:26:07.209958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:56.126788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.200867+0000","last_change":"2024-08-17T02:26:07.200867+0000","last_active":"2024-08-17T02:26:07.200867+0000","last_peered":"2024-08-17T02:26:07.200867+0000","last_clean":"2024-08-17T02:26:07.200867+0000","last_became_active":"2024-08-17T02:26:07.200619+0000","last_became_peered":"2024-08-17T02:26:07.200619+0000","last_unstale":"2024-08-17T02:26:07.200867+0000","last_undegraded":"2024-08-17T02:26:07.200867+0000","last_fullsized":"2024-08-17T02:26:07.200867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:54.523133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.222134+0000","last_change":"2024-08-17T02:26:07.222134+0000","last_active":"2024-08-17T02:26:07.222134+0000","last_peered":"2024-08-17T02:26:07.222134+0000","last_clean":"2024-08-17T02:26:07.222134+0000","last_became_active":"2024-08-17T02:26:07.221465+0000","last_became_peered":"2024-08-17T02:26:07.221465+0000","last_unstale":"2024-08-17T02:26:07.222134+0000","last_undegraded":"2024-08-17T02:26:07.222134+0000","last_fullsized":"2024-08-17T02:26:07.222134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:54.523133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.228618+0000","last_change":"2024-08-17T02:26:07.228618+0000","last_active":"2024-08-17T02:26:07.228618+0000","last_peered":"2024-08-17T02:26:07.228618+0000","last_clean":"2024-08-17T02:26:07.228618+0000","last_became_active":"2024-08-17T02:26:07.228378+0000","last_became_peered":"2024-08-17T02:26:07.228378+0000","last_unstale":"2024-08-17T02:26:07.228618+0000","last_undegraded":"2024-08-17T02:26:07.228618+0000","last_fullsized":"2024-08-17T02:26:07.228618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:43.584516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.230632+0000","last_change":"2024-08-17T02:26:07.230632+0000","last_active":"2024-08-17T02:26:07.230632+0000","last_peered":"2024-08-17T02:26:07.230632+0000","last_clean":"2024-08-17T02:26:07.230632+0000","last_became_active":"2024-08-17T02:26:07.229377+0000","last_became_peered":"2024-08-17T02:26:07.229377+0000","last_unstale":"2024-08-17T02:26:07.230632+0000","last_undegraded":"2024-08-17T02:26:07.230632+0000","last_fullsized":"2024-08-17T02:26:07.230632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:10:22.670697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.215030+0000","last_change":"2024-08-17T02:26:07.215030+0000","last_active":"2024-08-17T02:26:07.215030+0000","last_peered":"2024-08-17T02:26:07.215030+0000","last_clean":"2024-08-17T02:26:07.215030+0000","last_became_active":"2024-08-17T02:26:07.214631+0000","last_became_peered":"2024-08-17T02:26:07.214631+0000","last_unstale":"2024-08-17T02:26:07.215030+0000","last_undegraded":"2024-08-17T02:26:07.215030+0000","last_fullsized":"2024-08-17T02:26:07.215030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:03.321036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.210116+0000","last_change":"2024-08-17T02:26:07.210116+0000","last_active":"2024-08-17T02:26:07.210116+0000","last_peered":"2024-08-17T02:26:07.210116+0000","last_clean":"2024-08-17T02:26:07.210116+0000","last_became_active":"2024-08-17T02:26:07.209853+0000","last_became_peered":"2024-08-17T02:26:07.209853+0000","last_unstale":"2024-08-17T02:26:07.210116+0000","last_undegraded":"2024-08-17T02:26:07.210116+0000","last_fullsized":"2024-08-17T02:26:07.210116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:16.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.215863+0000","last_change":"2024-08-17T02:26:07.215863+0000","last_active":"2024-08-17T02:26:07.215863+0000","last_peered":"2024-08-17T02:26:07.215863+0000","last_clean":"2024-08-17T02:26:07.215863+0000","last_became_active":"2024-08-17T02:26:07.215598+0000","last_became_peered":"2024-08-17T02:26:07.215598+0000","last_unstale":"2024-08-17T02:26:07.215863+0000","last_undegraded":"2024-08-17T02:26:07.215863+0000","last_fullsized":"2024-08-17T02:26:07.215863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:33:48.116630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.219873+0000","last_change":"2024-08-17T02:26:07.219873+0000","last_active":"2024-08-17T02:26:07.219873+0000","last_peered":"2024-08-17T02:26:07.219873+0000","last_clean":"2024-08-17T02:26:07.219873+0000","last_became_active":"2024-08-17T02:26:07.219625+0000","last_became_peered":"2024-08-17T02:26:07.219625+0000","last_unstale":"2024-08-17T02:26:07.219873+0000","last_undegraded":"2024-08-17T02:26:07.219873+0000","last_fullsized":"2024-08-17T02:26:07.219873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:56.126788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.208691+0000","last_change":"2024-08-17T02:26:07.208691+0000","last_active":"2024-08-17T02:26:07.208691+0000","last_peered":"2024-08-17T02:26:07.208691+0000","last_clean":"2024-08-17T02:26:07.208691+0000","last_became_active":"2024-08-17T02:26:07.208418+0000","last_became_peered":"2024-08-17T02:26:07.208418+0000","last_unstale":"2024-08-17T02:26:07.208691+0000","last_undegraded":"2024-08-17T02:26:07.208691+0000","last_fullsized":"2024-08-17T02:26:07.208691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.818972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.208463+0000","last_change":"2024-08-17T02:26:07.208463+0000","last_active":"2024-08-17T02:26:07.208463+0000","last_peered":"2024-08-17T02:26:07.208463+0000","last_clean":"2024-08-17T02:26:07.208463+0000","last_became_active":"2024-08-17T02:26:07.208204+0000","last_became_peered":"2024-08-17T02:26:07.208204+0000","last_unstale":"2024-08-17T02:26:07.208463+0000","last_undegraded":"2024-08-17T02:26:07.208463+0000","last_fullsized":"2024-08-17T02:26:07.208463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:57.679849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.223680+0000","last_change":"2024-08-17T02:26:06.207170+0000","last_active":"2024-08-17T02:26:07.223680+0000","last_peered":"2024-08-17T02:26:07.223680+0000","last_clean":"2024-08-17T02:26:07.223680+0000","last_became_active":"2024-08-17T02:26:06.206919+0000","last_became_peered":"2024-08-17T02:26:06.206919+0000","last_unstale":"2024-08-17T02:26:07.223680+0000","last_undegraded":"2024-08-17T02:26:07.223680+0000","last_fullsized":"2024-08-17T02:26:07.223680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:28.410715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.206410+0000","last_change":"2024-08-17T02:26:07.206410+0000","last_active":"2024-08-17T02:26:07.206410+0000","last_peered":"2024-08-17T02:26:07.206410+0000","last_clean":"2024-08-17T02:26:07.206410+0000","last_became_active":"2024-08-17T02:26:07.205635+0000","last_became_peered":"2024-08-17T02:26:07.205635+0000","last_unstale":"2024-08-17T02:26:07.206410+0000","last_undegraded":"2024-08-17T02:26:07.206410+0000","last_fullsized":"2024-08-17T02:26:07.206410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:08.776031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.206421+0000","last_change":"2024-08-17T02:26:06.212172+0000","last_active":"2024-08-17T02:26:07.206421+0000","last_peered":"2024-08-17T02:26:07.206421+0000","last_clean":"2024-08-17T02:26:07.206421+0000","last_became_active":"2024-08-17T02:26:06.211853+0000","last_became_peered":"2024-08-17T02:26:06.211853+0000","last_unstale":"2024-08-17T02:26:07.206421+0000","last_undegraded":"2024-08-17T02:26:07.206421+0000","last_fullsized":"2024-08-17T02:26:07.206421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:28.410715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.225451+0000","last_change":"2024-08-17T02:26:07.225451+0000","last_active":"2024-08-17T02:26:07.225451+0000","last_peered":"2024-08-17T02:26:07.225451+0000","last_clean":"2024-08-17T02:26:07.225451+0000","last_became_active":"2024-08-17T02:26:07.225161+0000","last_became_peered":"2024-08-17T02:26:07.225161+0000","last_unstale":"2024-08-17T02:26:07.225451+0000","last_undegraded":"2024-08-17T02:26:07.225451+0000","last_fullsized":"2024-08-17T02:26:07.225451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:57.679849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.234581+0000","last_change":"2024-08-17T02:26:06.215516+0000","last_active":"2024-08-17T02:26:07.234581+0000","last_peered":"2024-08-17T02:26:07.234581+0000","last_clean":"2024-08-17T02:26:07.234581+0000","last_became_active":"2024-08-17T02:26:06.215255+0000","last_became_peered":"2024-08-17T02:26:06.215255+0000","last_unstale":"2024-08-17T02:26:07.234581+0000","last_undegraded":"2024-08-17T02:26:07.234581+0000","last_fullsized":"2024-08-17T02:26:07.234581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:55.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.224841+0000","last_change":"2024-08-17T02:26:07.224841+0000","last_active":"2024-08-17T02:26:07.224841+0000","last_peered":"2024-08-17T02:26:07.224841+0000","last_clean":"2024-08-17T02:26:07.224841+0000","last_became_active":"2024-08-17T02:26:07.224307+0000","last_became_peered":"2024-08-17T02:26:07.224307+0000","last_unstale":"2024-08-17T02:26:07.224841+0000","last_undegraded":"2024-08-17T02:26:07.224841+0000","last_fullsized":"2024-08-17T02:26:07.224841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:44.430002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.232264+0000","last_change":"2024-08-17T02:26:06.212258+0000","last_active":"2024-08-17T02:26:07.232264+0000","last_peered":"2024-08-17T02:26:07.232264+0000","last_clean":"2024-08-17T02:26:07.232264+0000","last_became_active":"2024-08-17T02:26:06.211872+0000","last_became_peered":"2024-08-17T02:26:06.211872+0000","last_unstale":"2024-08-17T02:26:07.232264+0000","last_undegraded":"2024-08-17T02:26:07.232264+0000","last_fullsized":"2024-08-17T02:26:07.232264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:30.712426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.209019+0000","last_change":"2024-08-17T02:26:07.209019+0000","last_active":"2024-08-17T02:26:07.209019+0000","last_peered":"2024-08-17T02:26:07.209019+0000","last_clean":"2024-08-17T02:26:07.209019+0000","last_became_active":"2024-08-17T02:26:07.208772+0000","last_became_peered":"2024-08-17T02:26:07.208772+0000","last_unstale":"2024-08-17T02:26:07.209019+0000","last_undegraded":"2024-08-17T02:26:07.209019+0000","last_fullsized":"2024-08-17T02:26:07.209019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:08.066259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.200812+0000","last_change":"2024-08-17T02:26:06.208387+0000","last_active":"2024-08-17T02:26:07.200812+0000","last_peered":"2024-08-17T02:26:07.200812+0000","last_clean":"2024-08-17T02:26:07.200812+0000","last_became_active":"2024-08-17T02:26:06.208166+0000","last_became_peered":"2024-08-17T02:26:06.208166+0000","last_unstale":"2024-08-17T02:26:07.200812+0000","last_undegraded":"2024-08-17T02:26:07.200812+0000","last_fullsized":"2024-08-17T02:26:07.200812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:03.847541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.215783+0000","last_change":"2024-08-17T02:26:07.215783+0000","last_active":"2024-08-17T02:26:07.215783+0000","last_peered":"2024-08-17T02:26:07.215783+0000","last_clean":"2024-08-17T02:26:07.215783+0000","last_became_active":"2024-08-17T02:26:07.214821+0000","last_became_peered":"2024-08-17T02:26:07.214821+0000","last_unstale":"2024-08-17T02:26:07.215783+0000","last_undegraded":"2024-08-17T02:26:07.215783+0000","last_fullsized":"2024-08-17T02:26:07.215783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:10:22.670697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.200313+0000","last_change":"2024-08-17T02:26:06.210960+0000","last_active":"2024-08-17T02:26:07.200313+0000","last_peered":"2024-08-17T02:26:07.200313+0000","last_clean":"2024-08-17T02:26:07.200313+0000","last_became_active":"2024-08-17T02:26:06.210697+0000","last_became_peered":"2024-08-17T02:26:06.210697+0000","last_unstale":"2024-08-17T02:26:07.200313+0000","last_undegraded":"2024-08-17T02:26:07.200313+0000","last_fullsized":"2024-08-17T02:26:07.200313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:22.702948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.213960+0000","last_change":"2024-08-17T02:26:07.213960+0000","last_active":"2024-08-17T02:26:07.213960+0000","last_peered":"2024-08-17T02:26:07.213960+0000","last_clean":"2024-08-17T02:26:07.213960+0000","last_became_active":"2024-08-17T02:26:07.213067+0000","last_became_peered":"2024-08-17T02:26:07.213067+0000","last_unstale":"2024-08-17T02:26:07.213960+0000","last_undegraded":"2024-08-17T02:26:07.213960+0000","last_fullsized":"2024-08-17T02:26:07.213960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:58.572216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.210463+0000","last_change":"2024-08-17T02:26:06.208749+0000","last_active":"2024-08-17T02:26:06.210463+0000","last_peered":"2024-08-17T02:26:06.210463+0000","last_clean":"2024-08-17T02:26:06.210463+0000","last_became_active":"2024-08-17T02:26:06.206558+0000","last_became_peered":"2024-08-17T02:26:06.206558+0000","last_unstale":"2024-08-17T02:26:06.210463+0000","last_undegraded":"2024-08-17T02:26:06.210463+0000","last_fullsized":"2024-08-17T02:26:06.210463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:25.993154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.221108+0000","last_change":"2024-08-17T02:26:07.221108+0000","last_active":"2024-08-17T02:26:07.221108+0000","last_peered":"2024-08-17T02:26:07.221108+0000","last_clean":"2024-08-17T02:26:07.221108+0000","last_became_active":"2024-08-17T02:26:07.220802+0000","last_became_peered":"2024-08-17T02:26:07.220802+0000","last_unstale":"2024-08-17T02:26:07.221108+0000","last_undegraded":"2024-08-17T02:26:07.221108+0000","last_fullsized":"2024-08-17T02:26:07.221108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:08.776031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.210675+0000","last_change":"2024-08-17T02:26:06.206448+0000","last_active":"2024-08-17T02:26:06.210675+0000","last_peered":"2024-08-17T02:26:06.210675+0000","last_clean":"2024-08-17T02:26:06.210675+0000","last_became_active":"2024-08-17T02:26:06.206200+0000","last_became_peered":"2024-08-17T02:26:06.206200+0000","last_unstale":"2024-08-17T02:26:06.210675+0000","last_undegraded":"2024-08-17T02:26:06.210675+0000","last_fullsized":"2024-08-17T02:26:06.210675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:58.769776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.229548+0000","last_change":"2024-08-17T02:26:07.229548+0000","last_active":"2024-08-17T02:26:07.229548+0000","last_peered":"2024-08-17T02:26:07.229548+0000","last_clean":"2024-08-17T02:26:07.229548+0000","last_became_active":"2024-08-17T02:26:07.229255+0000","last_became_peered":"2024-08-17T02:26:07.229255+0000","last_unstale":"2024-08-17T02:26:07.229548+0000","last_undegraded":"2024-08-17T02:26:07.229548+0000","last_fullsized":"2024-08-17T02:26:07.229548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:50.673521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.219493+0000","last_change":"2024-08-17T02:26:06.218314+0000","last_active":"2024-08-17T02:26:06.219493+0000","last_peered":"2024-08-17T02:26:06.219493+0000","last_clean":"2024-08-17T02:26:06.219493+0000","last_became_active":"2024-08-17T02:26:06.218055+0000","last_became_peered":"2024-08-17T02:26:06.218055+0000","last_unstale":"2024-08-17T02:26:06.219493+0000","last_undegraded":"2024-08-17T02:26:06.219493+0000","last_fullsized":"2024-08-17T02:26:06.219493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:41.153882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.234675+0000","last_change":"2024-08-17T02:26:07.234675+0000","last_active":"2024-08-17T02:26:07.234675+0000","last_peered":"2024-08-17T02:26:07.234675+0000","last_clean":"2024-08-17T02:26:07.234675+0000","last_became_active":"2024-08-17T02:26:07.234397+0000","last_became_peered":"2024-08-17T02:26:07.234397+0000","last_unstale":"2024-08-17T02:26:07.234675+0000","last_undegraded":"2024-08-17T02:26:07.234675+0000","last_fullsized":"2024-08-17T02:26:07.234675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.214807+0000","last_change":"2024-08-17T02:26:06.210177+0000","last_active":"2024-08-17T02:26:06.214807+0000","last_peered":"2024-08-17T02:26:06.214807+0000","last_clean":"2024-08-17T02:26:06.214807+0000","last_became_active":"2024-08-17T02:26:06.208911+0000","last_became_peered":"2024-08-17T02:26:06.208911+0000","last_unstale":"2024-08-17T02:26:06.214807+0000","last_undegraded":"2024-08-17T02:26:06.214807+0000","last_fullsized":"2024-08-17T02:26:06.214807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:22.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.233472+0000","last_change":"2024-08-17T02:26:07.233472+0000","last_active":"2024-08-17T02:26:07.233472+0000","last_peered":"2024-08-17T02:26:07.233472+0000","last_clean":"2024-08-17T02:26:07.233472+0000","last_became_active":"2024-08-17T02:26:07.228862+0000","last_became_peered":"2024-08-17T02:26:07.228862+0000","last_unstale":"2024-08-17T02:26:07.233472+0000","last_undegraded":"2024-08-17T02:26:07.233472+0000","last_fullsized":"2024-08-17T02:26:07.233472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:08.066259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.223978+0000","last_change":"2024-08-17T02:26:06.215581+0000","last_active":"2024-08-17T02:26:07.223978+0000","last_peered":"2024-08-17T02:26:07.223978+0000","last_clean":"2024-08-17T02:26:07.223978+0000","last_became_active":"2024-08-17T02:26:06.215307+0000","last_became_peered":"2024-08-17T02:26:06.215307+0000","last_unstale":"2024-08-17T02:26:07.223978+0000","last_undegraded":"2024-08-17T02:26:07.223978+0000","last_fullsized":"2024-08-17T02:26:07.223978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:25.993154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.228481+0000","last_change":"2024-08-17T02:26:07.228481+0000","last_active":"2024-08-17T02:26:07.228481+0000","last_peered":"2024-08-17T02:26:07.228481+0000","last_clean":"2024-08-17T02:26:07.228481+0000","last_became_active":"2024-08-17T02:26:07.228154+0000","last_became_peered":"2024-08-17T02:26:07.228154+0000","last_unstale":"2024-08-17T02:26:07.228481+0000","last_undegraded":"2024-08-17T02:26:07.228481+0000","last_fullsized":"2024-08-17T02:26:07.228481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:30.687363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.237517+0000","last_change":"2024-08-17T02:26:06.213409+0000","last_active":"2024-08-17T02:26:07.237517+0000","last_peered":"2024-08-17T02:26:07.237517+0000","last_clean":"2024-08-17T02:26:07.237517+0000","last_became_active":"2024-08-17T02:26:06.213119+0000","last_became_peered":"2024-08-17T02:26:06.213119+0000","last_unstale":"2024-08-17T02:26:07.237517+0000","last_undegraded":"2024-08-17T02:26:07.237517+0000","last_fullsized":"2024-08-17T02:26:07.237517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:27.365457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.221181+0000","last_change":"2024-08-17T02:26:07.221181+0000","last_active":"2024-08-17T02:26:07.221181+0000","last_peered":"2024-08-17T02:26:07.221181+0000","last_clean":"2024-08-17T02:26:07.221181+0000","last_became_active":"2024-08-17T02:26:07.220901+0000","last_became_peered":"2024-08-17T02:26:07.220901+0000","last_unstale":"2024-08-17T02:26:07.221181+0000","last_undegraded":"2024-08-17T02:26:07.221181+0000","last_fullsized":"2024-08-17T02:26:07.221181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:17:24.045737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.225788+0000","last_change":"2024-08-17T02:26:06.209140+0000","last_active":"2024-08-17T02:26:07.225788+0000","last_peered":"2024-08-17T02:26:07.225788+0000","last_clean":"2024-08-17T02:26:07.225788+0000","last_became_active":"2024-08-17T02:26:06.207013+0000","last_became_peered":"2024-08-17T02:26:06.207013+0000","last_unstale":"2024-08-17T02:26:07.225788+0000","last_undegraded":"2024-08-17T02:26:07.225788+0000","last_fullsized":"2024-08-17T02:26:07.225788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:18.073413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.230677+0000","last_change":"2024-08-17T02:26:07.230677+0000","last_active":"2024-08-17T02:26:07.230677+0000","last_peered":"2024-08-17T02:26:07.230677+0000","last_clean":"2024-08-17T02:26:07.230677+0000","last_became_active":"2024-08-17T02:26:07.227917+0000","last_became_peered":"2024-08-17T02:26:07.227917+0000","last_unstale":"2024-08-17T02:26:07.230677+0000","last_undegraded":"2024-08-17T02:26:07.230677+0000","last_fullsized":"2024-08-17T02:26:07.230677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:44.430002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.213911+0000","last_change":"2024-08-17T02:26:06.210132+0000","last_active":"2024-08-17T02:26:06.213911+0000","last_peered":"2024-08-17T02:26:06.213911+0000","last_clean":"2024-08-17T02:26:06.213911+0000","last_became_active":"2024-08-17T02:26:06.209408+0000","last_became_peered":"2024-08-17T02:26:06.209408+0000","last_unstale":"2024-08-17T02:26:06.213911+0000","last_undegraded":"2024-08-17T02:26:06.213911+0000","last_fullsized":"2024-08-17T02:26:06.213911+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:08:11.655491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.212201+0000","last_change":"2024-08-17T02:26:07.212201+0000","last_active":"2024-08-17T02:26:07.212201+0000","last_peered":"2024-08-17T02:26:07.212201+0000","last_clean":"2024-08-17T02:26:07.212201+0000","last_became_active":"2024-08-17T02:26:07.207913+0000","last_became_peered":"2024-08-17T02:26:07.207913+0000","last_unstale":"2024-08-17T02:26:07.212201+0000","last_undegraded":"2024-08-17T02:26:07.212201+0000","last_fullsized":"2024-08-17T02:26:07.212201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.219683+0000","last_change":"2024-08-17T02:26:06.218562+0000","last_active":"2024-08-17T02:26:06.219683+0000","last_peered":"2024-08-17T02:26:06.219683+0000","last_clean":"2024-08-17T02:26:06.219683+0000","last_became_active":"2024-08-17T02:26:06.218283+0000","last_became_peered":"2024-08-17T02:26:06.218283+0000","last_unstale":"2024-08-17T02:26:06.219683+0000","last_undegraded":"2024-08-17T02:26:06.219683+0000","last_fullsized":"2024-08-17T02:26:06.219683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:13:33.072308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.206564+0000","last_change":"2024-08-17T02:26:07.206564+0000","last_active":"2024-08-17T02:26:07.206564+0000","last_peered":"2024-08-17T02:26:07.206564+0000","last_clean":"2024-08-17T02:26:07.206564+0000","last_became_active":"2024-08-17T02:26:07.206281+0000","last_became_peered":"2024-08-17T02:26:07.206281+0000","last_unstale":"2024-08-17T02:26:07.206564+0000","last_undegraded":"2024-08-17T02:26:07.206564+0000","last_fullsized":"2024-08-17T02:26:07.206564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:17:24.045737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.238315+0000","last_change":"2024-08-17T02:26:06.213047+0000","last_active":"2024-08-17T02:26:07.238315+0000","last_peered":"2024-08-17T02:26:07.238315+0000","last_clean":"2024-08-17T02:26:07.238315+0000","last_became_active":"2024-08-17T02:26:06.212767+0000","last_became_peered":"2024-08-17T02:26:06.212767+0000","last_unstale":"2024-08-17T02:26:07.238315+0000","last_undegraded":"2024-08-17T02:26:07.238315+0000","last_fullsized":"2024-08-17T02:26:07.238315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:29.737941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.208162+0000","last_change":"2024-08-17T02:26:07.208162+0000","last_active":"2024-08-17T02:26:07.208162+0000","last_peered":"2024-08-17T02:26:07.208162+0000","last_clean":"2024-08-17T02:26:07.208162+0000","last_became_active":"2024-08-17T02:26:07.207898+0000","last_became_peered":"2024-08-17T02:26:07.207898+0000","last_unstale":"2024-08-17T02:26:07.208162+0000","last_undegraded":"2024-08-17T02:26:07.208162+0000","last_fullsized":"2024-08-17T02:26:07.208162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:57.134550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.209752+0000","last_change":"2024-08-17T02:26:06.216282+0000","last_active":"2024-08-17T02:26:07.209752+0000","last_peered":"2024-08-17T02:26:07.209752+0000","last_clean":"2024-08-17T02:26:07.209752+0000","last_became_active":"2024-08-17T02:26:06.215974+0000","last_became_peered":"2024-08-17T02:26:06.215974+0000","last_unstale":"2024-08-17T02:26:07.209752+0000","last_undegraded":"2024-08-17T02:26:07.209752+0000","last_fullsized":"2024-08-17T02:26:07.209752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:41.153882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.206100+0000","last_change":"2024-08-17T02:26:07.206100+0000","last_active":"2024-08-17T02:26:07.206100+0000","last_peered":"2024-08-17T02:26:07.206100+0000","last_clean":"2024-08-17T02:26:07.206100+0000","last_became_active":"2024-08-17T02:26:07.205856+0000","last_became_peered":"2024-08-17T02:26:07.205856+0000","last_unstale":"2024-08-17T02:26:07.206100+0000","last_undegraded":"2024-08-17T02:26:07.206100+0000","last_fullsized":"2024-08-17T02:26:07.206100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:40:31.952730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.226073+0000","last_change":"2024-08-17T02:26:06.207822+0000","last_active":"2024-08-17T02:26:07.226073+0000","last_peered":"2024-08-17T02:26:07.226073+0000","last_clean":"2024-08-17T02:26:07.226073+0000","last_became_active":"2024-08-17T02:26:06.207526+0000","last_became_peered":"2024-08-17T02:26:06.207526+0000","last_unstale":"2024-08-17T02:26:07.226073+0000","last_undegraded":"2024-08-17T02:26:07.226073+0000","last_fullsized":"2024-08-17T02:26:07.226073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:34.186776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.213006+0000","last_change":"2024-08-17T02:26:07.213006+0000","last_active":"2024-08-17T02:26:07.213006+0000","last_peered":"2024-08-17T02:26:07.213006+0000","last_clean":"2024-08-17T02:26:07.213006+0000","last_became_active":"2024-08-17T02:26:07.212418+0000","last_became_peered":"2024-08-17T02:26:07.212418+0000","last_unstale":"2024-08-17T02:26:07.213006+0000","last_undegraded":"2024-08-17T02:26:07.213006+0000","last_fullsized":"2024-08-17T02:26:07.213006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:57.134550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.201766+0000","last_change":"2024-08-17T02:26:06.210028+0000","last_active":"2024-08-17T02:26:07.201766+0000","last_peered":"2024-08-17T02:26:07.201766+0000","last_clean":"2024-08-17T02:26:07.201766+0000","last_became_active":"2024-08-17T02:26:06.208858+0000","last_became_peered":"2024-08-17T02:26:06.208858+0000","last_unstale":"2024-08-17T02:26:07.201766+0000","last_undegraded":"2024-08-17T02:26:07.201766+0000","last_fullsized":"2024-08-17T02:26:07.201766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:54.398057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.211737+0000","last_change":"2024-08-17T02:26:07.211737+0000","last_active":"2024-08-17T02:26:07.211737+0000","last_peered":"2024-08-17T02:26:07.211737+0000","last_clean":"2024-08-17T02:26:07.211737+0000","last_became_active":"2024-08-17T02:26:07.211463+0000","last_became_peered":"2024-08-17T02:26:07.211463+0000","last_unstale":"2024-08-17T02:26:07.211737+0000","last_undegraded":"2024-08-17T02:26:07.211737+0000","last_fullsized":"2024-08-17T02:26:07.211737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:30.744169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.210747+0000","last_change":"2024-08-17T02:26:06.207079+0000","last_active":"2024-08-17T02:26:06.210747+0000","last_peered":"2024-08-17T02:26:06.210747+0000","last_clean":"2024-08-17T02:26:06.210747+0000","last_became_active":"2024-08-17T02:26:06.206695+0000","last_became_peered":"2024-08-17T02:26:06.206695+0000","last_unstale":"2024-08-17T02:26:06.210747+0000","last_undegraded":"2024-08-17T02:26:06.210747+0000","last_fullsized":"2024-08-17T02:26:06.210747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:29:26.454627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.203494+0000","last_change":"2024-08-17T02:26:07.203494+0000","last_active":"2024-08-17T02:26:07.203494+0000","last_peered":"2024-08-17T02:26:07.203494+0000","last_clean":"2024-08-17T02:26:07.203494+0000","last_became_active":"2024-08-17T02:26:07.203144+0000","last_became_peered":"2024-08-17T02:26:07.203144+0000","last_unstale":"2024-08-17T02:26:07.203494+0000","last_undegraded":"2024-08-17T02:26:07.203494+0000","last_fullsized":"2024-08-17T02:26:07.203494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:42.160110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.225541+0000","last_change":"2024-08-17T02:26:06.215253+0000","last_active":"2024-08-17T02:26:07.225541+0000","last_peered":"2024-08-17T02:26:07.225541+0000","last_clean":"2024-08-17T02:26:07.225541+0000","last_became_active":"2024-08-17T02:26:06.213063+0000","last_became_peered":"2024-08-17T02:26:06.213063+0000","last_unstale":"2024-08-17T02:26:07.225541+0000","last_undegraded":"2024-08-17T02:26:07.225541+0000","last_fullsized":"2024-08-17T02:26:07.225541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:03.847541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.216818+0000","last_change":"2024-08-17T02:26:07.216818+0000","last_active":"2024-08-17T02:26:07.216818+0000","last_peered":"2024-08-17T02:26:07.216818+0000","last_clean":"2024-08-17T02:26:07.216818+0000","last_became_active":"2024-08-17T02:26:07.216573+0000","last_became_peered":"2024-08-17T02:26:07.216573+0000","last_unstale":"2024-08-17T02:26:07.216818+0000","last_undegraded":"2024-08-17T02:26:07.216818+0000","last_fullsized":"2024-08-17T02:26:07.216818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:32.034736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.213932+0000","last_change":"2024-08-17T02:26:06.213079+0000","last_active":"2024-08-17T02:26:06.213932+0000","last_peered":"2024-08-17T02:26:06.213932+0000","last_clean":"2024-08-17T02:26:06.213932+0000","last_became_active":"2024-08-17T02:26:06.212858+0000","last_became_peered":"2024-08-17T02:26:06.212858+0000","last_unstale":"2024-08-17T02:26:06.213932+0000","last_undegraded":"2024-08-17T02:26:06.213932+0000","last_fullsized":"2024-08-17T02:26:06.213932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:22.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.213514+0000","last_change":"2024-08-17T02:26:07.213514+0000","last_active":"2024-08-17T02:26:07.213514+0000","last_peered":"2024-08-17T02:26:07.213514+0000","last_clean":"2024-08-17T02:26:07.213514+0000","last_became_active":"2024-08-17T02:26:07.213238+0000","last_became_peered":"2024-08-17T02:26:07.213238+0000","last_unstale":"2024-08-17T02:26:07.213514+0000","last_undegraded":"2024-08-17T02:26:07.213514+0000","last_fullsized":"2024-08-17T02:26:07.213514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:08:12.661719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.217178+0000","last_change":"2024-08-17T02:26:06.215871+0000","last_active":"2024-08-17T02:26:06.217178+0000","last_peered":"2024-08-17T02:26:06.217178+0000","last_clean":"2024-08-17T02:26:06.217178+0000","last_became_active":"2024-08-17T02:26:06.215289+0000","last_became_peered":"2024-08-17T02:26:06.215289+0000","last_unstale":"2024-08-17T02:26:06.217178+0000","last_undegraded":"2024-08-17T02:26:06.217178+0000","last_fullsized":"2024-08-17T02:26:06.217178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:28.410715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.214088+0000","last_change":"2024-08-17T02:26:07.214088+0000","last_active":"2024-08-17T02:26:07.214088+0000","last_peered":"2024-08-17T02:26:07.214088+0000","last_clean":"2024-08-17T02:26:07.214088+0000","last_became_active":"2024-08-17T02:26:07.213801+0000","last_became_peered":"2024-08-17T02:26:07.213801+0000","last_unstale":"2024-08-17T02:26:07.214088+0000","last_undegraded":"2024-08-17T02:26:07.214088+0000","last_fullsized":"2024-08-17T02:26:07.214088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:08.200210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.215266+0000","last_change":"2024-08-17T02:26:06.211099+0000","last_active":"2024-08-17T02:26:06.215266+0000","last_peered":"2024-08-17T02:26:06.215266+0000","last_clean":"2024-08-17T02:26:06.215266+0000","last_became_active":"2024-08-17T02:26:06.210803+0000","last_became_peered":"2024-08-17T02:26:06.210803+0000","last_unstale":"2024-08-17T02:26:06.215266+0000","last_undegraded":"2024-08-17T02:26:06.215266+0000","last_fullsized":"2024-08-17T02:26:06.215266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:41.153882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.200282+0000","last_change":"2024-08-17T02:26:07.200282+0000","last_active":"2024-08-17T02:26:07.200282+0000","last_peered":"2024-08-17T02:26:07.200282+0000","last_clean":"2024-08-17T02:26:07.200282+0000","last_became_active":"2024-08-17T02:26:07.199990+0000","last_became_peered":"2024-08-17T02:26:07.199990+0000","last_unstale":"2024-08-17T02:26:07.200282+0000","last_undegraded":"2024-08-17T02:26:07.200282+0000","last_fullsized":"2024-08-17T02:26:07.200282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:29.416944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.233944+0000","last_change":"2024-08-17T02:26:06.216533+0000","last_active":"2024-08-17T02:26:07.233944+0000","last_peered":"2024-08-17T02:26:07.233944+0000","last_clean":"2024-08-17T02:26:07.233944+0000","last_became_active":"2024-08-17T02:26:06.216192+0000","last_became_peered":"2024-08-17T02:26:06.216192+0000","last_unstale":"2024-08-17T02:26:07.233944+0000","last_undegraded":"2024-08-17T02:26:07.233944+0000","last_fullsized":"2024-08-17T02:26:07.233944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:28.410715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.224466+0000","last_change":"2024-08-17T02:26:07.224466+0000","last_active":"2024-08-17T02:26:07.224466+0000","last_peered":"2024-08-17T02:26:07.224466+0000","last_clean":"2024-08-17T02:26:07.224466+0000","last_became_active":"2024-08-17T02:26:07.224056+0000","last_became_peered":"2024-08-17T02:26:07.224056+0000","last_unstale":"2024-08-17T02:26:07.224466+0000","last_undegraded":"2024-08-17T02:26:07.224466+0000","last_fullsized":"2024-08-17T02:26:07.224466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:09.394997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.217371+0000","last_change":"2024-08-17T02:26:06.214068+0000","last_active":"2024-08-17T02:26:06.217371+0000","last_peered":"2024-08-17T02:26:06.217371+0000","last_clean":"2024-08-17T02:26:06.217371+0000","last_became_active":"2024-08-17T02:26:06.213776+0000","last_became_peered":"2024-08-17T02:26:06.213776+0000","last_unstale":"2024-08-17T02:26:06.217371+0000","last_undegraded":"2024-08-17T02:26:06.217371+0000","last_fullsized":"2024-08-17T02:26:06.217371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:10:23.971148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.227428+0000","last_change":"2024-08-17T02:26:07.227428+0000","last_active":"2024-08-17T02:26:07.227428+0000","last_peered":"2024-08-17T02:26:07.227428+0000","last_clean":"2024-08-17T02:26:07.227428+0000","last_became_active":"2024-08-17T02:26:07.227105+0000","last_became_peered":"2024-08-17T02:26:07.227105+0000","last_unstale":"2024-08-17T02:26:07.227428+0000","last_undegraded":"2024-08-17T02:26:07.227428+0000","last_fullsized":"2024-08-17T02:26:07.227428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:16.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.217468+0000","last_change":"2024-08-17T02:26:06.213511+0000","last_active":"2024-08-17T02:26:06.217468+0000","last_peered":"2024-08-17T02:26:06.217468+0000","last_clean":"2024-08-17T02:26:06.217468+0000","last_became_active":"2024-08-17T02:26:06.211419+0000","last_became_peered":"2024-08-17T02:26:06.211419+0000","last_unstale":"2024-08-17T02:26:06.217468+0000","last_undegraded":"2024-08-17T02:26:06.217468+0000","last_fullsized":"2024-08-17T02:26:06.217468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:31.028508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.213331+0000","last_change":"2024-08-17T02:26:07.213331+0000","last_active":"2024-08-17T02:26:07.213331+0000","last_peered":"2024-08-17T02:26:07.213331+0000","last_clean":"2024-08-17T02:26:07.213331+0000","last_became_active":"2024-08-17T02:26:07.212881+0000","last_became_peered":"2024-08-17T02:26:07.212881+0000","last_unstale":"2024-08-17T02:26:07.213331+0000","last_undegraded":"2024-08-17T02:26:07.213331+0000","last_fullsized":"2024-08-17T02:26:07.213331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:16.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.217211+0000","last_change":"2024-08-17T02:26:06.212317+0000","last_active":"2024-08-17T02:26:06.217211+0000","last_peered":"2024-08-17T02:26:06.217211+0000","last_clean":"2024-08-17T02:26:06.217211+0000","last_became_active":"2024-08-17T02:26:06.207149+0000","last_became_peered":"2024-08-17T02:26:06.207149+0000","last_unstale":"2024-08-17T02:26:06.217211+0000","last_undegraded":"2024-08-17T02:26:06.217211+0000","last_fullsized":"2024-08-17T02:26:06.217211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:34.186776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.215388+0000","last_change":"2024-08-17T02:26:07.215388+0000","last_active":"2024-08-17T02:26:07.215388+0000","last_peered":"2024-08-17T02:26:07.215388+0000","last_clean":"2024-08-17T02:26:07.215388+0000","last_became_active":"2024-08-17T02:26:07.215130+0000","last_became_peered":"2024-08-17T02:26:07.215130+0000","last_unstale":"2024-08-17T02:26:07.215388+0000","last_undegraded":"2024-08-17T02:26:07.215388+0000","last_fullsized":"2024-08-17T02:26:07.215388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:26.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.213389+0000","last_change":"2024-08-17T02:26:06.209428+0000","last_active":"2024-08-17T02:26:06.213389+0000","last_peered":"2024-08-17T02:26:06.213389+0000","last_clean":"2024-08-17T02:26:06.213389+0000","last_became_active":"2024-08-17T02:26:06.208621+0000","last_became_peered":"2024-08-17T02:26:06.208621+0000","last_unstale":"2024-08-17T02:26:06.213389+0000","last_undegraded":"2024-08-17T02:26:06.213389+0000","last_fullsized":"2024-08-17T02:26:06.213389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:22.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.223503+0000","last_change":"2024-08-17T02:26:07.223503+0000","last_active":"2024-08-17T02:26:07.223503+0000","last_peered":"2024-08-17T02:26:07.223503+0000","last_clean":"2024-08-17T02:26:07.223503+0000","last_became_active":"2024-08-17T02:26:07.222936+0000","last_became_peered":"2024-08-17T02:26:07.222936+0000","last_unstale":"2024-08-17T02:26:07.223503+0000","last_undegraded":"2024-08-17T02:26:07.223503+0000","last_fullsized":"2024-08-17T02:26:07.223503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:11.892494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.210638+0000","last_change":"2024-08-17T02:26:06.206207+0000","last_active":"2024-08-17T02:26:06.210638+0000","last_peered":"2024-08-17T02:26:06.210638+0000","last_clean":"2024-08-17T02:26:06.210638+0000","last_became_active":"2024-08-17T02:26:06.205938+0000","last_became_peered":"2024-08-17T02:26:06.205938+0000","last_unstale":"2024-08-17T02:26:06.210638+0000","last_undegraded":"2024-08-17T02:26:06.210638+0000","last_fullsized":"2024-08-17T02:26:06.210638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:23.897071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.225532+0000","last_change":"2024-08-17T02:26:07.225532+0000","last_active":"2024-08-17T02:26:07.225532+0000","last_peered":"2024-08-17T02:26:07.225532+0000","last_clean":"2024-08-17T02:26:07.225532+0000","last_became_active":"2024-08-17T02:26:07.225282+0000","last_became_peered":"2024-08-17T02:26:07.225282+0000","last_unstale":"2024-08-17T02:26:07.225532+0000","last_undegraded":"2024-08-17T02:26:07.225532+0000","last_fullsized":"2024-08-17T02:26:07.225532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:30.864474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.218706+0000","last_change":"2024-08-17T02:26:06.216372+0000","last_active":"2024-08-17T02:26:06.218706+0000","last_peered":"2024-08-17T02:26:06.218706+0000","last_clean":"2024-08-17T02:26:06.218706+0000","last_became_active":"2024-08-17T02:26:06.216099+0000","last_became_peered":"2024-08-17T02:26:06.216099+0000","last_unstale":"2024-08-17T02:26:06.218706+0000","last_undegraded":"2024-08-17T02:26:06.218706+0000","last_fullsized":"2024-08-17T02:26:06.218706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:31.028508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.212936+0000","last_change":"2024-08-17T02:26:07.212936+0000","last_active":"2024-08-17T02:26:07.212936+0000","last_peered":"2024-08-17T02:26:07.212936+0000","last_clean":"2024-08-17T02:26:07.212936+0000","last_became_active":"2024-08-17T02:26:07.212570+0000","last_became_peered":"2024-08-17T02:26:07.212570+0000","last_unstale":"2024-08-17T02:26:07.212936+0000","last_undegraded":"2024-08-17T02:26:07.212936+0000","last_fullsized":"2024-08-17T02:26:07.212936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:50.673521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.211610+0000","last_change":"2024-08-17T02:26:06.209727+0000","last_active":"2024-08-17T02:26:06.211610+0000","last_peered":"2024-08-17T02:26:06.211610+0000","last_clean":"2024-08-17T02:26:06.211610+0000","last_became_active":"2024-08-17T02:26:06.209468+0000","last_became_peered":"2024-08-17T02:26:06.209468+0000","last_unstale":"2024-08-17T02:26:06.211610+0000","last_undegraded":"2024-08-17T02:26:06.211610+0000","last_fullsized":"2024-08-17T02:26:06.211610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:08:11.655491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.208828+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:26:06.208828+0000","last_peered":"2024-08-17T02:26:06.208828+0000","last_clean":"2024-08-17T02:26:06.208828+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:26:06.208828+0000","last_undegraded":"2024-08-17T02:26:06.208828+0000","last_fullsized":"2024-08-17T02:26:06.208828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":946176,"data_stored":724478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.79200000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.629}]},{"osd":3,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.70499999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.69199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.746},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.71699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":335872,"data_stored":127257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.61199999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.63500000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.7160000000000002,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.75},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.8449999999999998,"5min":4.8449999999999998,"15min":4.8449999999999998},"last":0.70199999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.77700000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297712,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074128,"statfs":{"total":96636764160,"available":96331907072,"internally_reserved":0,"allocated":356352,"data_stored":134680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.623},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60999999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.751}]},{"osd":4,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.55300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":335872,"data_stored":127257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":4.5339999999999998,"5min":4.5339999999999998,"15min":4.5339999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":4.5119999999999996,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.72299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.432},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.498}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":135594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.37},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47999999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.51900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.439}]},{"osd":4,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.70799999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.61599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301844,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069996,"statfs":{"total":96636764160,"available":96327675904,"internally_reserved":0,"allocated":335872,"data_stored":127257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.50700000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.1869999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.58999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.69299999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":135594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.435},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.66200000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302444,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069396,"statfs":{"total":96636764160,"available":96327061504,"internally_reserved":0,"allocated":942080,"data_stored":724388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.623}]},{"osd":2,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.66400000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.83799999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:11.402 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:26:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.587+0000 7ff9b1a00640 1 Processor -- start 2024-08-17T02:26:11.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.587+0000 7ff9b1a00640 1 -- start start 2024-08-17T02:26:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.588+0000 7ff9b1a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9ac0afdd0 0x7ff9ac1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.588+0000 7ff9b1a00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac157690 con 0x7ff9ac0b0270 2024-08-17T02:26:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.588+0000 7ff9b1a00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac156a80 con 0x7ff9ac155900 2024-08-17T02:26:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.588+0000 7ff9b1a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac156d60 con 0x7ff9ac0afdd0 2024-08-17T02:26:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.588+0000 7ff9b1000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9ac0afdd0 0x7ff9ac1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.588+0000 7ff9b1000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9ac0afdd0 0x7ff9ac1563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42916/0 (socket says 172.21.15.45:42916) 2024-08-17T02:26:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.588+0000 7ff9ab400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff9ac0b0270 0x7ff9ac0ae6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59460/0 (socket says 172.21.15.45:59460) 2024-08-17T02:26:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.588+0000 7ff9b1000640 1 -- 172.21.15.45:0/2130862862 learned_addr learned my addr 172.21.15.45:0/2130862862 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:11.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.589+0000 7ff9b1000640 1 -- 172.21.15.45:0/2130862862 >> v1:172.21.15.169:6789/0 conn(0x7ff9ac155900 legacy=0x7ff9ac155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.589+0000 7ff9b1000640 1 -- 172.21.15.45:0/2130862862 >> v1:172.21.15.45:6789/0 conn(0x7ff9ac0b0270 legacy=0x7ff9ac0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.589+0000 7ff9aaa00640 1 -- 172.21.15.45:0/2130862862 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740894726 0 0) 0x7ff9ac156a80 con 0x7ff9ac155900 2024-08-17T02:26:11.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.589+0000 7ff9b1000640 1 -- 172.21.15.45:0/2130862862 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac157040 con 0x7ff9ac0afdd0 2024-08-17T02:26:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.590+0000 7ff9b1000640 1 --2- 172.21.15.45:0/2130862862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0afdd0 0x7ff9ac1563e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009f20 tx=0x7ff9a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72ef478bab00331 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.590+0000 7ff9aaa00640 1 -- 172.21.15.45:0/2130862862 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a40090d0 con 0x7ff9ac0afdd0 2024-08-17T02:26:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.590+0000 7ff9aaa00640 1 -- 172.21.15.45:0/2130862862 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4009230 con 0x7ff9ac0afdd0 2024-08-17T02:26:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.590+0000 7ff9aaa00640 1 -- 172.21.15.45:0/2130862862 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4034650 con 0x7ff9ac0afdd0 2024-08-17T02:26:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.591+0000 7ff9b1a00640 1 -- 172.21.15.45:0/2130862862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0afdd0 msgr2=0x7ff9ac1563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.591+0000 7ff9b1a00640 1 --2- 172.21.15.45:0/2130862862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0afdd0 0x7ff9ac1563e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4009f20 tx=0x7ff9a4009840 comp rx=0 tx=0).stop 2024-08-17T02:26:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.591+0000 7ff9b1a00640 1 -- 172.21.15.45:0/2130862862 shutdown_connections 2024-08-17T02:26:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.591+0000 7ff9b1a00640 1 --2- 172.21.15.45:0/2130862862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0afdd0 0x7ff9ac1563e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.591+0000 7ff9b1a00640 1 -- 172.21.15.45:0/2130862862 >> 172.21.15.45:0/2130862862 conn(0x7ff9ac067750 msgr2=0x7ff9ac0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.591+0000 7ff9b1a00640 1 -- 172.21.15.45:0/2130862862 shutdown_connections 2024-08-17T02:26:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.591+0000 7ff9b1a00640 1 -- 172.21.15.45:0/2130862862 wait complete. 2024-08-17T02:26:11.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.592+0000 7ff9b1a00640 1 Processor -- start 2024-08-17T02:26:11.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.592+0000 7ff9b1a00640 1 -- start start 2024-08-17T02:26:11.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.593+0000 7ff9b1a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9ac0afdd0 0x7ff9ac153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.593+0000 7ff9b1a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b0270 0x7ff9ac149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.593+0000 7ff9b1a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9ac155900 0x7ff9ac149da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.593+0000 7ff9b1a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac149060 con 0x7ff9ac0b0270 2024-08-17T02:26:11.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.593+0000 7ff9b1a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0ac4d0 con 0x7ff9ac155900 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.593+0000 7ff9b1a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0a9f80 con 0x7ff9ac0afdd0 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.593+0000 7ff9ab400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b0270 0x7ff9ac149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.593+0000 7ff9ab400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b0270 0x7ff9ac149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42918/0 (socket says 172.21.15.45:42918) 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.593+0000 7ff9ab400640 1 -- 172.21.15.45:0/3900831287 learned_addr learned my addr 172.21.15.45:0/3900831287 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9b1000640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9ac155900 0x7ff9ac149da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9abe00640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9ac0afdd0 0x7ff9ac153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9ab400640 1 -- 172.21.15.45:0/3900831287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9ac0afdd0 msgr2=0x7ff9ac153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9ab400640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9ac0afdd0 0x7ff9ac153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9ab400640 1 -- 172.21.15.45:0/3900831287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9ac155900 msgr2=0x7ff9ac149da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9ab400640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9ac155900 0x7ff9ac149da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9ab400640 1 -- 172.21.15.45:0/3900831287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a4009ae0 con 0x7ff9ac0b0270 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9ab400640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b0270 0x7ff9ac149860 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff99800c810 tx=0x7ff998007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9a3400640 1 -- 172.21.15.45:0/3900831287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9980070f0 con 0x7ff9ac0b0270 2024-08-17T02:26:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9a3400640 1 -- 172.21.15.45:0/3900831287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff998007250 con 0x7ff9ac0b0270 2024-08-17T02:26:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9a3400640 1 -- 172.21.15.45:0/3900831287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998007650 con 0x7ff9ac0b0270 2024-08-17T02:26:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.594+0000 7ff9b1a00640 1 -- 172.21.15.45:0/3900831287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac154680 con 0x7ff9ac0b0270 2024-08-17T02:26:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.595+0000 7ff9b1a00640 1 -- 172.21.15.45:0/3900831287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac0a9c10 con 0x7ff9ac0b0270 2024-08-17T02:26:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.595+0000 7ff9b1a00640 1 -- 172.21.15.45:0/3900831287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac0a9a70 con 0x7ff9ac0b0270 2024-08-17T02:26:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.596+0000 7ff9a3400640 1 -- 172.21.15.45:0/3900831287 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff9980049b0 con 0x7ff9ac0b0270 2024-08-17T02:26:11.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.597+0000 7ff9a3400640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff98c065150 0x7ff98c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:11.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.597+0000 7ff9a3400640 1 -- 172.21.15.45:0/3900831287 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff998081aa0 con 0x7ff9ac0b0270 2024-08-17T02:26:11.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.597+0000 7ff9abe00640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff98c065150 0x7ff98c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:11.598 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.598+0000 7ff9abe00640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff98c065150 0x7ff98c067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff99c003780 tx=0x7ff99c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:11.602 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.601+0000 7ff9a3400640 1 -- 172.21.15.45:0/3900831287 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff9ac0a9a70 con 0x7ff9ac0b0270 2024-08-17T02:26:11.782 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.781+0000 7ff9b1a00640 1 -- 172.21.15.45:0/3900831287 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9ac0a9a70 con 0x7ff98c065150 2024-08-17T02:26:11.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.789+0000 7ff9a3400640 1 -- 172.21.15.45:0/3900831287 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288922 (secure 0 0 0) 0x7ff9ac0a9a70 con 0x7ff98c065150 2024-08-17T02:26:11.793 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:11.794 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:26:11.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 -- 172.21.15.45:0/3900831287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff98c065150 msgr2=0x7ff98c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff98c065150 0x7ff98c067600 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff99c003780 tx=0x7ff99c009040 comp rx=0 tx=0).stop 2024-08-17T02:26:11.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 -- 172.21.15.45:0/3900831287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b0270 msgr2=0x7ff9ac149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:11.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b0270 0x7ff9ac149860 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff99800c810 tx=0x7ff998007ec0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.796 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 -- 172.21.15.45:0/3900831287 shutdown_connections 2024-08-17T02:26:11.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff9ac155900 0x7ff9ac149da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9ac0b0270 0x7ff9ac149860 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff98c065150 0x7ff98c067600 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 --2- 172.21.15.45:0/3900831287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff9ac0afdd0 0x7ff9ac153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:11.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 -- 172.21.15.45:0/3900831287 >> 172.21.15.45:0/3900831287 conn(0x7ff9ac067750 msgr2=0x7ff9ac06ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:11.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 -- 172.21.15.45:0/3900831287 shutdown_connections 2024-08-17T02:26:11.797 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:11.793+0000 7ff9b1a00640 1 -- 172.21.15.45:0/3900831287 wait complete. 2024-08-17T02:26:11.808 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2024-08-17T02:26:11.668363+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592706,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":97,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2399408,"kb_used_data":3888,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752575312,"statfs":{"total":773094113280,"available":770637119488,"internally_reserved":0,"allocated":3981312,"data_stored":2236505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":30,"apply_latency_ms":30,"commit_latency_ns":30000000,"apply_latency_ns":30000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001190"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.215184+0000","last_change":"2024-08-17T02:26:07.215184+0000","last_active":"2024-08-17T02:26:07.215184+0000","last_peered":"2024-08-17T02:26:07.215184+0000","last_clean":"2024-08-17T02:26:07.215184+0000","last_became_active":"2024-08-17T02:26:07.214953+0000","last_became_peered":"2024-08-17T02:26:07.214953+0000","last_unstale":"2024-08-17T02:26:07.215184+0000","last_undegraded":"2024-08-17T02:26:07.215184+0000","last_fullsized":"2024-08-17T02:26:07.215184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:57.679849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.221506+0000","last_change":"2024-08-17T02:26:07.221506+0000","last_active":"2024-08-17T02:26:07.221506+0000","last_peered":"2024-08-17T02:26:07.221506+0000","last_clean":"2024-08-17T02:26:07.221506+0000","last_became_active":"2024-08-17T02:26:07.220699+0000","last_became_peered":"2024-08-17T02:26:07.220699+0000","last_unstale":"2024-08-17T02:26:07.221506+0000","last_undegraded":"2024-08-17T02:26:07.221506+0000","last_fullsized":"2024-08-17T02:26:07.221506+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:33:48.116630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.228394+0000","last_change":"2024-08-17T02:26:07.228394+0000","last_active":"2024-08-17T02:26:07.228394+0000","last_peered":"2024-08-17T02:26:07.228394+0000","last_clean":"2024-08-17T02:26:07.228394+0000","last_became_active":"2024-08-17T02:26:07.228120+0000","last_became_peered":"2024-08-17T02:26:07.228120+0000","last_unstale":"2024-08-17T02:26:07.228394+0000","last_undegraded":"2024-08-17T02:26:07.228394+0000","last_fullsized":"2024-08-17T02:26:07.228394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:33:48.116630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.216610+0000","last_change":"2024-08-17T02:26:07.216610+0000","last_active":"2024-08-17T02:26:07.216610+0000","last_peered":"2024-08-17T02:26:07.216610+0000","last_clean":"2024-08-17T02:26:07.216610+0000","last_became_active":"2024-08-17T02:26:07.212767+0000","last_became_peered":"2024-08-17T02:26:07.212767+0000","last_unstale":"2024-08-17T02:26:07.216610+0000","last_undegraded":"2024-08-17T02:26:07.216610+0000","last_fullsized":"2024-08-17T02:26:07.216610+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:03.321036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.207734+0000","last_change":"2024-08-17T02:26:07.207734+0000","last_active":"2024-08-17T02:26:07.207734+0000","last_peered":"2024-08-17T02:26:07.207734+0000","last_clean":"2024-08-17T02:26:07.207734+0000","last_became_active":"2024-08-17T02:26:07.207445+0000","last_became_peered":"2024-08-17T02:26:07.207445+0000","last_unstale":"2024-08-17T02:26:07.207734+0000","last_undegraded":"2024-08-17T02:26:07.207734+0000","last_fullsized":"2024-08-17T02:26:07.207734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:13:34.078537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.219873+0000","last_change":"2024-08-17T02:26:07.219873+0000","last_active":"2024-08-17T02:26:07.219873+0000","last_peered":"2024-08-17T02:26:07.219873+0000","last_clean":"2024-08-17T02:26:07.219873+0000","last_became_active":"2024-08-17T02:26:07.219594+0000","last_became_peered":"2024-08-17T02:26:07.219594+0000","last_unstale":"2024-08-17T02:26:07.219873+0000","last_undegraded":"2024-08-17T02:26:07.219873+0000","last_fullsized":"2024-08-17T02:26:07.219873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:30.687363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.214249+0000","last_change":"2024-08-17T02:26:07.214249+0000","last_active":"2024-08-17T02:26:07.214249+0000","last_peered":"2024-08-17T02:26:07.214249+0000","last_clean":"2024-08-17T02:26:07.214249+0000","last_became_active":"2024-08-17T02:26:07.213978+0000","last_became_peered":"2024-08-17T02:26:07.213978+0000","last_unstale":"2024-08-17T02:26:07.214249+0000","last_undegraded":"2024-08-17T02:26:07.214249+0000","last_fullsized":"2024-08-17T02:26:07.214249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:54.523133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.217378+0000","last_change":"2024-08-17T02:26:07.217378+0000","last_active":"2024-08-17T02:26:07.217378+0000","last_peered":"2024-08-17T02:26:07.217378+0000","last_clean":"2024-08-17T02:26:07.217378+0000","last_became_active":"2024-08-17T02:26:07.217082+0000","last_became_peered":"2024-08-17T02:26:07.217082+0000","last_unstale":"2024-08-17T02:26:07.217378+0000","last_undegraded":"2024-08-17T02:26:07.217378+0000","last_fullsized":"2024-08-17T02:26:07.217378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:30.687363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.222195+0000","last_change":"2024-08-17T02:26:07.222195+0000","last_active":"2024-08-17T02:26:07.222195+0000","last_peered":"2024-08-17T02:26:07.222195+0000","last_clean":"2024-08-17T02:26:07.222195+0000","last_became_active":"2024-08-17T02:26:07.221912+0000","last_became_peered":"2024-08-17T02:26:07.221912+0000","last_unstale":"2024-08-17T02:26:07.222195+0000","last_undegraded":"2024-08-17T02:26:07.222195+0000","last_fullsized":"2024-08-17T02:26:07.222195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:03.321036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.234675+0000","last_change":"2024-08-17T02:26:07.234675+0000","last_active":"2024-08-17T02:26:07.234675+0000","last_peered":"2024-08-17T02:26:07.234675+0000","last_clean":"2024-08-17T02:26:07.234675+0000","last_became_active":"2024-08-17T02:26:07.234414+0000","last_became_peered":"2024-08-17T02:26:07.234414+0000","last_unstale":"2024-08-17T02:26:07.234675+0000","last_undegraded":"2024-08-17T02:26:07.234675+0000","last_fullsized":"2024-08-17T02:26:07.234675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:40:31.952730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.228480+0000","last_change":"2024-08-17T02:26:07.228480+0000","last_active":"2024-08-17T02:26:07.228480+0000","last_peered":"2024-08-17T02:26:07.228480+0000","last_clean":"2024-08-17T02:26:07.228480+0000","last_became_active":"2024-08-17T02:26:07.228129+0000","last_became_peered":"2024-08-17T02:26:07.228129+0000","last_unstale":"2024-08-17T02:26:07.228480+0000","last_undegraded":"2024-08-17T02:26:07.228480+0000","last_fullsized":"2024-08-17T02:26:07.228480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:43.584516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.219144+0000","last_change":"2024-08-17T02:26:07.219144+0000","last_active":"2024-08-17T02:26:07.219144+0000","last_peered":"2024-08-17T02:26:07.219144+0000","last_clean":"2024-08-17T02:26:07.219144+0000","last_became_active":"2024-08-17T02:26:07.216076+0000","last_became_peered":"2024-08-17T02:26:07.216076+0000","last_unstale":"2024-08-17T02:26:07.219144+0000","last_undegraded":"2024-08-17T02:26:07.219144+0000","last_fullsized":"2024-08-17T02:26:07.219144+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:11.892494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.223836+0000","last_change":"2024-08-17T02:26:07.223836+0000","last_active":"2024-08-17T02:26:07.223836+0000","last_peered":"2024-08-17T02:26:07.223836+0000","last_clean":"2024-08-17T02:26:07.223836+0000","last_became_active":"2024-08-17T02:26:07.223583+0000","last_became_peered":"2024-08-17T02:26:07.223583+0000","last_unstale":"2024-08-17T02:26:07.223836+0000","last_undegraded":"2024-08-17T02:26:07.223836+0000","last_fullsized":"2024-08-17T02:26:07.223836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:26.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.232613+0000","last_change":"2024-08-17T02:26:07.232613+0000","last_active":"2024-08-17T02:26:07.232613+0000","last_peered":"2024-08-17T02:26:07.232613+0000","last_clean":"2024-08-17T02:26:07.232613+0000","last_became_active":"2024-08-17T02:26:07.232027+0000","last_became_peered":"2024-08-17T02:26:07.232027+0000","last_unstale":"2024-08-17T02:26:07.232613+0000","last_undegraded":"2024-08-17T02:26:07.232613+0000","last_fullsized":"2024-08-17T02:26:07.232613+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:10:22.670697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.207180+0000","last_change":"2024-08-17T02:26:07.207180+0000","last_active":"2024-08-17T02:26:07.207180+0000","last_peered":"2024-08-17T02:26:07.207180+0000","last_clean":"2024-08-17T02:26:07.207180+0000","last_became_active":"2024-08-17T02:26:07.206870+0000","last_became_peered":"2024-08-17T02:26:07.206870+0000","last_unstale":"2024-08-17T02:26:07.207180+0000","last_undegraded":"2024-08-17T02:26:07.207180+0000","last_fullsized":"2024-08-17T02:26:07.207180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:44.430002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.226818+0000","last_change":"2024-08-17T02:26:07.226818+0000","last_active":"2024-08-17T02:26:07.226818+0000","last_peered":"2024-08-17T02:26:07.226818+0000","last_clean":"2024-08-17T02:26:07.226818+0000","last_became_active":"2024-08-17T02:26:07.226499+0000","last_became_peered":"2024-08-17T02:26:07.226499+0000","last_unstale":"2024-08-17T02:26:07.226818+0000","last_undegraded":"2024-08-17T02:26:07.226818+0000","last_fullsized":"2024-08-17T02:26:07.226818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:09.394997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.217782+0000","last_change":"2024-08-17T02:26:07.217782+0000","last_active":"2024-08-17T02:26:07.217782+0000","last_peered":"2024-08-17T02:26:07.217782+0000","last_clean":"2024-08-17T02:26:07.217782+0000","last_became_active":"2024-08-17T02:26:07.217514+0000","last_became_peered":"2024-08-17T02:26:07.217514+0000","last_unstale":"2024-08-17T02:26:07.217782+0000","last_undegraded":"2024-08-17T02:26:07.217782+0000","last_fullsized":"2024-08-17T02:26:07.217782+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:11.892494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.234791+0000","last_change":"2024-08-17T02:26:07.234791+0000","last_active":"2024-08-17T02:26:07.234791+0000","last_peered":"2024-08-17T02:26:07.234791+0000","last_clean":"2024-08-17T02:26:07.234791+0000","last_became_active":"2024-08-17T02:26:07.234416+0000","last_became_peered":"2024-08-17T02:26:07.234416+0000","last_unstale":"2024-08-17T02:26:07.234791+0000","last_undegraded":"2024-08-17T02:26:07.234791+0000","last_fullsized":"2024-08-17T02:26:07.234791+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:09.394997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.236483+0000","last_change":"2024-08-17T02:26:07.236483+0000","last_active":"2024-08-17T02:26:07.236483+0000","last_peered":"2024-08-17T02:26:07.236483+0000","last_clean":"2024-08-17T02:26:07.236483+0000","last_became_active":"2024-08-17T02:26:07.234686+0000","last_became_peered":"2024-08-17T02:26:07.234686+0000","last_unstale":"2024-08-17T02:26:07.236483+0000","last_undegraded":"2024-08-17T02:26:07.236483+0000","last_fullsized":"2024-08-17T02:26:07.236483+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:08.200210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.201164+0000","last_change":"2024-08-17T02:26:07.201164+0000","last_active":"2024-08-17T02:26:07.201164+0000","last_peered":"2024-08-17T02:26:07.201164+0000","last_clean":"2024-08-17T02:26:07.201164+0000","last_became_active":"2024-08-17T02:26:07.200895+0000","last_became_peered":"2024-08-17T02:26:07.200895+0000","last_unstale":"2024-08-17T02:26:07.201164+0000","last_undegraded":"2024-08-17T02:26:07.201164+0000","last_fullsized":"2024-08-17T02:26:07.201164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:23.314496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.211907+0000","last_change":"2024-08-17T02:26:07.211907+0000","last_active":"2024-08-17T02:26:07.211907+0000","last_peered":"2024-08-17T02:26:07.211907+0000","last_clean":"2024-08-17T02:26:07.211907+0000","last_became_active":"2024-08-17T02:26:07.211611+0000","last_became_peered":"2024-08-17T02:26:07.211611+0000","last_unstale":"2024-08-17T02:26:07.211907+0000","last_undegraded":"2024-08-17T02:26:07.211907+0000","last_fullsized":"2024-08-17T02:26:07.211907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:08.776031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.225464+0000","last_change":"2024-08-17T02:26:07.225464+0000","last_active":"2024-08-17T02:26:07.225464+0000","last_peered":"2024-08-17T02:26:07.225464+0000","last_clean":"2024-08-17T02:26:07.225464+0000","last_became_active":"2024-08-17T02:26:07.225196+0000","last_became_peered":"2024-08-17T02:26:07.225196+0000","last_unstale":"2024-08-17T02:26:07.225464+0000","last_undegraded":"2024-08-17T02:26:07.225464+0000","last_fullsized":"2024-08-17T02:26:07.225464+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:17:24.045737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.209958+0000","last_change":"2024-08-17T02:26:07.209958+0000","last_active":"2024-08-17T02:26:07.209958+0000","last_peered":"2024-08-17T02:26:07.209958+0000","last_clean":"2024-08-17T02:26:07.209958+0000","last_became_active":"2024-08-17T02:26:07.209703+0000","last_became_peered":"2024-08-17T02:26:07.209703+0000","last_unstale":"2024-08-17T02:26:07.209958+0000","last_undegraded":"2024-08-17T02:26:07.209958+0000","last_fullsized":"2024-08-17T02:26:07.209958+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:56.126788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.200867+0000","last_change":"2024-08-17T02:26:07.200867+0000","last_active":"2024-08-17T02:26:07.200867+0000","last_peered":"2024-08-17T02:26:07.200867+0000","last_clean":"2024-08-17T02:26:07.200867+0000","last_became_active":"2024-08-17T02:26:07.200619+0000","last_became_peered":"2024-08-17T02:26:07.200619+0000","last_unstale":"2024-08-17T02:26:07.200867+0000","last_undegraded":"2024-08-17T02:26:07.200867+0000","last_fullsized":"2024-08-17T02:26:07.200867+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:54.523133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.222134+0000","last_change":"2024-08-17T02:26:07.222134+0000","last_active":"2024-08-17T02:26:07.222134+0000","last_peered":"2024-08-17T02:26:07.222134+0000","last_clean":"2024-08-17T02:26:07.222134+0000","last_became_active":"2024-08-17T02:26:07.221465+0000","last_became_peered":"2024-08-17T02:26:07.221465+0000","last_unstale":"2024-08-17T02:26:07.222134+0000","last_undegraded":"2024-08-17T02:26:07.222134+0000","last_fullsized":"2024-08-17T02:26:07.222134+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:07:54.523133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.228618+0000","last_change":"2024-08-17T02:26:07.228618+0000","last_active":"2024-08-17T02:26:07.228618+0000","last_peered":"2024-08-17T02:26:07.228618+0000","last_clean":"2024-08-17T02:26:07.228618+0000","last_became_active":"2024-08-17T02:26:07.228378+0000","last_became_peered":"2024-08-17T02:26:07.228378+0000","last_unstale":"2024-08-17T02:26:07.228618+0000","last_undegraded":"2024-08-17T02:26:07.228618+0000","last_fullsized":"2024-08-17T02:26:07.228618+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:33:43.584516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.230632+0000","last_change":"2024-08-17T02:26:07.230632+0000","last_active":"2024-08-17T02:26:07.230632+0000","last_peered":"2024-08-17T02:26:07.230632+0000","last_clean":"2024-08-17T02:26:07.230632+0000","last_became_active":"2024-08-17T02:26:07.229377+0000","last_became_peered":"2024-08-17T02:26:07.229377+0000","last_unstale":"2024-08-17T02:26:07.230632+0000","last_undegraded":"2024-08-17T02:26:07.230632+0000","last_fullsized":"2024-08-17T02:26:07.230632+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:10:22.670697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.215030+0000","last_change":"2024-08-17T02:26:07.215030+0000","last_active":"2024-08-17T02:26:07.215030+0000","last_peered":"2024-08-17T02:26:07.215030+0000","last_clean":"2024-08-17T02:26:07.215030+0000","last_became_active":"2024-08-17T02:26:07.214631+0000","last_became_peered":"2024-08-17T02:26:07.214631+0000","last_unstale":"2024-08-17T02:26:07.215030+0000","last_undegraded":"2024-08-17T02:26:07.215030+0000","last_fullsized":"2024-08-17T02:26:07.215030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:22:03.321036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.210116+0000","last_change":"2024-08-17T02:26:07.210116+0000","last_active":"2024-08-17T02:26:07.210116+0000","last_peered":"2024-08-17T02:26:07.210116+0000","last_clean":"2024-08-17T02:26:07.210116+0000","last_became_active":"2024-08-17T02:26:07.209853+0000","last_became_peered":"2024-08-17T02:26:07.209853+0000","last_unstale":"2024-08-17T02:26:07.210116+0000","last_undegraded":"2024-08-17T02:26:07.210116+0000","last_fullsized":"2024-08-17T02:26:07.210116+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:16.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.215863+0000","last_change":"2024-08-17T02:26:07.215863+0000","last_active":"2024-08-17T02:26:07.215863+0000","last_peered":"2024-08-17T02:26:07.215863+0000","last_clean":"2024-08-17T02:26:07.215863+0000","last_became_active":"2024-08-17T02:26:07.215598+0000","last_became_peered":"2024-08-17T02:26:07.215598+0000","last_unstale":"2024-08-17T02:26:07.215863+0000","last_undegraded":"2024-08-17T02:26:07.215863+0000","last_fullsized":"2024-08-17T02:26:07.215863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:33:48.116630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.219873+0000","last_change":"2024-08-17T02:26:07.219873+0000","last_active":"2024-08-17T02:26:07.219873+0000","last_peered":"2024-08-17T02:26:07.219873+0000","last_clean":"2024-08-17T02:26:07.219873+0000","last_became_active":"2024-08-17T02:26:07.219625+0000","last_became_peered":"2024-08-17T02:26:07.219625+0000","last_unstale":"2024-08-17T02:26:07.219873+0000","last_undegraded":"2024-08-17T02:26:07.219873+0000","last_fullsized":"2024-08-17T02:26:07.219873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:56.126788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.208691+0000","last_change":"2024-08-17T02:26:07.208691+0000","last_active":"2024-08-17T02:26:07.208691+0000","last_peered":"2024-08-17T02:26:07.208691+0000","last_clean":"2024-08-17T02:26:07.208691+0000","last_became_active":"2024-08-17T02:26:07.208418+0000","last_became_peered":"2024-08-17T02:26:07.208418+0000","last_unstale":"2024-08-17T02:26:07.208691+0000","last_undegraded":"2024-08-17T02:26:07.208691+0000","last_fullsized":"2024-08-17T02:26:07.208691+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:44:06.818972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.208463+0000","last_change":"2024-08-17T02:26:07.208463+0000","last_active":"2024-08-17T02:26:07.208463+0000","last_peered":"2024-08-17T02:26:07.208463+0000","last_clean":"2024-08-17T02:26:07.208463+0000","last_became_active":"2024-08-17T02:26:07.208204+0000","last_became_peered":"2024-08-17T02:26:07.208204+0000","last_unstale":"2024-08-17T02:26:07.208463+0000","last_undegraded":"2024-08-17T02:26:07.208463+0000","last_fullsized":"2024-08-17T02:26:07.208463+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:57.679849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.223680+0000","last_change":"2024-08-17T02:26:06.207170+0000","last_active":"2024-08-17T02:26:07.223680+0000","last_peered":"2024-08-17T02:26:07.223680+0000","last_clean":"2024-08-17T02:26:07.223680+0000","last_became_active":"2024-08-17T02:26:06.206919+0000","last_became_peered":"2024-08-17T02:26:06.206919+0000","last_unstale":"2024-08-17T02:26:07.223680+0000","last_undegraded":"2024-08-17T02:26:07.223680+0000","last_fullsized":"2024-08-17T02:26:07.223680+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:28.410715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":570,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.206410+0000","last_change":"2024-08-17T02:26:07.206410+0000","last_active":"2024-08-17T02:26:07.206410+0000","last_peered":"2024-08-17T02:26:07.206410+0000","last_clean":"2024-08-17T02:26:07.206410+0000","last_became_active":"2024-08-17T02:26:07.205635+0000","last_became_peered":"2024-08-17T02:26:07.205635+0000","last_unstale":"2024-08-17T02:26:07.206410+0000","last_undegraded":"2024-08-17T02:26:07.206410+0000","last_fullsized":"2024-08-17T02:26:07.206410+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:08.776031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.206421+0000","last_change":"2024-08-17T02:26:06.212172+0000","last_active":"2024-08-17T02:26:07.206421+0000","last_peered":"2024-08-17T02:26:07.206421+0000","last_clean":"2024-08-17T02:26:07.206421+0000","last_became_active":"2024-08-17T02:26:06.211853+0000","last_became_peered":"2024-08-17T02:26:06.211853+0000","last_unstale":"2024-08-17T02:26:07.206421+0000","last_undegraded":"2024-08-17T02:26:07.206421+0000","last_fullsized":"2024-08-17T02:26:07.206421+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:28.410715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.225451+0000","last_change":"2024-08-17T02:26:07.225451+0000","last_active":"2024-08-17T02:26:07.225451+0000","last_peered":"2024-08-17T02:26:07.225451+0000","last_clean":"2024-08-17T02:26:07.225451+0000","last_became_active":"2024-08-17T02:26:07.225161+0000","last_became_peered":"2024-08-17T02:26:07.225161+0000","last_unstale":"2024-08-17T02:26:07.225451+0000","last_undegraded":"2024-08-17T02:26:07.225451+0000","last_fullsized":"2024-08-17T02:26:07.225451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:05:57.679849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.234581+0000","last_change":"2024-08-17T02:26:06.215516+0000","last_active":"2024-08-17T02:26:07.234581+0000","last_peered":"2024-08-17T02:26:07.234581+0000","last_clean":"2024-08-17T02:26:07.234581+0000","last_became_active":"2024-08-17T02:26:06.215255+0000","last_became_peered":"2024-08-17T02:26:06.215255+0000","last_unstale":"2024-08-17T02:26:07.234581+0000","last_undegraded":"2024-08-17T02:26:07.234581+0000","last_fullsized":"2024-08-17T02:26:07.234581+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:12:55.120560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.224841+0000","last_change":"2024-08-17T02:26:07.224841+0000","last_active":"2024-08-17T02:26:07.224841+0000","last_peered":"2024-08-17T02:26:07.224841+0000","last_clean":"2024-08-17T02:26:07.224841+0000","last_became_active":"2024-08-17T02:26:07.224307+0000","last_became_peered":"2024-08-17T02:26:07.224307+0000","last_unstale":"2024-08-17T02:26:07.224841+0000","last_undegraded":"2024-08-17T02:26:07.224841+0000","last_fullsized":"2024-08-17T02:26:07.224841+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:44.430002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.232264+0000","last_change":"2024-08-17T02:26:06.212258+0000","last_active":"2024-08-17T02:26:07.232264+0000","last_peered":"2024-08-17T02:26:07.232264+0000","last_clean":"2024-08-17T02:26:07.232264+0000","last_became_active":"2024-08-17T02:26:06.211872+0000","last_became_peered":"2024-08-17T02:26:06.211872+0000","last_unstale":"2024-08-17T02:26:07.232264+0000","last_undegraded":"2024-08-17T02:26:07.232264+0000","last_fullsized":"2024-08-17T02:26:07.232264+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:09:30.712426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.209019+0000","last_change":"2024-08-17T02:26:07.209019+0000","last_active":"2024-08-17T02:26:07.209019+0000","last_peered":"2024-08-17T02:26:07.209019+0000","last_clean":"2024-08-17T02:26:07.209019+0000","last_became_active":"2024-08-17T02:26:07.208772+0000","last_became_peered":"2024-08-17T02:26:07.208772+0000","last_unstale":"2024-08-17T02:26:07.209019+0000","last_undegraded":"2024-08-17T02:26:07.209019+0000","last_fullsized":"2024-08-17T02:26:07.209019+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:08.066259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.200812+0000","last_change":"2024-08-17T02:26:06.208387+0000","last_active":"2024-08-17T02:26:07.200812+0000","last_peered":"2024-08-17T02:26:07.200812+0000","last_clean":"2024-08-17T02:26:07.200812+0000","last_became_active":"2024-08-17T02:26:06.208166+0000","last_became_peered":"2024-08-17T02:26:06.208166+0000","last_unstale":"2024-08-17T02:26:07.200812+0000","last_undegraded":"2024-08-17T02:26:07.200812+0000","last_fullsized":"2024-08-17T02:26:07.200812+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:03.847541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.215783+0000","last_change":"2024-08-17T02:26:07.215783+0000","last_active":"2024-08-17T02:26:07.215783+0000","last_peered":"2024-08-17T02:26:07.215783+0000","last_clean":"2024-08-17T02:26:07.215783+0000","last_became_active":"2024-08-17T02:26:07.214821+0000","last_became_peered":"2024-08-17T02:26:07.214821+0000","last_unstale":"2024-08-17T02:26:07.215783+0000","last_undegraded":"2024-08-17T02:26:07.215783+0000","last_fullsized":"2024-08-17T02:26:07.215783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:10:22.670697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.200313+0000","last_change":"2024-08-17T02:26:06.210960+0000","last_active":"2024-08-17T02:26:07.200313+0000","last_peered":"2024-08-17T02:26:07.200313+0000","last_clean":"2024-08-17T02:26:07.200313+0000","last_became_active":"2024-08-17T02:26:06.210697+0000","last_became_peered":"2024-08-17T02:26:06.210697+0000","last_unstale":"2024-08-17T02:26:07.200313+0000","last_undegraded":"2024-08-17T02:26:07.200313+0000","last_fullsized":"2024-08-17T02:26:07.200313+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:17:22.702948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.213960+0000","last_change":"2024-08-17T02:26:07.213960+0000","last_active":"2024-08-17T02:26:07.213960+0000","last_peered":"2024-08-17T02:26:07.213960+0000","last_clean":"2024-08-17T02:26:07.213960+0000","last_became_active":"2024-08-17T02:26:07.213067+0000","last_became_peered":"2024-08-17T02:26:07.213067+0000","last_unstale":"2024-08-17T02:26:07.213960+0000","last_undegraded":"2024-08-17T02:26:07.213960+0000","last_fullsized":"2024-08-17T02:26:07.213960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T02:40:58.572216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.210463+0000","last_change":"2024-08-17T02:26:06.208749+0000","last_active":"2024-08-17T02:26:06.210463+0000","last_peered":"2024-08-17T02:26:06.210463+0000","last_clean":"2024-08-17T02:26:06.210463+0000","last_became_active":"2024-08-17T02:26:06.206558+0000","last_became_peered":"2024-08-17T02:26:06.206558+0000","last_unstale":"2024-08-17T02:26:06.210463+0000","last_undegraded":"2024-08-17T02:26:06.210463+0000","last_fullsized":"2024-08-17T02:26:06.210463+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:25.993154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.221108+0000","last_change":"2024-08-17T02:26:07.221108+0000","last_active":"2024-08-17T02:26:07.221108+0000","last_peered":"2024-08-17T02:26:07.221108+0000","last_clean":"2024-08-17T02:26:07.221108+0000","last_became_active":"2024-08-17T02:26:07.220802+0000","last_became_peered":"2024-08-17T02:26:07.220802+0000","last_unstale":"2024-08-17T02:26:07.221108+0000","last_undegraded":"2024-08-17T02:26:07.221108+0000","last_fullsized":"2024-08-17T02:26:07.221108+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:34:08.776031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.210675+0000","last_change":"2024-08-17T02:26:06.206448+0000","last_active":"2024-08-17T02:26:06.210675+0000","last_peered":"2024-08-17T02:26:06.210675+0000","last_clean":"2024-08-17T02:26:06.210675+0000","last_became_active":"2024-08-17T02:26:06.206200+0000","last_became_peered":"2024-08-17T02:26:06.206200+0000","last_unstale":"2024-08-17T02:26:06.210675+0000","last_undegraded":"2024-08-17T02:26:06.210675+0000","last_fullsized":"2024-08-17T02:26:06.210675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:51:58.769776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.229548+0000","last_change":"2024-08-17T02:26:07.229548+0000","last_active":"2024-08-17T02:26:07.229548+0000","last_peered":"2024-08-17T02:26:07.229548+0000","last_clean":"2024-08-17T02:26:07.229548+0000","last_became_active":"2024-08-17T02:26:07.229255+0000","last_became_peered":"2024-08-17T02:26:07.229255+0000","last_unstale":"2024-08-17T02:26:07.229548+0000","last_undegraded":"2024-08-17T02:26:07.229548+0000","last_fullsized":"2024-08-17T02:26:07.229548+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:50.673521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.219493+0000","last_change":"2024-08-17T02:26:06.218314+0000","last_active":"2024-08-17T02:26:06.219493+0000","last_peered":"2024-08-17T02:26:06.219493+0000","last_clean":"2024-08-17T02:26:06.219493+0000","last_became_active":"2024-08-17T02:26:06.218055+0000","last_became_peered":"2024-08-17T02:26:06.218055+0000","last_unstale":"2024-08-17T02:26:06.219493+0000","last_undegraded":"2024-08-17T02:26:06.219493+0000","last_fullsized":"2024-08-17T02:26:06.219493+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:41.153882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.234675+0000","last_change":"2024-08-17T02:26:07.234675+0000","last_active":"2024-08-17T02:26:07.234675+0000","last_peered":"2024-08-17T02:26:07.234675+0000","last_clean":"2024-08-17T02:26:07.234675+0000","last_became_active":"2024-08-17T02:26:07.234397+0000","last_became_peered":"2024-08-17T02:26:07.234397+0000","last_unstale":"2024-08-17T02:26:07.234675+0000","last_undegraded":"2024-08-17T02:26:07.234675+0000","last_fullsized":"2024-08-17T02:26:07.234675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.214807+0000","last_change":"2024-08-17T02:26:06.210177+0000","last_active":"2024-08-17T02:26:06.214807+0000","last_peered":"2024-08-17T02:26:06.214807+0000","last_clean":"2024-08-17T02:26:06.214807+0000","last_became_active":"2024-08-17T02:26:06.208911+0000","last_became_peered":"2024-08-17T02:26:06.208911+0000","last_unstale":"2024-08-17T02:26:06.214807+0000","last_undegraded":"2024-08-17T02:26:06.214807+0000","last_fullsized":"2024-08-17T02:26:06.214807+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:22.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.233472+0000","last_change":"2024-08-17T02:26:07.233472+0000","last_active":"2024-08-17T02:26:07.233472+0000","last_peered":"2024-08-17T02:26:07.233472+0000","last_clean":"2024-08-17T02:26:07.233472+0000","last_became_active":"2024-08-17T02:26:07.228862+0000","last_became_peered":"2024-08-17T02:26:07.228862+0000","last_unstale":"2024-08-17T02:26:07.233472+0000","last_undegraded":"2024-08-17T02:26:07.233472+0000","last_fullsized":"2024-08-17T02:26:07.233472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:57:08.066259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.223978+0000","last_change":"2024-08-17T02:26:06.215581+0000","last_active":"2024-08-17T02:26:07.223978+0000","last_peered":"2024-08-17T02:26:07.223978+0000","last_clean":"2024-08-17T02:26:07.223978+0000","last_became_active":"2024-08-17T02:26:06.215307+0000","last_became_peered":"2024-08-17T02:26:06.215307+0000","last_unstale":"2024-08-17T02:26:07.223978+0000","last_undegraded":"2024-08-17T02:26:07.223978+0000","last_fullsized":"2024-08-17T02:26:07.223978+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:25.993154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.228481+0000","last_change":"2024-08-17T02:26:07.228481+0000","last_active":"2024-08-17T02:26:07.228481+0000","last_peered":"2024-08-17T02:26:07.228481+0000","last_clean":"2024-08-17T02:26:07.228481+0000","last_became_active":"2024-08-17T02:26:07.228154+0000","last_became_peered":"2024-08-17T02:26:07.228154+0000","last_unstale":"2024-08-17T02:26:07.228481+0000","last_undegraded":"2024-08-17T02:26:07.228481+0000","last_fullsized":"2024-08-17T02:26:07.228481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:14:30.687363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.237517+0000","last_change":"2024-08-17T02:26:06.213409+0000","last_active":"2024-08-17T02:26:07.237517+0000","last_peered":"2024-08-17T02:26:07.237517+0000","last_clean":"2024-08-17T02:26:07.237517+0000","last_became_active":"2024-08-17T02:26:06.213119+0000","last_became_peered":"2024-08-17T02:26:06.213119+0000","last_unstale":"2024-08-17T02:26:07.237517+0000","last_undegraded":"2024-08-17T02:26:07.237517+0000","last_fullsized":"2024-08-17T02:26:07.237517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:09:27.365457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1552,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.221181+0000","last_change":"2024-08-17T02:26:07.221181+0000","last_active":"2024-08-17T02:26:07.221181+0000","last_peered":"2024-08-17T02:26:07.221181+0000","last_clean":"2024-08-17T02:26:07.221181+0000","last_became_active":"2024-08-17T02:26:07.220901+0000","last_became_peered":"2024-08-17T02:26:07.220901+0000","last_unstale":"2024-08-17T02:26:07.221181+0000","last_undegraded":"2024-08-17T02:26:07.221181+0000","last_fullsized":"2024-08-17T02:26:07.221181+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:17:24.045737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.225788+0000","last_change":"2024-08-17T02:26:06.209140+0000","last_active":"2024-08-17T02:26:07.225788+0000","last_peered":"2024-08-17T02:26:07.225788+0000","last_clean":"2024-08-17T02:26:07.225788+0000","last_became_active":"2024-08-17T02:26:06.207013+0000","last_became_peered":"2024-08-17T02:26:06.207013+0000","last_unstale":"2024-08-17T02:26:07.225788+0000","last_undegraded":"2024-08-17T02:26:07.225788+0000","last_fullsized":"2024-08-17T02:26:07.225788+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:45:18.073413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.230677+0000","last_change":"2024-08-17T02:26:07.230677+0000","last_active":"2024-08-17T02:26:07.230677+0000","last_peered":"2024-08-17T02:26:07.230677+0000","last_clean":"2024-08-17T02:26:07.230677+0000","last_became_active":"2024-08-17T02:26:07.227917+0000","last_became_peered":"2024-08-17T02:26:07.227917+0000","last_unstale":"2024-08-17T02:26:07.230677+0000","last_undegraded":"2024-08-17T02:26:07.230677+0000","last_fullsized":"2024-08-17T02:26:07.230677+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T05:43:44.430002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.213911+0000","last_change":"2024-08-17T02:26:06.210132+0000","last_active":"2024-08-17T02:26:06.213911+0000","last_peered":"2024-08-17T02:26:06.213911+0000","last_clean":"2024-08-17T02:26:06.213911+0000","last_became_active":"2024-08-17T02:26:06.209408+0000","last_became_peered":"2024-08-17T02:26:06.209408+0000","last_unstale":"2024-08-17T02:26:06.213911+0000","last_undegraded":"2024-08-17T02:26:06.213911+0000","last_fullsized":"2024-08-17T02:26:06.213911+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:08:11.655491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.212201+0000","last_change":"2024-08-17T02:26:07.212201+0000","last_active":"2024-08-17T02:26:07.212201+0000","last_peered":"2024-08-17T02:26:07.212201+0000","last_clean":"2024-08-17T02:26:07.212201+0000","last_became_active":"2024-08-17T02:26:07.207913+0000","last_became_peered":"2024-08-17T02:26:07.207913+0000","last_unstale":"2024-08-17T02:26:07.212201+0000","last_undegraded":"2024-08-17T02:26:07.212201+0000","last_fullsized":"2024-08-17T02:26:07.212201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:14:37.210726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.219683+0000","last_change":"2024-08-17T02:26:06.218562+0000","last_active":"2024-08-17T02:26:06.219683+0000","last_peered":"2024-08-17T02:26:06.219683+0000","last_clean":"2024-08-17T02:26:06.219683+0000","last_became_active":"2024-08-17T02:26:06.218283+0000","last_became_peered":"2024-08-17T02:26:06.218283+0000","last_unstale":"2024-08-17T02:26:06.219683+0000","last_undegraded":"2024-08-17T02:26:06.219683+0000","last_fullsized":"2024-08-17T02:26:06.219683+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:13:33.072308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.206564+0000","last_change":"2024-08-17T02:26:07.206564+0000","last_active":"2024-08-17T02:26:07.206564+0000","last_peered":"2024-08-17T02:26:07.206564+0000","last_clean":"2024-08-17T02:26:07.206564+0000","last_became_active":"2024-08-17T02:26:07.206281+0000","last_became_peered":"2024-08-17T02:26:07.206281+0000","last_unstale":"2024-08-17T02:26:07.206564+0000","last_undegraded":"2024-08-17T02:26:07.206564+0000","last_fullsized":"2024-08-17T02:26:07.206564+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:17:24.045737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":17,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.238315+0000","last_change":"2024-08-17T02:26:06.213047+0000","last_active":"2024-08-17T02:26:07.238315+0000","last_peered":"2024-08-17T02:26:07.238315+0000","last_clean":"2024-08-17T02:26:07.238315+0000","last_became_active":"2024-08-17T02:26:06.212767+0000","last_became_peered":"2024-08-17T02:26:06.212767+0000","last_unstale":"2024-08-17T02:26:07.238315+0000","last_undegraded":"2024-08-17T02:26:07.238315+0000","last_fullsized":"2024-08-17T02:26:07.238315+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:29.737941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.208162+0000","last_change":"2024-08-17T02:26:07.208162+0000","last_active":"2024-08-17T02:26:07.208162+0000","last_peered":"2024-08-17T02:26:07.208162+0000","last_clean":"2024-08-17T02:26:07.208162+0000","last_became_active":"2024-08-17T02:26:07.207898+0000","last_became_peered":"2024-08-17T02:26:07.207898+0000","last_unstale":"2024-08-17T02:26:07.208162+0000","last_undegraded":"2024-08-17T02:26:07.208162+0000","last_fullsized":"2024-08-17T02:26:07.208162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:57.134550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.209752+0000","last_change":"2024-08-17T02:26:06.216282+0000","last_active":"2024-08-17T02:26:07.209752+0000","last_peered":"2024-08-17T02:26:07.209752+0000","last_clean":"2024-08-17T02:26:07.209752+0000","last_became_active":"2024-08-17T02:26:06.215974+0000","last_became_peered":"2024-08-17T02:26:06.215974+0000","last_unstale":"2024-08-17T02:26:07.209752+0000","last_undegraded":"2024-08-17T02:26:07.209752+0000","last_fullsized":"2024-08-17T02:26:07.209752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:41.153882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.206100+0000","last_change":"2024-08-17T02:26:07.206100+0000","last_active":"2024-08-17T02:26:07.206100+0000","last_peered":"2024-08-17T02:26:07.206100+0000","last_clean":"2024-08-17T02:26:07.206100+0000","last_became_active":"2024-08-17T02:26:07.205856+0000","last_became_peered":"2024-08-17T02:26:07.205856+0000","last_unstale":"2024-08-17T02:26:07.206100+0000","last_undegraded":"2024-08-17T02:26:07.206100+0000","last_fullsized":"2024-08-17T02:26:07.206100+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:40:31.952730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.226073+0000","last_change":"2024-08-17T02:26:06.207822+0000","last_active":"2024-08-17T02:26:07.226073+0000","last_peered":"2024-08-17T02:26:07.226073+0000","last_clean":"2024-08-17T02:26:07.226073+0000","last_became_active":"2024-08-17T02:26:06.207526+0000","last_became_peered":"2024-08-17T02:26:06.207526+0000","last_unstale":"2024-08-17T02:26:07.226073+0000","last_undegraded":"2024-08-17T02:26:07.226073+0000","last_fullsized":"2024-08-17T02:26:07.226073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:34.186776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.213006+0000","last_change":"2024-08-17T02:26:07.213006+0000","last_active":"2024-08-17T02:26:07.213006+0000","last_peered":"2024-08-17T02:26:07.213006+0000","last_clean":"2024-08-17T02:26:07.213006+0000","last_became_active":"2024-08-17T02:26:07.212418+0000","last_became_peered":"2024-08-17T02:26:07.212418+0000","last_unstale":"2024-08-17T02:26:07.213006+0000","last_undegraded":"2024-08-17T02:26:07.213006+0000","last_fullsized":"2024-08-17T02:26:07.213006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:26:57.134550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.201766+0000","last_change":"2024-08-17T02:26:06.210028+0000","last_active":"2024-08-17T02:26:07.201766+0000","last_peered":"2024-08-17T02:26:07.201766+0000","last_clean":"2024-08-17T02:26:07.201766+0000","last_became_active":"2024-08-17T02:26:06.208858+0000","last_became_peered":"2024-08-17T02:26:06.208858+0000","last_unstale":"2024-08-17T02:26:07.201766+0000","last_undegraded":"2024-08-17T02:26:07.201766+0000","last_fullsized":"2024-08-17T02:26:07.201766+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:45:54.398057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.211737+0000","last_change":"2024-08-17T02:26:07.211737+0000","last_active":"2024-08-17T02:26:07.211737+0000","last_peered":"2024-08-17T02:26:07.211737+0000","last_clean":"2024-08-17T02:26:07.211737+0000","last_became_active":"2024-08-17T02:26:07.211463+0000","last_became_peered":"2024-08-17T02:26:07.211463+0000","last_unstale":"2024-08-17T02:26:07.211737+0000","last_undegraded":"2024-08-17T02:26:07.211737+0000","last_fullsized":"2024-08-17T02:26:07.211737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T10:46:30.744169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.210747+0000","last_change":"2024-08-17T02:26:06.207079+0000","last_active":"2024-08-17T02:26:06.210747+0000","last_peered":"2024-08-17T02:26:06.210747+0000","last_clean":"2024-08-17T02:26:06.210747+0000","last_became_active":"2024-08-17T02:26:06.206695+0000","last_became_peered":"2024-08-17T02:26:06.206695+0000","last_unstale":"2024-08-17T02:26:06.210747+0000","last_undegraded":"2024-08-17T02:26:06.210747+0000","last_fullsized":"2024-08-17T02:26:06.210747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T09:29:26.454627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.203494+0000","last_change":"2024-08-17T02:26:07.203494+0000","last_active":"2024-08-17T02:26:07.203494+0000","last_peered":"2024-08-17T02:26:07.203494+0000","last_clean":"2024-08-17T02:26:07.203494+0000","last_became_active":"2024-08-17T02:26:07.203144+0000","last_became_peered":"2024-08-17T02:26:07.203144+0000","last_unstale":"2024-08-17T02:26:07.203494+0000","last_undegraded":"2024-08-17T02:26:07.203494+0000","last_fullsized":"2024-08-17T02:26:07.203494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:42.160110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.225541+0000","last_change":"2024-08-17T02:26:06.215253+0000","last_active":"2024-08-17T02:26:07.225541+0000","last_peered":"2024-08-17T02:26:07.225541+0000","last_clean":"2024-08-17T02:26:07.225541+0000","last_became_active":"2024-08-17T02:26:06.213063+0000","last_became_peered":"2024-08-17T02:26:06.213063+0000","last_unstale":"2024-08-17T02:26:07.225541+0000","last_undegraded":"2024-08-17T02:26:07.225541+0000","last_fullsized":"2024-08-17T02:26:07.225541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:46:03.847541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.216818+0000","last_change":"2024-08-17T02:26:07.216818+0000","last_active":"2024-08-17T02:26:07.216818+0000","last_peered":"2024-08-17T02:26:07.216818+0000","last_clean":"2024-08-17T02:26:07.216818+0000","last_became_active":"2024-08-17T02:26:07.216573+0000","last_became_peered":"2024-08-17T02:26:07.216573+0000","last_unstale":"2024-08-17T02:26:07.216818+0000","last_undegraded":"2024-08-17T02:26:07.216818+0000","last_fullsized":"2024-08-17T02:26:07.216818+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:32.034736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.213932+0000","last_change":"2024-08-17T02:26:06.213079+0000","last_active":"2024-08-17T02:26:06.213932+0000","last_peered":"2024-08-17T02:26:06.213932+0000","last_clean":"2024-08-17T02:26:06.213932+0000","last_became_active":"2024-08-17T02:26:06.212858+0000","last_became_peered":"2024-08-17T02:26:06.212858+0000","last_unstale":"2024-08-17T02:26:06.213932+0000","last_undegraded":"2024-08-17T02:26:06.213932+0000","last_fullsized":"2024-08-17T02:26:06.213932+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:22.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.213514+0000","last_change":"2024-08-17T02:26:07.213514+0000","last_active":"2024-08-17T02:26:07.213514+0000","last_peered":"2024-08-17T02:26:07.213514+0000","last_clean":"2024-08-17T02:26:07.213514+0000","last_became_active":"2024-08-17T02:26:07.213238+0000","last_became_peered":"2024-08-17T02:26:07.213238+0000","last_unstale":"2024-08-17T02:26:07.213514+0000","last_undegraded":"2024-08-17T02:26:07.213514+0000","last_fullsized":"2024-08-17T02:26:07.213514+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:08:12.661719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.217178+0000","last_change":"2024-08-17T02:26:06.215871+0000","last_active":"2024-08-17T02:26:06.217178+0000","last_peered":"2024-08-17T02:26:06.217178+0000","last_clean":"2024-08-17T02:26:06.217178+0000","last_became_active":"2024-08-17T02:26:06.215289+0000","last_became_peered":"2024-08-17T02:26:06.215289+0000","last_unstale":"2024-08-17T02:26:06.217178+0000","last_undegraded":"2024-08-17T02:26:06.217178+0000","last_fullsized":"2024-08-17T02:26:06.217178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:28.410715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.214088+0000","last_change":"2024-08-17T02:26:07.214088+0000","last_active":"2024-08-17T02:26:07.214088+0000","last_peered":"2024-08-17T02:26:07.214088+0000","last_clean":"2024-08-17T02:26:07.214088+0000","last_became_active":"2024-08-17T02:26:07.213801+0000","last_became_peered":"2024-08-17T02:26:07.213801+0000","last_unstale":"2024-08-17T02:26:07.214088+0000","last_undegraded":"2024-08-17T02:26:07.214088+0000","last_fullsized":"2024-08-17T02:26:07.214088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:15:08.200210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.215266+0000","last_change":"2024-08-17T02:26:06.211099+0000","last_active":"2024-08-17T02:26:06.215266+0000","last_peered":"2024-08-17T02:26:06.215266+0000","last_clean":"2024-08-17T02:26:06.215266+0000","last_became_active":"2024-08-17T02:26:06.210803+0000","last_became_peered":"2024-08-17T02:26:06.210803+0000","last_unstale":"2024-08-17T02:26:06.215266+0000","last_undegraded":"2024-08-17T02:26:06.215266+0000","last_fullsized":"2024-08-17T02:26:06.215266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:28:41.153882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.200282+0000","last_change":"2024-08-17T02:26:07.200282+0000","last_active":"2024-08-17T02:26:07.200282+0000","last_peered":"2024-08-17T02:26:07.200282+0000","last_clean":"2024-08-17T02:26:07.200282+0000","last_became_active":"2024-08-17T02:26:07.199990+0000","last_became_peered":"2024-08-17T02:26:07.199990+0000","last_unstale":"2024-08-17T02:26:07.200282+0000","last_undegraded":"2024-08-17T02:26:07.200282+0000","last_fullsized":"2024-08-17T02:26:07.200282+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:29.416944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.233944+0000","last_change":"2024-08-17T02:26:06.216533+0000","last_active":"2024-08-17T02:26:07.233944+0000","last_peered":"2024-08-17T02:26:07.233944+0000","last_clean":"2024-08-17T02:26:07.233944+0000","last_became_active":"2024-08-17T02:26:06.216192+0000","last_became_peered":"2024-08-17T02:26:06.216192+0000","last_unstale":"2024-08-17T02:26:07.233944+0000","last_undegraded":"2024-08-17T02:26:07.233944+0000","last_fullsized":"2024-08-17T02:26:07.233944+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:36:28.410715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.224466+0000","last_change":"2024-08-17T02:26:07.224466+0000","last_active":"2024-08-17T02:26:07.224466+0000","last_peered":"2024-08-17T02:26:07.224466+0000","last_clean":"2024-08-17T02:26:07.224466+0000","last_became_active":"2024-08-17T02:26:07.224056+0000","last_became_peered":"2024-08-17T02:26:07.224056+0000","last_unstale":"2024-08-17T02:26:07.224466+0000","last_undegraded":"2024-08-17T02:26:07.224466+0000","last_fullsized":"2024-08-17T02:26:07.224466+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:37:09.394997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.217371+0000","last_change":"2024-08-17T02:26:06.214068+0000","last_active":"2024-08-17T02:26:06.217371+0000","last_peered":"2024-08-17T02:26:06.217371+0000","last_clean":"2024-08-17T02:26:06.217371+0000","last_became_active":"2024-08-17T02:26:06.213776+0000","last_became_peered":"2024-08-17T02:26:06.213776+0000","last_unstale":"2024-08-17T02:26:06.217371+0000","last_undegraded":"2024-08-17T02:26:06.217371+0000","last_fullsized":"2024-08-17T02:26:06.217371+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:10:23.971148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.227428+0000","last_change":"2024-08-17T02:26:07.227428+0000","last_active":"2024-08-17T02:26:07.227428+0000","last_peered":"2024-08-17T02:26:07.227428+0000","last_clean":"2024-08-17T02:26:07.227428+0000","last_became_active":"2024-08-17T02:26:07.227105+0000","last_became_peered":"2024-08-17T02:26:07.227105+0000","last_unstale":"2024-08-17T02:26:07.227428+0000","last_undegraded":"2024-08-17T02:26:07.227428+0000","last_fullsized":"2024-08-17T02:26:07.227428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:16.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.217468+0000","last_change":"2024-08-17T02:26:06.213511+0000","last_active":"2024-08-17T02:26:06.217468+0000","last_peered":"2024-08-17T02:26:06.217468+0000","last_clean":"2024-08-17T02:26:06.217468+0000","last_became_active":"2024-08-17T02:26:06.211419+0000","last_became_peered":"2024-08-17T02:26:06.211419+0000","last_unstale":"2024-08-17T02:26:06.217468+0000","last_undegraded":"2024-08-17T02:26:06.217468+0000","last_fullsized":"2024-08-17T02:26:06.217468+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:31.028508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.213331+0000","last_change":"2024-08-17T02:26:07.213331+0000","last_active":"2024-08-17T02:26:07.213331+0000","last_peered":"2024-08-17T02:26:07.213331+0000","last_clean":"2024-08-17T02:26:07.213331+0000","last_became_active":"2024-08-17T02:26:07.212881+0000","last_became_peered":"2024-08-17T02:26:07.212881+0000","last_unstale":"2024-08-17T02:26:07.213331+0000","last_undegraded":"2024-08-17T02:26:07.213331+0000","last_fullsized":"2024-08-17T02:26:07.213331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:23:16.866505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.217211+0000","last_change":"2024-08-17T02:26:06.212317+0000","last_active":"2024-08-17T02:26:06.217211+0000","last_peered":"2024-08-17T02:26:06.217211+0000","last_clean":"2024-08-17T02:26:06.217211+0000","last_became_active":"2024-08-17T02:26:06.207149+0000","last_became_peered":"2024-08-17T02:26:06.207149+0000","last_unstale":"2024-08-17T02:26:06.217211+0000","last_undegraded":"2024-08-17T02:26:06.217211+0000","last_fullsized":"2024-08-17T02:26:06.217211+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:25:34.186776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.215388+0000","last_change":"2024-08-17T02:26:07.215388+0000","last_active":"2024-08-17T02:26:07.215388+0000","last_peered":"2024-08-17T02:26:07.215388+0000","last_clean":"2024-08-17T02:26:07.215388+0000","last_became_active":"2024-08-17T02:26:07.215130+0000","last_became_peered":"2024-08-17T02:26:07.215130+0000","last_unstale":"2024-08-17T02:26:07.215388+0000","last_undegraded":"2024-08-17T02:26:07.215388+0000","last_fullsized":"2024-08-17T02:26:07.215388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:32:26.999382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.213389+0000","last_change":"2024-08-17T02:26:06.209428+0000","last_active":"2024-08-17T02:26:06.213389+0000","last_peered":"2024-08-17T02:26:06.213389+0000","last_clean":"2024-08-17T02:26:06.213389+0000","last_became_active":"2024-08-17T02:26:06.208621+0000","last_became_peered":"2024-08-17T02:26:06.208621+0000","last_unstale":"2024-08-17T02:26:06.213389+0000","last_undegraded":"2024-08-17T02:26:06.213389+0000","last_fullsized":"2024-08-17T02:26:06.213389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T08:53:22.308267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.223503+0000","last_change":"2024-08-17T02:26:07.223503+0000","last_active":"2024-08-17T02:26:07.223503+0000","last_peered":"2024-08-17T02:26:07.223503+0000","last_clean":"2024-08-17T02:26:07.223503+0000","last_became_active":"2024-08-17T02:26:07.222936+0000","last_became_peered":"2024-08-17T02:26:07.222936+0000","last_unstale":"2024-08-17T02:26:07.223503+0000","last_undegraded":"2024-08-17T02:26:07.223503+0000","last_fullsized":"2024-08-17T02:26:07.223503+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:30:11.892494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.210638+0000","last_change":"2024-08-17T02:26:06.206207+0000","last_active":"2024-08-17T02:26:06.210638+0000","last_peered":"2024-08-17T02:26:06.210638+0000","last_clean":"2024-08-17T02:26:06.210638+0000","last_became_active":"2024-08-17T02:26:06.205938+0000","last_became_peered":"2024-08-17T02:26:06.205938+0000","last_unstale":"2024-08-17T02:26:06.210638+0000","last_undegraded":"2024-08-17T02:26:06.210638+0000","last_fullsized":"2024-08-17T02:26:06.210638+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T13:09:23.897071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.225532+0000","last_change":"2024-08-17T02:26:07.225532+0000","last_active":"2024-08-17T02:26:07.225532+0000","last_peered":"2024-08-17T02:26:07.225532+0000","last_clean":"2024-08-17T02:26:07.225532+0000","last_became_active":"2024-08-17T02:26:07.225282+0000","last_became_peered":"2024-08-17T02:26:07.225282+0000","last_unstale":"2024-08-17T02:26:07.225532+0000","last_undegraded":"2024-08-17T02:26:07.225532+0000","last_fullsized":"2024-08-17T02:26:07.225532+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T14:08:30.864474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.218706+0000","last_change":"2024-08-17T02:26:06.216372+0000","last_active":"2024-08-17T02:26:06.218706+0000","last_peered":"2024-08-17T02:26:06.218706+0000","last_clean":"2024-08-17T02:26:06.218706+0000","last_became_active":"2024-08-17T02:26:06.216099+0000","last_became_peered":"2024-08-17T02:26:06.216099+0000","last_unstale":"2024-08-17T02:26:06.218706+0000","last_undegraded":"2024-08-17T02:26:06.218706+0000","last_fullsized":"2024-08-17T02:26:06.218706+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T04:18:31.028508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":8,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-08-17T02:26:07.212936+0000","last_change":"2024-08-17T02:26:07.212936+0000","last_active":"2024-08-17T02:26:07.212936+0000","last_peered":"2024-08-17T02:26:07.212936+0000","last_clean":"2024-08-17T02:26:07.212936+0000","last_became_active":"2024-08-17T02:26:07.212570+0000","last_became_peered":"2024-08-17T02:26:07.212570+0000","last_unstale":"2024-08-17T02:26:07.212936+0000","last_undegraded":"2024-08-17T02:26:07.212936+0000","last_fullsized":"2024-08-17T02:26:07.212936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:06.182488+0000","last_clean_scrub_stamp":"2024-08-17T02:26:06.182488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T11:23:50.673521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.211610+0000","last_change":"2024-08-17T02:26:06.209727+0000","last_active":"2024-08-17T02:26:06.211610+0000","last_peered":"2024-08-17T02:26:06.211610+0000","last_clean":"2024-08-17T02:26:06.211610+0000","last_became_active":"2024-08-17T02:26:06.209468+0000","last_became_peered":"2024-08-17T02:26:06.209468+0000","last_unstale":"2024-08-17T02:26:06.211610+0000","last_undegraded":"2024-08-17T02:26:06.211610+0000","last_fullsized":"2024-08-17T02:26:06.211610+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:26:05.176259+0000","last_clean_scrub_stamp":"2024-08-17T02:26:05.176259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T12:08:11.655491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-08-17T02:26:06.208828+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:26:06.208828+0000","last_peered":"2024-08-17T02:26:06.208828+0000","last_clean":"2024-08-17T02:26:06.208828+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:26:06.208828+0000","last_undegraded":"2024-08-17T02:26:06.208828+0000","last_fullsized":"2024-08-17T02:26:06.208828+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2338,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298288,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073552,"statfs":{"total":96636764160,"available":96331317248,"internally_reserved":0,"allocated":946176,"data_stored":724478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.173,"5min":1.173,"15min":1.173},"last":0.79200000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61699999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.629}]},{"osd":3,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.70499999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.69199999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.746},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.71699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":335872,"data_stored":127257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.61199999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.339,"5min":1.339,"15min":1.339},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.63500000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.7160000000000002,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.57799999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.75},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":4.8449999999999998,"5min":4.8449999999999998,"15min":4.8449999999999998},"last":0.70199999999999996}]},{"osd":4,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.804,"5min":1.804,"15min":1.804},"last":0.77700000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71399999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297712,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074128,"statfs":{"total":96636764160,"available":96331907072,"internally_reserved":0,"allocated":356352,"data_stored":134680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.59599999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.76300000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.623},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60999999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.751}]},{"osd":4,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.50800000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2769999999999999,"5min":1.2769999999999999,"15min":1.2769999999999999},"last":0.73099999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:03 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.55300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297688,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94074152,"statfs":{"total":96636764160,"available":96331931648,"internally_reserved":0,"allocated":335872,"data_stored":127257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":4.5339999999999998,"5min":4.5339999999999998,"15min":4.5339999999999998},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":4.5119999999999996,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.72299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.76100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.59299999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.47399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.432},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:26:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.498}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":135594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.37},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47999999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":1.349,"5min":1.349,"15min":1.349},"last":0.51900000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.439}]},{"osd":4,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.59399999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.70799999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.68899999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.446,"5min":1.446,"15min":1.446},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.61599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301844,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069996,"statfs":{"total":96636764160,"available":96327675904,"internally_reserved":0,"allocated":335872,"data_stored":127257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.3969999999999998,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.50700000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":3.1869999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.46300000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":3.0800000000000001,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.58999999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.4790000000000001,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.72699999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.444,"5min":2.444,"15min":2.444},"last":0.69299999999999995}]},{"osd":6,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":2.3420000000000001,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:26:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.512,"5min":2.512,"15min":2.512},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.67100000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":301872,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069968,"statfs":{"total":96636764160,"available":96327647232,"internally_reserved":0,"allocated":364544,"data_stored":135594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.435},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.40500000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.46000000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.66200000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.71999999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:26:02 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.63500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302444,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069396,"statfs":{"total":96636764160,"available":96327061504,"internally_reserved":0,"allocated":942080,"data_stored":724388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.623}]},{"osd":2,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.66400000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.48399999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.071,"5min":1.071,"15min":1.071},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.83799999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.81999999999999995}]},{"osd":7,"last update":"Sat Aug 17 02:26:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.752}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:26:11.813 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-08-17T02:26:11.813 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-08-17T02:26:12.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.006+0000 7fc417200640 1 Processor -- start 2024-08-17T02:26:12.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.006+0000 7fc417200640 1 -- start start 2024-08-17T02:26:12.008 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.007+0000 7fc417200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc410158b60 0x7fc4100abb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.008+0000 7fc417200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4100aa960 con 0x7fc410158f30 2024-08-17T02:26:12.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.008+0000 7fc417200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4100ab6a0 con 0x7fc4100ac070 2024-08-17T02:26:12.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.008+0000 7fc417200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4100aa3a0 con 0x7fc410158b60 2024-08-17T02:26:12.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.008+0000 7fc415e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc410158b60 0x7fc4100abb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.008+0000 7fc416800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc410158f30 0x7fc4100ac500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43854/0 (socket says 172.21.15.45:43854) 2024-08-17T02:26:12.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.008+0000 7fc415e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc410158b60 0x7fc4100abb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41090/0 (socket says 172.21.15.45:41090) 2024-08-17T02:26:12.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.008+0000 7fc416800640 1 -- 172.21.15.45:0/2050302897 learned_addr learned my addr 172.21.15.45:0/2050302897 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:12.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.008+0000 7fc415e00640 1 -- 172.21.15.45:0/2050302897 >> v1:172.21.15.169:6789/0 conn(0x7fc4100ac070 legacy=0x7fc4100a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:12.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.008+0000 7fc415e00640 1 -- 172.21.15.45:0/2050302897 >> v1:172.21.15.45:6789/0 conn(0x7fc410158f30 legacy=0x7fc4100ac500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.008+0000 7fc415e00640 1 -- 172.21.15.45:0/2050302897 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4100aa680 con 0x7fc410158b60 2024-08-17T02:26:12.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.009+0000 7fc415e00640 1 --2- 172.21.15.45:0/2050302897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc410158b60 0x7fc4100abb30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc404009850 tx=0x7fc4040090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9511044fcc229393 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.010+0000 7fc414a00640 1 -- 172.21.15.45:0/2050302897 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40402ad90 con 0x7fc410158b60 2024-08-17T02:26:12.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.010+0000 7fc414a00640 1 -- 172.21.15.45:0/2050302897 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc404032440 con 0x7fc410158b60 2024-08-17T02:26:12.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.010+0000 7fc414a00640 1 -- 172.21.15.45:0/2050302897 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404032820 con 0x7fc410158b60 2024-08-17T02:26:12.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.010+0000 7fc417200640 1 -- 172.21.15.45:0/2050302897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc410158b60 msgr2=0x7fc4100abb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.010+0000 7fc417200640 1 --2- 172.21.15.45:0/2050302897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc410158b60 0x7fc4100abb30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fc404009850 tx=0x7fc4040090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.010+0000 7fc417200640 1 -- 172.21.15.45:0/2050302897 shutdown_connections 2024-08-17T02:26:12.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.010+0000 7fc417200640 1 --2- 172.21.15.45:0/2050302897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc410158b60 0x7fc4100abb30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.010+0000 7fc417200640 1 -- 172.21.15.45:0/2050302897 >> 172.21.15.45:0/2050302897 conn(0x7fc410067750 msgr2=0x7fc4100cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.010+0000 7fc417200640 1 -- 172.21.15.45:0/2050302897 shutdown_connections 2024-08-17T02:26:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.010+0000 7fc417200640 1 -- 172.21.15.45:0/2050302897 wait complete. 2024-08-17T02:26:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.012+0000 7fc417200640 1 Processor -- start 2024-08-17T02:26:12.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.012+0000 7fc417200640 1 -- start start 2024-08-17T02:26:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.012+0000 7fc417200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4100ac070 0x7fc4101452a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc417200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc410158b60 0x7fc4100c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc417200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc410158f30 0x7fc4100ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc417200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100c3760 con 0x7fc410158f30 2024-08-17T02:26:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc417200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100c2b50 con 0x7fc410158b60 2024-08-17T02:26:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc417200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100c2e30 con 0x7fc4100ac070 2024-08-17T02:26:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc416800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc410158f30 0x7fc4100ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc416800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc410158f30 0x7fc4100ac4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41100/0 (socket says 172.21.15.45:41100) 2024-08-17T02:26:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc416800640 1 -- 172.21.15.45:0/1136108626 learned_addr learned my addr 172.21.15.45:0/1136108626 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc415e00640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4100ac070 0x7fc4101452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc415400640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc410158b60 0x7fc4100c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc416800640 1 -- 172.21.15.45:0/1136108626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4100ac070 msgr2=0x7fc4101452a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc416800640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4100ac070 0x7fc4101452a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc416800640 1 -- 172.21.15.45:0/1136108626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc410158b60 msgr2=0x7fc4100c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc416800640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc410158b60 0x7fc4100c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.013+0000 7fc416800640 1 -- 172.21.15.45:0/1136108626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404009390 con 0x7fc410158f30 2024-08-17T02:26:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.014+0000 7fc416800640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc410158f30 0x7fc4100ac4e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00cbc0 tx=0x7fc40c0019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.014+0000 7fc409600640 1 -- 172.21.15.45:0/1136108626 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c00a640 con 0x7fc410158f30 2024-08-17T02:26:12.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.014+0000 7fc409600640 1 -- 172.21.15.45:0/1136108626 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c00a7a0 con 0x7fc410158f30 2024-08-17T02:26:12.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.014+0000 7fc417200640 1 -- 172.21.15.45:0/1136108626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4100c3110 con 0x7fc410158f30 2024-08-17T02:26:12.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.014+0000 7fc409600640 1 -- 172.21.15.45:0/1136108626 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c00ab20 con 0x7fc410158f30 2024-08-17T02:26:12.016 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.014+0000 7fc417200640 1 -- 172.21.15.45:0/1136108626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4101457e0 con 0x7fc410158f30 2024-08-17T02:26:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.015+0000 7fc417200640 1 -- 172.21.15.45:0/1136108626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4100c38d0 con 0x7fc410158f30 2024-08-17T02:26:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.016+0000 7fc409600640 1 -- 172.21.15.45:0/1136108626 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc40c007300 con 0x7fc410158f30 2024-08-17T02:26:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.016+0000 7fc409600640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc3f4065150 0x7fc3f4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.017+0000 7fc409600640 1 -- 172.21.15.45:0/1136108626 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc40c0826f0 con 0x7fc410158f30 2024-08-17T02:26:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.017+0000 7fc415e00640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc3f4065150 0x7fc3f4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.017+0000 7fc415e00640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc3f4065150 0x7fc3f4067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc404034000 tx=0x7fc404032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.020+0000 7fc409600640 1 -- 172.21.15.45:0/1136108626 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc40c050790 con 0x7fc410158f30 2024-08-17T02:26:12.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.270+0000 7fc417200640 1 -- 172.21.15.45:0/1136108626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc410071050 con 0x7fc410158f30 2024-08-17T02:26:12.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.274+0000 7fc409600640 1 -- 172.21.15.45:0/1136108626 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc40c004b20 con 0x7fc410158f30 2024-08-17T02:26:12.274 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2024-08-17T02:26:12.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 -- 172.21.15.45:0/1136108626 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc3f4065150 msgr2=0x7fc3f4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc3f4065150 0x7fc3f4067600 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc404034000 tx=0x7fc404032000 comp rx=0 tx=0).stop 2024-08-17T02:26:12.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 -- 172.21.15.45:0/1136108626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc410158f30 msgr2=0x7fc4100ac4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc410158f30 0x7fc4100ac4e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc40c00cbc0 tx=0x7fc40c0019c0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 -- 172.21.15.45:0/1136108626 shutdown_connections 2024-08-17T02:26:12.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc410158f30 0x7fc4100ac4e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc410158b60 0x7fc4100c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc3f4065150 0x7fc3f4067600 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 --2- 172.21.15.45:0/1136108626 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc4100ac070 0x7fc4101452a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 -- 172.21.15.45:0/1136108626 >> 172.21.15.45:0/1136108626 conn(0x7fc410067750 msgr2=0x7fc4100cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 -- 172.21.15.45:0/1136108626 shutdown_connections 2024-08-17T02:26:12.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.276+0000 7fc417200640 1 -- 172.21.15.45:0/1136108626 wait complete. 2024-08-17T02:26:12.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:26:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.441+0000 7f5e34a00640 1 Processor -- start 2024-08-17T02:26:12.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.441+0000 7f5e34a00640 1 -- start start 2024-08-17T02:26:12.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.443+0000 7f5e34a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5e3006df00 0x7f5e300adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.443+0000 7f5e34a00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e30156670 con 0x7f5e30155a20 2024-08-17T02:26:12.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.443+0000 7f5e34a00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e3006e5e0 con 0x7f5e30155df0 2024-08-17T02:26:12.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.443+0000 7f5e34a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e300b0350 con 0x7f5e3006df00 2024-08-17T02:26:12.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.443+0000 7f5e2de00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5e30155a20 0x7f5e3006d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43858/0 (socket says 172.21.15.45:43858) 2024-08-17T02:26:12.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.443+0000 7f5e2de00640 1 -- 172.21.15.45:0/748853289 learned_addr learned my addr 172.21.15.45:0/748853289 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:12.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.443+0000 7f5e2d400640 1 --2- 172.21.15.45:0/748853289 >> v2:172.21.15.169:3300/0 conn(0x7f5e3006df00 0x7f5e300adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.443+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3850179861 0 0) 0x7f5e30156670 con 0x7f5e30155a20 2024-08-17T02:26:12.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.443+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e140034e0 con 0x7f5e30155a20 2024-08-17T02:26:12.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064653713 0 0) 0x7f5e3006e5e0 con 0x7f5e30155df0 2024-08-17T02:26:12.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e30156670 con 0x7f5e30155df0 2024-08-17T02:26:12.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4264085354 0 0) 0x7f5e140034e0 con 0x7f5e30155a20 2024-08-17T02:26:12.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 >> v2:172.21.15.169:3300/0 conn(0x7f5e3006df00 msgr2=0x7f5e300adf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:12.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 --2- 172.21.15.45:0/748853289 >> v2:172.21.15.169:3300/0 conn(0x7f5e3006df00 0x7f5e300adf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.446 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 >> v1:172.21.15.169:6789/0 conn(0x7f5e30155df0 legacy=0x7f5e30156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3006e8c0 con 0x7f5e30155a20 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7f5e200013f0 con 0x7f5e30155a20 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 >> v1:172.21.15.45:6789/0 conn(0x7f5e30155a20 legacy=0x7f5e3006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 --2- 172.21.15.45:0/748853289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e14003bb0 0x7f5e14003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 --2- 172.21.15.45:0/748853289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e14004780 0x7f5e14004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 --2- 172.21.15.45:0/748853289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e14005180 0x7f5e1400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1400c0f0 con 0x7f5e14004780 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1400e470 con 0x7f5e14005180 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1400e630 con 0x7f5e14003bb0 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2d400640 1 --2- 172.21.15.45:0/748853289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e14004780 0x7f5e14004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2e800640 1 --2- 172.21.15.45:0/748853289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e14005180 0x7f5e1400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.444+0000 7f5e2de00640 1 --2- 172.21.15.45:0/748853289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e14003bb0 0x7f5e14003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.445+0000 7f5e2d400640 1 -- 172.21.15.45:0/748853289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e14003bb0 msgr2=0x7f5e14003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:12.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.445+0000 7f5e2d400640 1 --2- 172.21.15.45:0/748853289 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e14003bb0 0x7f5e14003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.445+0000 7f5e2d400640 1 -- 172.21.15.45:0/748853289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e14005180 msgr2=0x7f5e1400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:12.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.445+0000 7f5e2d400640 1 --2- 172.21.15.45:0/748853289 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e14005180 0x7f5e1400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.445+0000 7f5e2d400640 1 -- 172.21.15.45:0/748853289 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e140034e0 con 0x7f5e14004780 2024-08-17T02:26:12.448 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.445+0000 7f5e2e800640 1 -- 172.21.15.45:0/748853289 reap_dead start 2024-08-17T02:26:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.446+0000 7f5e2d400640 1 --2- 172.21.15.45:0/748853289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e14004780 0x7f5e14004bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c006e70 tx=0x7f5e1c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f898a1fd77075ce9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.446+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c031400 con 0x7f5e14004780 2024-08-17T02:26:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.446+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c02d050 con 0x7f5e14004780 2024-08-17T02:26:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.446+0000 7f5e2ca00640 1 -- 172.21.15.45:0/748853289 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c031790 con 0x7f5e14004780 2024-08-17T02:26:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.447+0000 7f5e34a00640 1 -- 172.21.15.45:0/748853289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e14004780 msgr2=0x7f5e14004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.447+0000 7f5e34a00640 1 --2- 172.21.15.45:0/748853289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e14004780 0x7f5e14004bf0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c006e70 tx=0x7f5e1c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.447+0000 7f5e34a00640 1 -- 172.21.15.45:0/748853289 shutdown_connections 2024-08-17T02:26:12.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.447+0000 7f5e34a00640 1 --2- 172.21.15.45:0/748853289 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e14004780 0x7f5e14004bf0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.447+0000 7f5e34a00640 1 -- 172.21.15.45:0/748853289 >> 172.21.15.45:0/748853289 conn(0x7f5e300cb9b0 msgr2=0x7f5e300cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.447+0000 7f5e34a00640 1 -- 172.21.15.45:0/748853289 shutdown_connections 2024-08-17T02:26:12.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.447+0000 7f5e34a00640 1 -- 172.21.15.45:0/748853289 wait complete. 2024-08-17T02:26:12.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.448+0000 7f5e34a00640 1 Processor -- start 2024-08-17T02:26:12.450 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.448+0000 7f5e34a00640 1 -- start start 2024-08-17T02:26:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.449+0000 7f5e34a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e14004780 0x7f5e3014f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.449+0000 7f5e34a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e30165b90 0x7f5e300a7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.449+0000 7f5e34a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e300ac720 0x7f5e300acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.449+0000 7f5e34a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300a54d0 con 0x7f5e300ac720 2024-08-17T02:26:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.449+0000 7f5e34a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300a87b0 con 0x7f5e30165b90 2024-08-17T02:26:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.449+0000 7f5e34a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e300a8a50 con 0x7f5e14004780 2024-08-17T02:26:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2e800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e300ac720 0x7f5e300acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2e800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e300ac720 0x7f5e300acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41130/0 (socket says 172.21.15.45:41130) 2024-08-17T02:26:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2e800640 1 -- 172.21.15.45:0/2577935337 learned_addr learned my addr 172.21.15.45:0/2577935337 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:12.452 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2de00640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e14004780 0x7f5e3014f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2d400640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e30165b90 0x7f5e300a7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2e800640 1 -- 172.21.15.45:0/2577935337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e14004780 msgr2=0x7f5e3014f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2e800640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e14004780 0x7f5e3014f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2e800640 1 -- 172.21.15.45:0/2577935337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e30165b90 msgr2=0x7f5e300a7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2e800640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e30165b90 0x7f5e300a7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2e800640 1 -- 172.21.15.45:0/2577935337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e300a8d30 con 0x7f5e300ac720 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2d400640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e30165b90 0x7f5e300a7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e2e800640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e300ac720 0x7f5e300acb70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5e3006aa10 tx=0x7f5e28007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e25600640 1 -- 172.21.15.45:0/2577935337 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2800ee80 con 0x7f5e300ac720 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e25600640 1 -- 172.21.15.45:0/2577935337 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e28006d20 con 0x7f5e300ac720 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.450+0000 7f5e25600640 1 -- 172.21.15.45:0/2577935337 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e280146d0 con 0x7f5e300ac720 2024-08-17T02:26:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.451+0000 7f5e34a00640 1 -- 172.21.15.45:0/2577935337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e300a9010 con 0x7f5e300ac720 2024-08-17T02:26:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.451+0000 7f5e34a00640 1 -- 172.21.15.45:0/2577935337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e3014f9a0 con 0x7f5e300ac720 2024-08-17T02:26:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.452+0000 7f5e34a00640 1 -- 172.21.15.45:0/2577935337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e300a9510 con 0x7f5e300ac720 2024-08-17T02:26:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.452+0000 7f5e25600640 1 -- 172.21.15.45:0/2577935337 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5e28007030 con 0x7f5e300ac720 2024-08-17T02:26:12.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.453+0000 7f5e25600640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e10065150 0x7f5e10067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:12.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.453+0000 7f5e25600640 1 -- 172.21.15.45:0/2577935337 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5e280818b0 con 0x7f5e300ac720 2024-08-17T02:26:12.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.454+0000 7f5e2de00640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e10065150 0x7f5e10067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:12.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.454+0000 7f5e2de00640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e10065150 0x7f5e10067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5e20001200 tx=0x7f5e20001ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:12.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.457+0000 7f5e25600640 1 -- 172.21.15.45:0/2577935337 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5e2804f980 con 0x7f5e300ac720 2024-08-17T02:26:12.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.676+0000 7f5e34a00640 1 -- 172.21.15.45:0/2577935337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e30064db0 con 0x7f5e300ac720 2024-08-17T02:26:12.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.677+0000 7f5e25600640 1 -- 172.21.15.45:0/2577935337 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f5e28052fa0 con 0x7f5e300ac720 2024-08-17T02:26:12.678 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:12.678 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2570743735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2570743735},{"type":"v1","addr":"172.21.15.169:6834","nonce":2570743735}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1704272549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1704272549},{"type":"v1","addr":"172.21.15.169:6835","nonce":1704272549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4912,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/569206503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":569206503},{"type":"v1","addr":"172.21.15.45:6837","nonce":569206503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:06.620196+0000","modified":"2024-08-17T02:26:10.215482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6836/618002034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":618002034},{"type":"v1","addr":"172.21.15.45:6836","nonce":618002034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2024-08-17T02:26:12.678 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2024-08-17T02:26:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 -- 172.21.15.45:0/2577935337 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e10065150 msgr2=0x7f5e10067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e10065150 0x7f5e10067600 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5e20001200 tx=0x7f5e20001ca0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 -- 172.21.15.45:0/2577935337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e300ac720 msgr2=0x7f5e300acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e300ac720 0x7f5e300acb70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f5e3006aa10 tx=0x7f5e28007f90 comp rx=0 tx=0).stop 2024-08-17T02:26:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 -- 172.21.15.45:0/2577935337 shutdown_connections 2024-08-17T02:26:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e300ac720 0x7f5e300acb70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5e30165b90 0x7f5e300a7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5e10065150 0x7f5e10067600 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 --2- 172.21.15.45:0/2577935337 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5e14004780 0x7f5e3014f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:12.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 -- 172.21.15.45:0/2577935337 >> 172.21.15.45:0/2577935337 conn(0x7f5e300cb9b0 msgr2=0x7f5e301504b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:12.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 -- 172.21.15.45:0/2577935337 shutdown_connections 2024-08-17T02:26:12.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:12.679+0000 7f5e34a00640 1 -- 172.21.15.45:0/2577935337 wait complete. 2024-08-17T02:26:13.098 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-17T02:26:06.620196+0000', 'modified': '2024-08-17T02:26:10.215482+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4926}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4926': {'gid': 4926, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6836/618002034', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6834', 'nonce': 618002034}, {'type': 'v1', 'addr': '172.21.15.45:6836', 'nonce': 618002034}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-08-17T02:26:13.098 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-17T02:26:13.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-08-17T02:26:13.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.252+0000 7f63df000640 1 Processor -- start 2024-08-17T02:26:13.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.253+0000 7f63df000640 1 -- start start 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.254+0000 7f63df000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63d8155900 0x7f63d8155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.254+0000 7f63df000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d80b0270 0x7f63d8156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.254+0000 7f63df000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f63d8157b20 0x7f63d8157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.254+0000 7f63df000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d8157690 con 0x7f63d8155900 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.254+0000 7f63df000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d8156a80 con 0x7f63d8157b20 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.254+0000 7f63df000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d8156d60 con 0x7f63d80b0270 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.254+0000 7f63ddc00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63d8155900 0x7f63d8155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.254+0000 7f63ddc00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63d8155900 0x7f63d8155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41142/0 (socket says 172.21.15.45:41142) 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.254+0000 7f63ddc00640 1 -- 172.21.15.45:0/114910690 learned_addr learned my addr 172.21.15.45:0/114910690 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.254+0000 7f63de600640 1 --2- 172.21.15.45:0/114910690 >> v2:172.21.15.169:3300/0 conn(0x7f63d8157b20 0x7f63d8157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.254+0000 7f63dd200640 1 --2- 172.21.15.45:0/114910690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d80b0270 0x7f63d8156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.255+0000 7f63ddc00640 1 -- 172.21.15.45:0/114910690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d80b0270 msgr2=0x7f63d8156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.255+0000 7f63ddc00640 1 --2- 172.21.15.45:0/114910690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d80b0270 0x7f63d8156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.255+0000 7f63ddc00640 1 -- 172.21.15.45:0/114910690 >> v2:172.21.15.169:3300/0 conn(0x7f63d8157b20 msgr2=0x7f63d8157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.255+0000 7f63ddc00640 1 --2- 172.21.15.45:0/114910690 >> v2:172.21.15.169:3300/0 conn(0x7f63d8157b20 0x7f63d8157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.255+0000 7f63ddc00640 1 -- 172.21.15.45:0/114910690 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d8157040 con 0x7f63d8155900 2024-08-17T02:26:13.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.255+0000 7f63dd200640 1 --2- 172.21.15.45:0/114910690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d80b0270 0x7f63d8156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:13.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.256+0000 7f63ddc00640 1 --2- 172.21.15.45:0/114910690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8155900 0x7f63d8155cd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f63d80cc860 tx=0x7f63cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df59a64b701651d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.256+0000 7f63d7e00640 1 -- 172.21.15.45:0/114910690 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc02ad40 con 0x7f63d8155900 2024-08-17T02:26:13.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.256+0000 7f63d7e00640 1 -- 172.21.15.45:0/114910690 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc032440 con 0x7f63d8155900 2024-08-17T02:26:13.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.256+0000 7f63d7e00640 1 -- 172.21.15.45:0/114910690 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc02aea0 con 0x7f63d8155900 2024-08-17T02:26:13.258 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.256+0000 7f63df000640 1 -- 172.21.15.45:0/114910690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8155900 msgr2=0x7f63d8155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.256+0000 7f63df000640 1 --2- 172.21.15.45:0/114910690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8155900 0x7f63d8155cd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f63d80cc860 tx=0x7f63cc0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.257+0000 7f63df000640 1 -- 172.21.15.45:0/114910690 shutdown_connections 2024-08-17T02:26:13.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.257+0000 7f63df000640 1 --2- 172.21.15.45:0/114910690 >> v2:172.21.15.169:3300/0 conn(0x7f63d8157b20 0x7f63d8157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.257+0000 7f63df000640 1 --2- 172.21.15.45:0/114910690 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d80b0270 0x7f63d8156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.257+0000 7f63df000640 1 --2- 172.21.15.45:0/114910690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8155900 0x7f63d8155cd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.257+0000 7f63df000640 1 -- 172.21.15.45:0/114910690 >> 172.21.15.45:0/114910690 conn(0x7f63d8067750 msgr2=0x7f63d80cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.257+0000 7f63df000640 1 -- 172.21.15.45:0/114910690 shutdown_connections 2024-08-17T02:26:13.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.257+0000 7f63df000640 1 -- 172.21.15.45:0/114910690 wait complete. 2024-08-17T02:26:13.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.258+0000 7f63df000640 1 Processor -- start 2024-08-17T02:26:13.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.258+0000 7f63df000640 1 -- start start 2024-08-17T02:26:13.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.259+0000 7f63df000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d80b0270 0x7f63d81678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.259+0000 7f63df000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d8155900 0x7f63d80aab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.259+0000 7f63df000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63d8157b20 0x7f63d80cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.259+0000 7f63df000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80abef0 con 0x7f63d80b0270 2024-08-17T02:26:13.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.259+0000 7f63df000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80ab060 con 0x7f63d8157b20 2024-08-17T02:26:13.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.259+0000 7f63df000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80ab2e0 con 0x7f63d8155900 2024-08-17T02:26:13.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.259+0000 7f63ddc00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d80b0270 0x7f63d81678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.259+0000 7f63ddc00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d80b0270 0x7f63d81678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41158/0 (socket says 172.21.15.45:41158) 2024-08-17T02:26:13.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.259+0000 7f63ddc00640 1 -- 172.21.15.45:0/2974373014 learned_addr learned my addr 172.21.15.45:0/2974373014 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:13.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.260+0000 7f63dd200640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d8155900 0x7f63d80aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.260+0000 7f63de600640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63d8157b20 0x7f63d80cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.260+0000 7f63ddc00640 1 -- 172.21.15.45:0/2974373014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d8155900 msgr2=0x7f63d80aab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.260+0000 7f63ddc00640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d8155900 0x7f63d80aab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.260+0000 7f63ddc00640 1 -- 172.21.15.45:0/2974373014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63d8157b20 msgr2=0x7f63d80cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.260+0000 7f63ddc00640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63d8157b20 0x7f63d80cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.260+0000 7f63ddc00640 1 -- 172.21.15.45:0/2974373014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63cc009450 con 0x7f63d80b0270 2024-08-17T02:26:13.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.260+0000 7f63ddc00640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d80b0270 0x7f63d81678a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009210 tx=0x7f63cc032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.260+0000 7f63d4c00640 1 -- 172.21.15.45:0/2974373014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc032720 con 0x7f63d80b0270 2024-08-17T02:26:13.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.261+0000 7f63d4c00640 1 -- 172.21.15.45:0/2974373014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc031a60 con 0x7f63d80b0270 2024-08-17T02:26:13.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.261+0000 7f63df000640 1 -- 172.21.15.45:0/2974373014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d80ab5c0 con 0x7f63d80b0270 2024-08-17T02:26:13.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.261+0000 7f63d4c00640 1 -- 172.21.15.45:0/2974373014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc031e20 con 0x7f63d80b0270 2024-08-17T02:26:13.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.261+0000 7f63df000640 1 -- 172.21.15.45:0/2974373014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d80abb80 con 0x7f63d80b0270 2024-08-17T02:26:13.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.263+0000 7f63d4c00640 1 -- 172.21.15.45:0/2974373014 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f63cc039040 con 0x7f63d80b0270 2024-08-17T02:26:13.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.264+0000 7f63d4c00640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 0x7f63b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.264+0000 7f63d4c00640 1 -- 172.21.15.45:0/2974373014 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63cc0a22f0 con 0x7f63d80b0270 2024-08-17T02:26:13.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.264+0000 7f63dd200640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 0x7f63b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.264+0000 7f63e2b7f740 1 Processor -- start 2024-08-17T02:26:13.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.264+0000 7f63e2b7f740 1 -- start start 2024-08-17T02:26:13.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.264+0000 7f63dd200640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 0x7f63b8067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f63d80ac640 tx=0x7f63c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.265+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e14e4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.265+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e152d9e0 0x55c2e14e5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.265+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e150bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.265+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e14a1380 con 0x55c2e14e7230 2024-08-17T02:26:13.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.265+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e144a9e0 con 0x55c2e14e49f0 2024-08-17T02:26:13.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.265+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2e1448170 con 0x55c2e152d9e0 2024-08-17T02:26:13.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.265+0000 7f63de600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e150bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.266+0000 7f63de600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e150bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41170/0 (socket says 172.21.15.45:41170) 2024-08-17T02:26:13.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.266+0000 7f63de600640 1 -- 172.21.15.45:0/832914623 learned_addr learned my addr 172.21.15.45:0/832914623 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:13.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.266+0000 7f63de600640 1 -- 172.21.15.45:0/832914623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e152d9e0 msgr2=0x55c2e14e5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.266+0000 7f63de600640 1 --2- 172.21.15.45:0/832914623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e152d9e0 0x55c2e14e5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.266+0000 7f63de600640 1 -- 172.21.15.45:0/832914623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 msgr2=0x55c2e14e4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.266+0000 7f63de600640 1 --2- 172.21.15.45:0/832914623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e14e4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.266+0000 7f63de600640 1 -- 172.21.15.45:0/832914623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2e13f7820 con 0x55c2e14e7230 2024-08-17T02:26:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.266+0000 7f63de600640 1 --2- 172.21.15.45:0/832914623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e150bcf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f63d0011500 tx=0x7f63d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c903ca940bc5a976 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.266+0000 7f63c9600640 1 -- 172.21.15.45:0/832914623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000e040 con 0x55c2e14e7230 2024-08-17T02:26:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.266+0000 7f63c9600640 1 -- 172.21.15.45:0/832914623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d000f040 con 0x55c2e14e7230 2024-08-17T02:26:13.269 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.266+0000 7f63c9600640 1 -- 172.21.15.45:0/832914623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d0015850 con 0x55c2e14e7230 2024-08-17T02:26:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.267+0000 7f63e2b7f740 1 -- 172.21.15.45:0/832914623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 msgr2=0x55c2e150bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.267+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/832914623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e150bcf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f63d0011500 tx=0x7f63d000b040 comp rx=0 tx=0).stop 2024-08-17T02:26:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.267+0000 7f63e2b7f740 1 -- 172.21.15.45:0/832914623 shutdown_connections 2024-08-17T02:26:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.267+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/832914623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e150bcf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.267+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/832914623 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e152d9e0 0x55c2e14e5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.267+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/832914623 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e14e4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.267+0000 7f63e2b7f740 1 -- 172.21.15.45:0/832914623 >> 172.21.15.45:0/832914623 conn(0x55c2e147f030 msgr2=0x55c2e152de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.267+0000 7f63e2b7f740 1 -- 172.21.15.45:0/832914623 shutdown_connections 2024-08-17T02:26:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.267+0000 7f63e2b7f740 1 -- 172.21.15.45:0/832914623 wait complete. 2024-08-17T02:26:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.268+0000 7f63e2b7f740 1 -- start start 2024-08-17T02:26:13.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.268+0000 7f63e2b7f740 1 Processor -- start 2024-08-17T02:26:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e15086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e15127f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e152d9e0 0x55c2e150d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e1443f60 con 0x55c2e14e7230 2024-08-17T02:26:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e13ec690 con 0x55c2e14e49f0 2024-08-17T02:26:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2e13ec330 con 0x55c2e152d9e0 2024-08-17T02:26:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63e2b7f740 10 client.0 _ll_register_callbacks cb 0x55c2e13e62b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63dd200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e15127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63ddc00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e15086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63dd200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e15127f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41172/0 (socket says 172.21.15.45:41172) 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63dd200640 1 -- 172.21.15.45:0/2828803576 learned_addr learned my addr 172.21.15.45:0/2828803576 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.269+0000 7f63de600640 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e152d9e0 0x55c2e150d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.270+0000 7f63dd200640 1 -- 172.21.15.45:0/2828803576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e152d9e0 msgr2=0x55c2e150d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.270+0000 7f63dd200640 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e152d9e0 0x55c2e150d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.270+0000 7f63dd200640 1 -- 172.21.15.45:0/2828803576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 msgr2=0x55c2e15086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.270+0000 7f63dd200640 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e15086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.270+0000 7f63dd200640 1 -- 172.21.15.45:0/2828803576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d0011230 con 0x55c2e14e7230 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.270+0000 7f63dd200640 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e15127f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f63c4016b00 tx=0x7f63c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7ab5c7847f5cc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.270+0000 7f63be000640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63be000640 1 -- 172.21.15.45:0/2828803576 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4014bc0 con 0x55c2e14e7230 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2828803576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c2e1477d20 con 0x55c2e14e7230 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63be000640 1 -- 172.21.15.45:0/2828803576 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63c4014d20 con 0x55c2e14e7230 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63be000640 1 -- 172.21.15.45:0/2828803576 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63c4021650 con 0x55c2e14e7230 2024-08-17T02:26:13.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63e2b7f740 10 client.5106 fetch_fsmap learned FSMap version 17 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2828803576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c2e140dab0 con 0x55c2e14e7230 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63be000640 1 -- 172.21.15.45:0/2828803576 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c2e1477d20 con 0x55c2e14e7230 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63be000640 1 -- 172.21.15.45:0/2828803576 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f63c40217b0 con 0x55c2e14e7230 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63e2b7f740 10 client.5106 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63e2b7f740 10 client.5106 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63e2b7f740 20 client.5106 populate_metadata read hostname 'smithi045' 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.45:6834/618002034,v1:172.21.15.45:6836/618002034] conn(0x55c2e150f5c0 0x55c2e14df160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63e2b7f740 4 client.5106 mds_command: new command op to 4926 tid=0[{"prefix": "get_command_descriptions"}] 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.271+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2828803576 --> [v2:172.21.15.45:6834/618002034,v1:172.21.15.45:6836/618002034] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c2e114b3c0 con 0x55c2e150f5c0 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.272+0000 7f63ddc00640 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.45:6834/618002034,v1:172.21.15.45:6836/618002034] conn(0x55c2e150f5c0 0x55c2e14df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.272+0000 7f63be000640 10 client.5106 ms_handle_connect on v2:172.21.15.45:6834/618002034 2024-08-17T02:26:13.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.272+0000 7f63ddc00640 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.45:6834/618002034,v1:172.21.15.45:6836/618002034] conn(0x55c2e150f5c0 0x55c2e14df160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eb5511928ebec36 server_cookie=ed76ee2e80466aa8 in_seq=0 out_seq=0 2024-08-17T02:26:13.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63be000640 1 -- 172.21.15.45:0/2828803576 <== mds.0 v2:172.21.15.45:6834/618002034 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (crc 0 0 0) 0x55c2e114b3c0 con 0x55c2e150f5c0 2024-08-17T02:26:13.277 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63be000640 10 client.5106 handle_command_reply: tid=0 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63e2b7f740 1 client.5106 shutdown 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2828803576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 msgr2=0x55c2e15127f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e15127f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f63c4016b00 tx=0x7f63c4017000 comp rx=0 tx=0).stop 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2828803576 shutdown_connections 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.45:6834/618002034,v1:172.21.15.45:6836/618002034] conn(0x55c2e150f5c0 0x55c2e14df160 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e152d9e0 0x55c2e150d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e7230 0x55c2e15127f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/2828803576 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e15086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63be000640 0 client.5106 ms_handle_reset on v2:172.21.15.45:6834/618002034 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2828803576 >> 172.21.15.45:0/2828803576 conn(0x55c2e147f030 msgr2=0x55c2e150b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2828803576 shutdown_connections 2024-08-17T02:26:13.278 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.273+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2828803576 wait complete. 2024-08-17T02:26:13.279 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.274+0000 7f63e2b7f740 20 client.5106 trim_cache size 0 max 16384 2024-08-17T02:26:13.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.289+0000 7f63e2b7f740 1 Processor -- start 2024-08-17T02:26:13.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.289+0000 7f63e2b7f740 1 -- start start 2024-08-17T02:26:13.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.290+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e49f0 0x55c2e150d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.290+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 0x55c2e15086b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.290+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e152d9e0 0x55c2e15127d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.290+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e11bef20 con 0x55c2e14e49f0 2024-08-17T02:26:13.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.290+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e14e1f30 con 0x55c2e152d9e0 2024-08-17T02:26:13.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.290+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2e14e5000 con 0x55c2e14e7230 2024-08-17T02:26:13.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.290+0000 7f63ddc00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e49f0 0x55c2e150d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.290+0000 7f63ddc00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e49f0 0x55c2e150d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41180/0 (socket says 172.21.15.45:41180) 2024-08-17T02:26:13.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.290+0000 7f63ddc00640 1 -- 172.21.15.45:0/2232336971 learned_addr learned my addr 172.21.15.45:0/2232336971 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:13.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63dd200640 1 --2- 172.21.15.45:0/2232336971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 0x55c2e15086b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63de600640 1 --2- 172.21.15.45:0/2232336971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e152d9e0 0x55c2e15127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63ddc00640 1 -- 172.21.15.45:0/2232336971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 msgr2=0x55c2e15086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63ddc00640 1 --2- 172.21.15.45:0/2232336971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 0x55c2e15086b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63ddc00640 1 -- 172.21.15.45:0/2232336971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e152d9e0 msgr2=0x55c2e15127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63ddc00640 1 --2- 172.21.15.45:0/2232336971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e152d9e0 0x55c2e15127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63ddc00640 1 -- 172.21.15.45:0/2232336971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2e1411490 con 0x55c2e14e49f0 2024-08-17T02:26:13.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63dd200640 1 --2- 172.21.15.45:0/2232336971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 0x55c2e15086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:13.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63de600640 1 --2- 172.21.15.45:0/2232336971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e152d9e0 0x55c2e15127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:13.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63ddc00640 1 --2- 172.21.15.45:0/2232336971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e49f0 0x55c2e150d690 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f63cc074010 tx=0x7f63cc076040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a283a2a2564ec45 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63ca000640 1 -- 172.21.15.45:0/2232336971 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc074080 con 0x55c2e14e49f0 2024-08-17T02:26:13.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63ca000640 1 -- 172.21.15.45:0/2232336971 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc0a20b0 con 0x55c2e14e49f0 2024-08-17T02:26:13.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.291+0000 7f63ca000640 1 -- 172.21.15.45:0/2232336971 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0a0880 con 0x55c2e14e49f0 2024-08-17T02:26:13.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.292+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2232336971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e49f0 msgr2=0x55c2e150d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.292+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/2232336971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e49f0 0x55c2e150d690 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f63cc074010 tx=0x7f63cc076040 comp rx=0 tx=0).stop 2024-08-17T02:26:13.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.292+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2232336971 shutdown_connections 2024-08-17T02:26:13.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.292+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/2232336971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e152d9e0 0x55c2e15127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.292+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/2232336971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 0x55c2e15086b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.292+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/2232336971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e14e49f0 0x55c2e150d690 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.292+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2232336971 >> 172.21.15.45:0/2232336971 conn(0x55c2e147f030 msgr2=0x55c2e14e1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.292+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2232336971 shutdown_connections 2024-08-17T02:26:13.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.292+0000 7f63e2b7f740 1 -- 172.21.15.45:0/2232336971 wait complete. 2024-08-17T02:26:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.292+0000 7f63e2b7f740 1 -- start start 2024-08-17T02:26:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.293+0000 7f63e2b7f740 1 Processor -- start 2024-08-17T02:26:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.293+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e1548560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.293+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 0x55c2e14e51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63e2b7f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e152d9e0 0x55c2e14e5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e1597050 con 0x55c2e152d9e0 2024-08-17T02:26:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2e14dfc40 con 0x55c2e14e49f0 2024-08-17T02:26:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63e2b7f740 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2e1529260 con 0x55c2e14e7230 2024-08-17T02:26:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63e2b7f740 10 client.0 _ll_register_callbacks cb 0x7f63c40166b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-17T02:26:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63de600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e152d9e0 0x55c2e14e5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63de600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e152d9e0 0x55c2e14e5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41182/0 (socket says 172.21.15.45:41182) 2024-08-17T02:26:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63de600640 1 -- 172.21.15.45:0/4098861246 learned_addr learned my addr 172.21.15.45:0/4098861246 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63ddc00640 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e1548560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63dd200640 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 0x55c2e14e51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63de600640 1 -- 172.21.15.45:0/4098861246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 msgr2=0x55c2e14e51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63de600640 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 0x55c2e14e51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63de600640 1 -- 172.21.15.45:0/4098861246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 msgr2=0x55c2e1548560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63de600640 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e1548560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63de600640 1 -- 172.21.15.45:0/4098861246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d80abb80 con 0x55c2e152d9e0 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63ddc00640 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e1548560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.294+0000 7f63dd200640 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 0x55c2e14e51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63de600640 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e152d9e0 0x55c2e14e5720 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55c2e14e4280 tx=0x7f63d001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c812aa556614aa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63be000640 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63be000640 1 -- 172.21.15.45:0/4098861246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000e040 con 0x55c2e152d9e0 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63be000640 1 -- 172.21.15.45:0/4098861246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63d001d6e0 con 0x55c2e152d9e0 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63e2b7f740 1 -- 172.21.15.45:0/4098861246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f63d000f040 con 0x55c2e152d9e0 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63be000640 1 -- 172.21.15.45:0/4098861246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63d001dab0 con 0x55c2e152d9e0 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63e2b7f740 10 client.5112 fetch_fsmap learned FSMap version 17 2024-08-17T02:26:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63e2b7f740 1 -- 172.21.15.45:0/4098861246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55c2e14111e0 con 0x55c2e152d9e0 2024-08-17T02:26:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63be000640 1 -- 172.21.15.45:0/4098861246 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d000f040 con 0x55c2e152d9e0 2024-08-17T02:26:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63be000640 1 -- 172.21.15.45:0/4098861246 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f63d001b020 con 0x55c2e152d9e0 2024-08-17T02:26:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63e2b7f740 10 client.5112 fetch_fsmap finished waiting for FSMap version 17 2024-08-17T02:26:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63e2b7f740 10 client.5112 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-17T02:26:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63e2b7f740 20 client.5112 populate_metadata read hostname 'smithi045' 2024-08-17T02:26:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.45:6834/618002034,v1:172.21.15.45:6836/618002034] conn(0x55c2e150b380 0x55c2e150b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63e2b7f740 4 client.5112 mds_command: new command op to 4926 tid=0[{"prefix": "status"}] 2024-08-17T02:26:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.295+0000 7f63e2b7f740 1 -- 172.21.15.45:0/4098861246 --> [v2:172.21.15.45:6834/618002034,v1:172.21.15.45:6836/618002034] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c2e115c6c0 con 0x55c2e150b380 2024-08-17T02:26:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.296+0000 7f63ddc00640 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.45:6834/618002034,v1:172.21.15.45:6836/618002034] conn(0x55c2e150b380 0x55c2e150b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.296+0000 7f63ddc00640 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.45:6834/618002034,v1:172.21.15.45:6836/618002034] conn(0x55c2e150b380 0x55c2e150b750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7baee6e540b7f5f4 server_cookie=c1238ce6856404bb in_seq=0 out_seq=0 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.296+0000 7f63be000640 10 client.5112 ms_handle_connect on v2:172.21.15.45:6834/618002034 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.296+0000 7f63be000640 1 -- 172.21.15.45:0/4098861246 <== mds.0 v2:172.21.15.45:6834/618002034 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55c2e115c6c0 con 0x55c2e150b380 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.296+0000 7f63be000640 10 client.5112 handle_command_reply: tid=0 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.296+0000 7f63e2b7f740 1 client.5112 shutdown 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63e2b7f740 1 -- 172.21.15.45:0/4098861246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e152d9e0 msgr2=0x55c2e14e5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e152d9e0 0x55c2e14e5720 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x55c2e14e4280 tx=0x7f63d001d000 comp rx=0 tx=0).stop 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63e2b7f740 1 -- 172.21.15.45:0/4098861246 shutdown_connections 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.45:6834/618002034,v1:172.21.15.45:6836/618002034] conn(0x55c2e150b380 0x55c2e150b750 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2e152d9e0 0x55c2e14e5720 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x55c2e14e7230 0x55c2e14e51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63e2b7f740 1 --2- 172.21.15.45:0/4098861246 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x55c2e14e49f0 0x55c2e1548560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63be000640 0 client.5112 ms_handle_reset on v2:172.21.15.45:6834/618002034 2024-08-17T02:26:13.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63e2b7f740 1 -- 172.21.15.45:0/4098861246 >> 172.21.15.45:0/4098861246 conn(0x55c2e147f030 msgr2=0x55c2e152c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63e2b7f740 1 -- 172.21.15.45:0/4098861246 shutdown_connections 2024-08-17T02:26:13.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63e2b7f740 1 -- 172.21.15.45:0/4098861246 wait complete. 2024-08-17T02:26:13.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.297+0000 7f63e2b7f740 20 client.5112 trim_cache size 0 max 16384 2024-08-17T02:26:13.306 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-08-17T02:26:13.306 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "2ec357bb-2069-43d1-ab40-d29098820580", 2024-08-17T02:26:13.306 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2024-08-17T02:26:13.306 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4926, 2024-08-17T02:26:13.306 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2024-08-17T02:26:13.307 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2024-08-17T02:26:13.307 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2024-08-17T02:26:13.307 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 6.1071609579999997, 2024-08-17T02:26:13.307 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 17, 2024-08-17T02:26:13.307 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 32, 2024-08-17T02:26:13.307 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 32, 2024-08-17T02:26:13.308 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 14.008597737000001 2024-08-17T02:26:13.308 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-08-17T02:26:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 -- 172.21.15.45:0/2974373014 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 msgr2=0x7f63b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 0x7f63b8067600 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f63d80ac640 tx=0x7f63c4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 -- 172.21.15.45:0/2974373014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d80b0270 msgr2=0x7f63d81678a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d80b0270 0x7f63d81678a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f63cc009210 tx=0x7f63cc032000 comp rx=0 tx=0).stop 2024-08-17T02:26:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 -- 172.21.15.45:0/2974373014 shutdown_connections 2024-08-17T02:26:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63d8157b20 0x7f63d80cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 0x7f63b8067600 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d8155900 0x7f63d80aab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 --2- 172.21.15.45:0/2974373014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d80b0270 0x7f63d81678a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 -- 172.21.15.45:0/2974373014 >> 172.21.15.45:0/2974373014 conn(0x7f63d8067750 msgr2=0x7f63d80ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 -- 172.21.15.45:0/2974373014 shutdown_connections 2024-08-17T02:26:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.298+0000 7f63df000640 1 -- 172.21.15.45:0/2974373014 wait complete. 2024-08-17T02:26:13.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:13.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.465+0000 7fb85b200640 1 Processor -- start 2024-08-17T02:26:13.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.465+0000 7fb85b200640 1 -- start start 2024-08-17T02:26:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.466+0000 7fb85b200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb85406df00 0x7fb8540adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.466+0000 7fb85b200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb854156670 con 0x7fb854155a20 2024-08-17T02:26:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.466+0000 7fb85b200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85406e5e0 con 0x7fb854155df0 2024-08-17T02:26:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.466+0000 7fb85b200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8540b0350 con 0x7fb85406df00 2024-08-17T02:26:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.466+0000 7fb84be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb85406df00 0x7fb8540adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.466+0000 7fb84be00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb85406df00 0x7fb8540adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41196/0 (socket says 172.21.15.45:41196) 2024-08-17T02:26:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.466+0000 7fb84be00640 1 -- 172.21.15.45:0/2019511697 learned_addr learned my addr 172.21.15.45:0/2019511697 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.466+0000 7fb853e00640 1 --1- 172.21.15.45:0/2019511697 >> v1:172.21.15.45:6789/0 conn(0x7fb854155a20 0x7fb85406d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43864/0 (socket says 172.21.15.45:43864) 2024-08-17T02:26:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.467+0000 7fb84be00640 1 -- 172.21.15.45:0/2019511697 >> v1:172.21.15.169:6789/0 conn(0x7fb854155df0 legacy=0x7fb854156b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.467+0000 7fb84be00640 1 -- 172.21.15.45:0/2019511697 >> v1:172.21.15.45:6789/0 conn(0x7fb854155a20 legacy=0x7fb85406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.467+0000 7fb84be00640 1 -- 172.21.15.45:0/2019511697 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85406e8c0 con 0x7fb85406df00 2024-08-17T02:26:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.468+0000 7fb84be00640 1 --2- 172.21.15.45:0/2019511697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85406df00 0x7fb8540adf10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009910 tx=0x7fb83c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d54a1da2973731 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.468+0000 7fb853400640 1 -- 172.21.15.45:0/2019511697 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c02ae60 con 0x7fb85406df00 2024-08-17T02:26:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.468+0000 7fb853400640 1 -- 172.21.15.45:0/2019511697 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c032440 con 0x7fb85406df00 2024-08-17T02:26:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.468+0000 7fb853400640 1 -- 172.21.15.45:0/2019511697 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c0327e0 con 0x7fb85406df00 2024-08-17T02:26:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.468+0000 7fb85b200640 1 -- 172.21.15.45:0/2019511697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85406df00 msgr2=0x7fb8540adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.469+0000 7fb85b200640 1 --2- 172.21.15.45:0/2019511697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85406df00 0x7fb8540adf10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb83c009910 tx=0x7fb83c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.469+0000 7fb85b200640 1 -- 172.21.15.45:0/2019511697 shutdown_connections 2024-08-17T02:26:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.469+0000 7fb85b200640 1 --2- 172.21.15.45:0/2019511697 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85406df00 0x7fb8540adf10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.469+0000 7fb85b200640 1 -- 172.21.15.45:0/2019511697 >> 172.21.15.45:0/2019511697 conn(0x7fb8540cb9b0 msgr2=0x7fb8540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.469+0000 7fb85b200640 1 -- 172.21.15.45:0/2019511697 shutdown_connections 2024-08-17T02:26:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.469+0000 7fb85b200640 1 -- 172.21.15.45:0/2019511697 wait complete. 2024-08-17T02:26:13.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.470+0000 7fb85b200640 1 Processor -- start 2024-08-17T02:26:13.471 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.470+0000 7fb85b200640 1 -- start start 2024-08-17T02:26:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.471+0000 7fb85b200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb85406df00 0x7fb8541414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.471+0000 7fb85b200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb854155a20 0x7fb854143840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.471+0000 7fb85b200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb854155df0 0x7fb854143d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.471+0000 7fb85b200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85413e5e0 con 0x7fb854155a20 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.471+0000 7fb85b200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb854141030 con 0x7fb854155df0 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.471+0000 7fb85b200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8541442c0 con 0x7fb85406df00 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.471+0000 7fb84be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb854155a20 0x7fb854143840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.471+0000 7fb84be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb854155a20 0x7fb854143840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41208/0 (socket says 172.21.15.45:41208) 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.471+0000 7fb84be00640 1 -- 172.21.15.45:0/2098333502 learned_addr learned my addr 172.21.15.45:0/2098333502 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb859200640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb854155df0 0x7fb854143d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb853e00640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb85406df00 0x7fb8541414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb84be00640 1 -- 172.21.15.45:0/2098333502 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb85406df00 msgr2=0x7fb8541414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb84be00640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb85406df00 0x7fb8541414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb84be00640 1 -- 172.21.15.45:0/2098333502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb854155df0 msgr2=0x7fb854143d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb84be00640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb854155df0 0x7fb854143d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb84be00640 1 -- 172.21.15.45:0/2098333502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb83c009450 con 0x7fb854155a20 2024-08-17T02:26:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb859200640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb854155df0 0x7fb854143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb84be00640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb854155a20 0x7fb854143840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb83c035040 tx=0x7fb83c032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb84b400640 1 -- 172.21.15.45:0/2098333502 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c031de0 con 0x7fb854155a20 2024-08-17T02:26:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb84b400640 1 -- 172.21.15.45:0/2098333502 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83c03d420 con 0x7fb854155a20 2024-08-17T02:26:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb84b400640 1 -- 172.21.15.45:0/2098333502 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83c03d7e0 con 0x7fb854155a20 2024-08-17T02:26:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.472+0000 7fb85b200640 1 -- 172.21.15.45:0/2098333502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb854144520 con 0x7fb854155a20 2024-08-17T02:26:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.473+0000 7fb85b200640 1 -- 172.21.15.45:0/2098333502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb854140cc0 con 0x7fb854155a20 2024-08-17T02:26:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.473+0000 7fb85b200640 1 -- 172.21.15.45:0/2098333502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb854064db0 con 0x7fb854155a20 2024-08-17T02:26:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.474+0000 7fb84b400640 1 -- 172.21.15.45:0/2098333502 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb83c039040 con 0x7fb854155a20 2024-08-17T02:26:13.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.475+0000 7fb84b400640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb830065150 0x7fb830067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:13.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.475+0000 7fb84b400640 1 -- 172.21.15.45:0/2098333502 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb83c0a23a0 con 0x7fb854155a20 2024-08-17T02:26:13.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.475+0000 7fb853e00640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb830065150 0x7fb830067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:13.476 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.476+0000 7fb853e00640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb830065150 0x7fb830067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb85413bf00 tx=0x7fb844007ce0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.479+0000 7fb84b400640 1 -- 172.21.15.45:0/2098333502 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb83c0703c0 con 0x7fb854155a20 2024-08-17T02:26:13.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.705+0000 7fb85b200640 1 -- 172.21.15.45:0/2098333502 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb854141170 con 0x7fb854155a20 2024-08-17T02:26:13.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.706+0000 7fb84b400640 1 -- 172.21.15.45:0/2098333502 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb83c037060 con 0x7fb854155a20 2024-08-17T02:26:13.707 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 -- 172.21.15.45:0/2098333502 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb830065150 msgr2=0x7fb830067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb830065150 0x7fb830067600 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb85413bf00 tx=0x7fb844007ce0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 -- 172.21.15.45:0/2098333502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb854155a20 msgr2=0x7fb854143840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb854155a20 0x7fb854143840 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb83c035040 tx=0x7fb83c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 -- 172.21.15.45:0/2098333502 shutdown_connections 2024-08-17T02:26:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb854155df0 0x7fb854143d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb854155a20 0x7fb854143840 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb830065150 0x7fb830067600 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 --2- 172.21.15.45:0/2098333502 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb85406df00 0x7fb8541414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 -- 172.21.15.45:0/2098333502 >> 172.21.15.45:0/2098333502 conn(0x7fb8540cb9b0 msgr2=0x7fb85406d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 -- 172.21.15.45:0/2098333502 shutdown_connections 2024-08-17T02:26:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:13.708+0000 7fb85b200640 1 -- 172.21.15.45:0/2098333502 wait complete. 2024-08-17T02:26:13.724 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:26:13.724 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:13.724 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2024-08-17T02:26:13.725 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-17T02:26:13.725 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:13.725 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:26:13.725 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:26:13.725 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:13.725 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:13.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.725 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2024-08-17T02:26:13.761 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:13.761 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:13.762 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:13.762 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.762 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:13.762 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.762 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:13.762 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:13.762 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2024-08-17T02:26:13.762 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:13.762 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:13.762 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2024-08-17T02:26:13.762 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42616sec preferred_lft 42616sec 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link noprefixroute 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 6e:87:19:ad:a0:0c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.763 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::581f:69ff:fec3:c521/64 scope link 2024-08-17T02:26:13.764 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.764 INFO:teuthology.orchestra.run.smithi045.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:13.764 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 86:ab:1b:d3:74:94 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:26:13.764 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::84ab:1bff:fed3:7494/64 scope link 2024-08-17T02:26:13.764 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.764 INFO:teuthology.orchestra.run.smithi045.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:13.764 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 6e:87:19:ad:a0:0c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:26:13.764 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::6c87:19ff:fead:a00c/64 scope link 2024-08-17T02:26:13.764 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:13.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.764 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:13.855 INFO:teuthology.orchestra.run.smithi045.stdout:1 2024-08-17T02:26:13.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.858 DEBUG:teuthology.orchestra.run.smithi045:> route 2024-08-17T02:26:13.895 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2024-08-17T02:26:13.895 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:13.895 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-08-17T02:26:13.895 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-08-17T02:26:13.895 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:13.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:13.895 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2024-08-17T02:26:13.895 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2024-08-17T02:26:13.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-08-17T02:26:13.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-08-17T02:26:13.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-08-17T02:26:13.896 DEBUG:teuthology.orchestra.run.smithi045:> ') 2024-08-17T02:26:14.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:14.041 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-08-17T02:26:14.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:14.076 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:26:14.077 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:26:14.077 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:14.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:14.077 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2024-08-17T02:26:14.079 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:14.136 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:14.136 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:14.237 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-17T02:26:14.237 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:14.237 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:14.312 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-08-17T02:26:14.312 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:14.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:14.436 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:14.436 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:14.462 INFO:teuthology.orchestra.run.smithi045.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:14.462 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:14.462 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.169:3300,172.21.15.169:3301" 2024-08-17T02:26:14.462 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: trying mount with new device syntax: 0@2ec357bb-2069-43d1-ab40-d29098820580.cephfs=/ 2024-08-17T02:26:14.462 INFO:teuthology.orchestra.run.smithi045.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.45:3300/172.21.15.169:3300/172.21.15.169:3301" will pass to kernel 2024-08-17T02:26:14.463 INFO:teuthology.orchestra.run.smithi045.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-17T02:26:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:26:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:26:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:26:14.463 INFO:teuthology.orchestra.run.smithi045.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:26:14.467 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:26:14.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:14.467 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-17T02:26:14.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-08-17T02:26:14.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.675+0000 7efc63c00640 1 Processor -- start 2024-08-17T02:26:14.676 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.675+0000 7efc63c00640 1 -- start start 2024-08-17T02:26:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.676+0000 7efc63c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc5c155180 0x7efc5c0aea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.676+0000 7efc63c00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efc5c155550 0x7efc5c0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.676+0000 7efc63c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5c0afc10 con 0x7efc5c06e080 2024-08-17T02:26:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.676+0000 7efc63c00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc5c0ae5b0 con 0x7efc5c155550 2024-08-17T02:26:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.676+0000 7efc63c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c0af000 con 0x7efc5c155180 2024-08-17T02:26:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.677+0000 7efc5be00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efc5c155550 0x7efc5c0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.677+0000 7efc61200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc5c155180 0x7efc5c0aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.677+0000 7efc5be00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7efc5c155550 0x7efc5c0ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:54146/0 (socket says 172.21.15.45:54146) 2024-08-17T02:26:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.677+0000 7efc5be00640 1 -- 172.21.15.45:0/2395965239 learned_addr learned my addr 172.21.15.45:0/2395965239 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.677+0000 7efc5be00640 1 -- 172.21.15.45:0/2395965239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc5c155180 msgr2=0x7efc5c0aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.677+0000 7efc5be00640 1 --2- 172.21.15.45:0/2395965239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc5c155180 0x7efc5c0aea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.677+0000 7efc5be00640 1 -- 172.21.15.45:0/2395965239 >> v1:172.21.15.169:6789/0 conn(0x7efc5c06e080 legacy=0x7efc5c06e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.677+0000 7efc5be00640 1 -- 172.21.15.45:0/2395965239 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc5c0af2e0 con 0x7efc5c155550 2024-08-17T02:26:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.677+0000 7efc61200640 1 --2- 172.21.15.45:0/2395965239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc5c155180 0x7efc5c0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.678+0000 7efc5be00640 1 --2- 172.21.15.45:0/2395965239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc5c155550 0x7efc5c0ae070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efc48009910 tx=0x7efc480091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e17217428ceba1b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.679+0000 7efc5b400640 1 -- 172.21.15.45:0/2395965239 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4802ae40 con 0x7efc5c155550 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.679+0000 7efc5b400640 1 -- 172.21.15.45:0/2395965239 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc48032440 con 0x7efc5c155550 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.679+0000 7efc5b400640 1 -- 172.21.15.45:0/2395965239 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48032820 con 0x7efc5c155550 2024-08-17T02:26:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.679+0000 7efc63c00640 1 -- 172.21.15.45:0/2395965239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc5c155550 msgr2=0x7efc5c0ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.679+0000 7efc63c00640 1 --2- 172.21.15.45:0/2395965239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc5c155550 0x7efc5c0ae070 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efc48009910 tx=0x7efc480091d0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.680+0000 7efc63c00640 1 -- 172.21.15.45:0/2395965239 shutdown_connections 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.680+0000 7efc63c00640 1 --2- 172.21.15.45:0/2395965239 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc5c155550 0x7efc5c0ae070 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.680+0000 7efc63c00640 1 --2- 172.21.15.45:0/2395965239 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc5c155180 0x7efc5c0aea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.680+0000 7efc63c00640 1 -- 172.21.15.45:0/2395965239 >> 172.21.15.45:0/2395965239 conn(0x7efc5c0cb9b0 msgr2=0x7efc5c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.680+0000 7efc63c00640 1 -- 172.21.15.45:0/2395965239 shutdown_connections 2024-08-17T02:26:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.680+0000 7efc63c00640 1 -- 172.21.15.45:0/2395965239 wait complete. 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.681+0000 7efc63c00640 1 Processor -- start 2024-08-17T02:26:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.681+0000 7efc63c00640 1 -- start start 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.682+0000 7efc63c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c06e080 0x7efc5c169d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.682+0000 7efc63c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc5c155180 0x7efc5c150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.682+0000 7efc63c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc5c155550 0x7efc5c162f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.682+0000 7efc63c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c16a2a0 con 0x7efc5c06e080 2024-08-17T02:26:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.682+0000 7efc63c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c150e50 con 0x7efc5c155550 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.682+0000 7efc63c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5c14f870 con 0x7efc5c155180 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.682+0000 7efc61200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c06e080 0x7efc5c169d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.682+0000 7efc61200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c06e080 0x7efc5c169d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41218/0 (socket says 172.21.15.45:41218) 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.682+0000 7efc61200640 1 -- 172.21.15.45:0/1823348607 learned_addr learned my addr 172.21.15.45:0/1823348607 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc5be00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc5c155180 0x7efc5c150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc61c00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc5c155550 0x7efc5c162f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc61200640 1 -- 172.21.15.45:0/1823348607 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc5c155180 msgr2=0x7efc5c150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc61200640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc5c155180 0x7efc5c150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc61200640 1 -- 172.21.15.45:0/1823348607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc5c155550 msgr2=0x7efc5c162f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc61200640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc5c155550 0x7efc5c162f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc61200640 1 -- 172.21.15.45:0/1823348607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc50009390 con 0x7efc5c06e080 2024-08-17T02:26:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc61c00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc5c155550 0x7efc5c162f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc61200640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c06e080 0x7efc5c169d60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efc5000ec80 tx=0x7efc500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc4fe00640 1 -- 172.21.15.45:0/1823348607 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5000eec0 con 0x7efc5c06e080 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc4fe00640 1 -- 172.21.15.45:0/1823348607 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5000cbc0 con 0x7efc5c06e080 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.683+0000 7efc4fe00640 1 -- 172.21.15.45:0/1823348607 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc50013470 con 0x7efc5c06e080 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.684+0000 7efc63c00640 1 -- 172.21.15.45:0/1823348607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc48009450 con 0x7efc5c06e080 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.684+0000 7efc63c00640 1 -- 172.21.15.45:0/1823348607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5c14feb0 con 0x7efc5c06e080 2024-08-17T02:26:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.685+0000 7efc63c00640 1 -- 172.21.15.45:0/1823348607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5c064db0 con 0x7efc5c06e080 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.686+0000 7efc4fe00640 1 -- 172.21.15.45:0/1823348607 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efc500137e0 con 0x7efc5c06e080 2024-08-17T02:26:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.687+0000 7efc4fe00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efc3c065150 0x7efc3c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.687+0000 7efc4fe00640 1 -- 172.21.15.45:0/1823348607 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efc500828f0 con 0x7efc5c06e080 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.687+0000 7efc5be00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efc3c065150 0x7efc3c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:14.688 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.688+0000 7efc5be00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efc3c065150 0x7efc3c067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc48034000 tx=0x7efc48032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:14.691 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.691+0000 7efc4fe00640 1 -- 172.21.15.45:0/1823348607 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efc50050910 con 0x7efc5c06e080 2024-08-17T02:26:14.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.913+0000 7efc63c00640 1 -- 172.21.15.45:0/1823348607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7efc5c0caf40 con 0x7efc5c06e080 2024-08-17T02:26:14.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.914+0000 7efc4fe00640 1 -- 172.21.15.45:0/1823348607 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7efc50017070 con 0x7efc5c06e080 2024-08-17T02:26:14.915 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-08-17T02:26:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 -- 172.21.15.45:0/1823348607 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efc3c065150 msgr2=0x7efc3c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efc3c065150 0x7efc3c067600 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7efc48034000 tx=0x7efc48032000 comp rx=0 tx=0).stop 2024-08-17T02:26:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 -- 172.21.15.45:0/1823348607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c06e080 msgr2=0x7efc5c169d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c06e080 0x7efc5c169d60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efc5000ec80 tx=0x7efc500090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 -- 172.21.15.45:0/1823348607 shutdown_connections 2024-08-17T02:26:14.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc5c155550 0x7efc5c162f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efc3c065150 0x7efc3c067600 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc5c155180 0x7efc5c150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 --2- 172.21.15.45:0/1823348607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc5c06e080 0x7efc5c169d60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:14.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 -- 172.21.15.45:0/1823348607 >> 172.21.15.45:0/1823348607 conn(0x7efc5c0cb9b0 msgr2=0x7efc5c0b10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:14.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 -- 172.21.15.45:0/1823348607 shutdown_connections 2024-08-17T02:26:14.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:14.916+0000 7efc63c00640 1 -- 172.21.15.45:0/1823348607 wait complete. 2024-08-17T02:26:14.932 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-17T02:26:14.932 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-17T02:26:14.932 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi169.front.sepia.ceph.com 2024-08-17T02:26:14.932 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-08-17T02:26:14.932 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:14.932 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-17T02:26:14.932 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-08-17T02:26:14.932 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-17T02:26:14.932 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:14.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:14.933 DEBUG:teuthology.orchestra.run.smithi169:> ip addr 2024-08-17T02:26:14.973 INFO:teuthology.orchestra.run.smithi169.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-17T02:26:14.973 INFO:teuthology.orchestra.run.smithi169.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-17T02:26:14.973 INFO:teuthology.orchestra.run.smithi169.stdout: inet 127.0.0.1/8 scope host lo 2024-08-17T02:26:14.974 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:14.974 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 ::1/128 scope host 2024-08-17T02:26:14.974 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:14.974 INFO:teuthology.orchestra.run.smithi169.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:14.974 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b4 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:14.974 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f0 2024-08-17T02:26:14.974 INFO:teuthology.orchestra.run.smithi169.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:14.974 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:d9:3b:b5 brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:14.974 INFO:teuthology.orchestra.run.smithi169.stdout: altname enp7s0f1 2024-08-17T02:26:14.974 INFO:teuthology.orchestra.run.smithi169.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-17T02:26:14.974 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4c brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 0c:c4:7a:88:7f:4d brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout: inet 172.21.15.169/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft 42605sec preferred_lft 42605sec 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::ec4:7aff:fe88:7f4d/64 scope link 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 5e:81:a3:d7:90:2f brd ff:ff:ff:ff:ff:ff 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::ec33:acff:fed8:71f9/64 scope link 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:14.975 INFO:teuthology.orchestra.run.smithi169.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:14.976 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 5e:81:a3:d7:90:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:26:14.976 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::5c81:a3ff:fed7:902f/64 scope link 2024-08-17T02:26:14.976 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:14.976 INFO:teuthology.orchestra.run.smithi169.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-08-17T02:26:14.976 INFO:teuthology.orchestra.run.smithi169.stdout: link/ether 86:11:27:1f:0c:2e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:26:14.976 INFO:teuthology.orchestra.run.smithi169.stdout: inet6 fe80::8411:27ff:fe1f:c2e/64 scope link 2024-08-17T02:26:14.976 INFO:teuthology.orchestra.run.smithi169.stdout: valid_lft forever preferred_lft forever 2024-08-17T02:26:14.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:14.976 DEBUG:teuthology.orchestra.run.smithi169:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-17T02:26:15.071 INFO:teuthology.orchestra.run.smithi169.stdout:1 2024-08-17T02:26:15.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:15.075 DEBUG:teuthology.orchestra.run.smithi169:> route 2024-08-17T02:26:15.111 INFO:teuthology.orchestra.run.smithi169.stdout:Kernel IP routing table 2024-08-17T02:26:15.111 INFO:teuthology.orchestra.run.smithi169.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-17T02:26:15.112 INFO:teuthology.orchestra.run.smithi169.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-17T02:26:15.112 INFO:teuthology.orchestra.run.smithi169.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-17T02:26:15.112 INFO:teuthology.orchestra.run.smithi169.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-17T02:26:15.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:15.112 DEBUG:teuthology.orchestra.run.smithi169:> (cd / && exec bash -c ' 2024-08-17T02:26:15.112 DEBUG:teuthology.orchestra.run.smithi169:> set -e 2024-08-17T02:26:15.112 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-17T02:26:15.112 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-17T02:26:15.112 DEBUG:teuthology.orchestra.run.smithi169:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-17T02:26:15.112 DEBUG:teuthology.orchestra.run.smithi169:> ') 2024-08-17T02:26:15.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:15.262 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-08-17T02:26:15.297 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:26:15.297 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:26:15.298 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:15.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:15.298 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link set brx.0 up 2024-08-17T02:26:15.395 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:15.395 DEBUG:teuthology.orchestra.run.smithi169:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:15.430 INFO:teuthology.orchestra.run.smithi169.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-08-17T02:26:15.431 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-17T02:26:15.431 DEBUG:teuthology.orchestra.run.smithi169:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:15.506 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-08-17T02:26:15.506 INFO:teuthology.orchestra.run:Running command with timeout 1800 2024-08-17T02:26:15.506 DEBUG:teuthology.orchestra.run.smithi169:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:15.628 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:15.629 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:15.655 INFO:teuthology.orchestra.run.smithi169.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-08-17T02:26:15.656 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-08-17T02:26:15.656 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: resolved to: "172.21.15.45:3300,172.21.15.169:3300,172.21.15.169:3301" 2024-08-17T02:26:15.656 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: trying mount with new device syntax: 1@2ec357bb-2069-43d1-ab40-d29098820580.cephfs=/ 2024-08-17T02:26:15.656 INFO:teuthology.orchestra.run.smithi169.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.45:3300/172.21.15.169:3300/172.21.15.169:3301" will pass to kernel 2024-08-17T02:26:15.657 INFO:teuthology.orchestra.run.smithi169.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-08-17T02:26:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: You just mounted a file system that supports labels which does not 2024-08-17T02:26:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-17T02:26:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: applications will generate AVC messages and not be allowed access to 2024-08-17T02:26:15.657 INFO:teuthology.orchestra.run.smithi169.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-17T02:26:15.660 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-17T02:26:15.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:26:15.660 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-08-17T02:26:15.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-08-17T02:26:15.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.872+0000 7f31fa200640 1 Processor -- start 2024-08-17T02:26:15.873 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.872+0000 7f31fa200640 1 -- start start 2024-08-17T02:26:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.873+0000 7f31fa200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f31f4152d80 0x7f31f41561c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.873+0000 7f31fa200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31f40cb040 0x7f31f40aca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.873+0000 7f31fa200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31f40acfa0 0x7f31f4158d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.873+0000 7f31fa200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f4156910 con 0x7f31f40acfa0 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.873+0000 7f31fa200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f40ad3e0 con 0x7f31f4152d80 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.873+0000 7f31fa200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f4153150 con 0x7f31f40cb040 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.873+0000 7f31f3e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31f40acfa0 0x7f31f4158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.874+0000 7f31f3e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31f40acfa0 0x7f31f4158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41222/0 (socket says 172.21.15.45:41222) 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.874+0000 7f31f3e00640 1 -- 172.21.15.45:0/1157771880 learned_addr learned my addr 172.21.15.45:0/1157771880 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.874+0000 7f31f3400640 1 --2- 172.21.15.45:0/1157771880 >> v2:172.21.15.169:3300/0 conn(0x7f31f4152d80 0x7f31f41561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.874+0000 7f31ebe00640 1 --2- 172.21.15.45:0/1157771880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31f40cb040 0x7f31f40aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.874+0000 7f31f3e00640 1 -- 172.21.15.45:0/1157771880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31f40cb040 msgr2=0x7f31f40aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.874+0000 7f31f3e00640 1 --2- 172.21.15.45:0/1157771880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31f40cb040 0x7f31f40aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.874+0000 7f31f3e00640 1 -- 172.21.15.45:0/1157771880 >> v2:172.21.15.169:3300/0 conn(0x7f31f4152d80 msgr2=0x7f31f41561c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:15.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.874+0000 7f31f3e00640 1 --2- 172.21.15.45:0/1157771880 >> v2:172.21.15.169:3300/0 conn(0x7f31f4152d80 0x7f31f41561c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.874+0000 7f31f3e00640 1 -- 172.21.15.45:0/1157771880 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f4156b60 con 0x7f31f40acfa0 2024-08-17T02:26:15.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.875+0000 7f31f3e00640 1 --2- 172.21.15.45:0/1157771880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f40acfa0 0x7f31f4158d40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f31f406c5c0 tx=0x7f31ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8db6c7097eeab02 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.875+0000 7f31f2a00640 1 -- 172.21.15.45:0/1157771880 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec031400 con 0x7f31f40acfa0 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.875+0000 7f31f2a00640 1 -- 172.21.15.45:0/1157771880 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31ec02d050 con 0x7f31f40acfa0 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.875+0000 7f31f2a00640 1 -- 172.21.15.45:0/1157771880 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31ec0317d0 con 0x7f31f40acfa0 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.876+0000 7f31fa200640 1 -- 172.21.15.45:0/1157771880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f40acfa0 msgr2=0x7f31f4158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.876+0000 7f31fa200640 1 --2- 172.21.15.45:0/1157771880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f40acfa0 0x7f31f4158d40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f31f406c5c0 tx=0x7f31ec009840 comp rx=0 tx=0).stop 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.876+0000 7f31fa200640 1 -- 172.21.15.45:0/1157771880 shutdown_connections 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.876+0000 7f31fa200640 1 --2- 172.21.15.45:0/1157771880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f40acfa0 0x7f31f4158d40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.876+0000 7f31fa200640 1 --2- 172.21.15.45:0/1157771880 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31f40cb040 0x7f31f40aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.876+0000 7f31fa200640 1 --2- 172.21.15.45:0/1157771880 >> v2:172.21.15.169:3300/0 conn(0x7f31f4152d80 0x7f31f41561c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.876+0000 7f31fa200640 1 -- 172.21.15.45:0/1157771880 >> 172.21.15.45:0/1157771880 conn(0x7f31f4067750 msgr2=0x7f31f406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.876+0000 7f31fa200640 1 -- 172.21.15.45:0/1157771880 shutdown_connections 2024-08-17T02:26:15.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.876+0000 7f31fa200640 1 -- 172.21.15.45:0/1157771880 wait complete. 2024-08-17T02:26:15.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.877+0000 7f31fa200640 1 Processor -- start 2024-08-17T02:26:15.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.877+0000 7f31fa200640 1 -- start start 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.878+0000 7f31fa200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31f40acfa0 0x7f31f414beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.878+0000 7f31fa200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f40cb040 0x7f31f406d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.878+0000 7f31fa200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31f4152d80 0x7f31f40a9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.878+0000 7f31fa200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f406c6c0 con 0x7f31f40cb040 2024-08-17T02:26:15.879 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.878+0000 7f31fa200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f414c9d0 con 0x7f31f40acfa0 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.878+0000 7f31fa200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f406d4e0 con 0x7f31f4152d80 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31ebe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f40cb040 0x7f31f406d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31ebe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f40cb040 0x7f31f406d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41238/0 (socket says 172.21.15.45:41238) 2024-08-17T02:26:15.880 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31ebe00640 1 -- 172.21.15.45:0/319832008 learned_addr learned my addr 172.21.15.45:0/319832008 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31f3400640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31f40acfa0 0x7f31f414beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31f3e00640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31f4152d80 0x7f31f40a9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31ebe00640 1 -- 172.21.15.45:0/319832008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31f4152d80 msgr2=0x7f31f40a9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31ebe00640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31f4152d80 0x7f31f40a9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31ebe00640 1 -- 172.21.15.45:0/319832008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31f40acfa0 msgr2=0x7f31f414beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31ebe00640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31f40acfa0 0x7f31f414beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:15.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31ebe00640 1 -- 172.21.15.45:0/319832008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31ec009ae0 con 0x7f31f40cb040 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31f3400640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31f40acfa0 0x7f31f414beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31f3e00640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31f4152d80 0x7f31f40a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31ebe00640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f40cb040 0x7f31f406d860 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00d8c0 tx=0x7f31dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.879+0000 7f31eaa00640 1 -- 172.21.15.45:0/319832008 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc00de50 con 0x7f31f40cb040 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.880+0000 7f31eaa00640 1 -- 172.21.15.45:0/319832008 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31dc00b8d0 con 0x7f31f40cb040 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.880+0000 7f31eaa00640 1 -- 172.21.15.45:0/319832008 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31dc00bc70 con 0x7f31f40cb040 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.880+0000 7f31fa200640 1 -- 172.21.15.45:0/319832008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f406c8d0 con 0x7f31f40cb040 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.880+0000 7f31fa200640 1 -- 172.21.15.45:0/319832008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f406ce90 con 0x7f31f40cb040 2024-08-17T02:26:15.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.881+0000 7f31fa200640 1 -- 172.21.15.45:0/319832008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f406d620 con 0x7f31f40cb040 2024-08-17T02:26:15.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.882+0000 7f31eaa00640 1 -- 172.21.15.45:0/319832008 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f31dc014640 con 0x7f31f40cb040 2024-08-17T02:26:15.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.882+0000 7f31eaa00640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31d0065180 0x7f31d0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:15.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.883+0000 7f31eaa00640 1 -- 172.21.15.45:0/319832008 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f31dc082b50 con 0x7f31f40cb040 2024-08-17T02:26:15.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.883+0000 7f31f3400640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31d0065180 0x7f31d0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:15.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.883+0000 7f31f3400640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31d0065180 0x7f31d0067630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f31e4006e70 tx=0x7f31e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:15.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:15.887+0000 7f31eaa00640 1 -- 172.21.15.45:0/319832008 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f31f406d620 con 0x7f31f40cb040 2024-08-17T02:26:16.108 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.107+0000 7f31fa200640 1 -- 172.21.15.45:0/319832008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f31f406d620 con 0x7f31f40cb040 2024-08-17T02:26:16.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.248+0000 7f31eaa00640 1 -- 172.21.15.45:0/319832008 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f31f406d620 con 0x7f31f40cb040 2024-08-17T02:26:16.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 -- 172.21.15.45:0/319832008 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31d0065180 msgr2=0x7f31d0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31d0065180 0x7f31d0067630 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f31e4006e70 tx=0x7f31e4008040 comp rx=0 tx=0).stop 2024-08-17T02:26:16.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 -- 172.21.15.45:0/319832008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f40cb040 msgr2=0x7f31f406d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f40cb040 0x7f31f406d860 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f31dc00d8c0 tx=0x7f31dc008040 comp rx=0 tx=0).stop 2024-08-17T02:26:16.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 -- 172.21.15.45:0/319832008 shutdown_connections 2024-08-17T02:26:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f31d0065180 0x7f31d0067630 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f31f4152d80 0x7f31f40a9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f40cb040 0x7f31f406d860 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 --2- 172.21.15.45:0/319832008 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f31f40acfa0 0x7f31f414beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 -- 172.21.15.45:0/319832008 >> 172.21.15.45:0/319832008 conn(0x7f31f4067750 msgr2=0x7f31f40c8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 -- 172.21.15.45:0/319832008 shutdown_connections 2024-08-17T02:26:16.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.250+0000 7f31fa200640 1 -- 172.21.15.45:0/319832008 wait complete. 2024-08-17T02:26:16.266 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:26:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.417+0000 7f6510800640 1 Processor -- start 2024-08-17T02:26:16.418 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.417+0000 7f6510800640 1 -- start start 2024-08-17T02:26:16.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.418+0000 7f6510800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6508158f80 0x7f65080ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.418+0000 7f6510800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6508159350 0x7f65080ca870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.418+0000 7f6510800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65080cb560 con 0x7f65080cf280 2024-08-17T02:26:16.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.418+0000 7f6510800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65080cf7e0 con 0x7f6508159350 2024-08-17T02:26:16.419 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.418+0000 7f6510800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65080cfac0 con 0x7f6508158f80 2024-08-17T02:26:16.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.419+0000 7f650de00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6508158f80 0x7f65080ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.419+0000 7f650d400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f6508159350 0x7f65080ca870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.419+0000 7f650e800640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7f65080cf280 0x7f65080cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:60820/0 (socket says 172.21.15.45:60820) 2024-08-17T02:26:16.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.419+0000 7f650e800640 1 -- 172.21.15.45:0/2361949849 learned_addr learned my addr 172.21.15.45:0/2361949849 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:16.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.419+0000 7f650ca00640 1 -- 172.21.15.45:0/2361949849 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3034154309 0 0) 0x7f65080cb560 con 0x7f65080cf280 2024-08-17T02:26:16.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.419+0000 7f650de00640 1 -- 172.21.15.45:0/2361949849 >> v2:172.21.15.169:3300/0 conn(0x7f6508159350 msgr2=0x7f65080ca870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:16.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.419+0000 7f650de00640 1 --2- 172.21.15.45:0/2361949849 >> v2:172.21.15.169:3300/0 conn(0x7f6508159350 0x7f65080ca870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.420 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.419+0000 7f650de00640 1 -- 172.21.15.45:0/2361949849 >> v1:172.21.15.169:6789/0 conn(0x7f65080cf280 legacy=0x7f65080cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.419+0000 7f650de00640 1 -- 172.21.15.45:0/2361949849 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65080caf10 con 0x7f6508158f80 2024-08-17T02:26:16.421 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.419+0000 7f650d400640 1 --2- 172.21.15.45:0/2361949849 >> v2:172.21.15.169:3300/0 conn(0x7f6508159350 0x7f65080ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.420+0000 7f650de00640 1 --2- 172.21.15.45:0/2361949849 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6508158f80 0x7f65080ca330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009850 tx=0x7f64fc0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0fd383c9cfbe950 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.420+0000 7f650ca00640 1 -- 172.21.15.45:0/2361949849 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc02ad90 con 0x7f6508158f80 2024-08-17T02:26:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.420+0000 7f650ca00640 1 -- 172.21.15.45:0/2361949849 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64fc032440 con 0x7f6508158f80 2024-08-17T02:26:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.420+0000 7f650ca00640 1 -- 172.21.15.45:0/2361949849 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64fc0327e0 con 0x7f6508158f80 2024-08-17T02:26:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.421+0000 7f6510800640 1 -- 172.21.15.45:0/2361949849 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6508158f80 msgr2=0x7f65080ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.421+0000 7f6510800640 1 --2- 172.21.15.45:0/2361949849 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6508158f80 0x7f65080ca330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f64fc009850 tx=0x7f64fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.421+0000 7f6510800640 1 -- 172.21.15.45:0/2361949849 shutdown_connections 2024-08-17T02:26:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.421+0000 7f6510800640 1 --2- 172.21.15.45:0/2361949849 >> v2:172.21.15.169:3300/0 conn(0x7f6508159350 0x7f65080ca870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.421+0000 7f6510800640 1 --2- 172.21.15.45:0/2361949849 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6508158f80 0x7f65080ca330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.422 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.421+0000 7f6510800640 1 -- 172.21.15.45:0/2361949849 >> 172.21.15.45:0/2361949849 conn(0x7f65080cfd90 msgr2=0x7f65080d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.421+0000 7f6510800640 1 -- 172.21.15.45:0/2361949849 shutdown_connections 2024-08-17T02:26:16.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.421+0000 7f6510800640 1 -- 172.21.15.45:0/2361949849 wait complete. 2024-08-17T02:26:16.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.422+0000 7f6510800640 1 Processor -- start 2024-08-17T02:26:16.423 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.422+0000 7f6510800640 1 -- start start 2024-08-17T02:26:16.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.423+0000 7f6510800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65080cf280 0x7f650816bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.423+0000 7f6510800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6508158f80 0x7f650815c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.424 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.423+0000 7f6510800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6508159350 0x7f6508169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.423+0000 7f6510800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f650815a1d0 con 0x7f6508159350 2024-08-17T02:26:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.423+0000 7f6510800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65080b3ce0 con 0x7f6508158f80 2024-08-17T02:26:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.423+0000 7f6510800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65080c3470 con 0x7f65080cf280 2024-08-17T02:26:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.424+0000 7f650e800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6508159350 0x7f6508169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.424+0000 7f650e800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6508159350 0x7f6508169ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41248/0 (socket says 172.21.15.45:41248) 2024-08-17T02:26:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.424+0000 7f650e800640 1 -- 172.21.15.45:0/179702663 learned_addr learned my addr 172.21.15.45:0/179702663 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.424+0000 7f650d400640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6508158f80 0x7f650815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.425 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.424+0000 7f650de00640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65080cf280 0x7f650816bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.424+0000 7f650e800640 1 -- 172.21.15.45:0/179702663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65080cf280 msgr2=0x7f650816bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.424+0000 7f650e800640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65080cf280 0x7f650816bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.424+0000 7f650e800640 1 -- 172.21.15.45:0/179702663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6508158f80 msgr2=0x7f650815c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.424+0000 7f650e800640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6508158f80 0x7f650815c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.426 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.424+0000 7f650e800640 1 -- 172.21.15.45:0/179702663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f8009390 con 0x7f6508159350 2024-08-17T02:26:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.424+0000 7f650e800640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6508159350 0x7f6508169ff0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f650400cbf0 tx=0x7f65040019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.425+0000 7f6501600640 1 -- 172.21.15.45:0/179702663 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650400ce10 con 0x7f6508159350 2024-08-17T02:26:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.425+0000 7f6501600640 1 -- 172.21.15.45:0/179702663 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650400a850 con 0x7f6508159350 2024-08-17T02:26:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.425+0000 7f6501600640 1 -- 172.21.15.45:0/179702663 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650400ac90 con 0x7f6508159350 2024-08-17T02:26:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.425+0000 7f6510800640 1 -- 172.21.15.45:0/179702663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64fc009390 con 0x7f6508159350 2024-08-17T02:26:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.425+0000 7f6510800640 1 -- 172.21.15.45:0/179702663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65080b4220 con 0x7f6508159350 2024-08-17T02:26:16.427 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.426+0000 7f6510800640 1 -- 172.21.15.45:0/179702663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6508064db0 con 0x7f6508159350 2024-08-17T02:26:16.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.427+0000 7f6501600640 1 -- 172.21.15.45:0/179702663 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6504007300 con 0x7f6508159350 2024-08-17T02:26:16.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.428+0000 7f6501600640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f64ec065150 0x7f64ec067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.428 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.428+0000 7f6501600640 1 -- 172.21.15.45:0/179702663 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6504082490 con 0x7f6508159350 2024-08-17T02:26:16.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.428+0000 7f650de00640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f64ec065150 0x7f64ec067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.429 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.429+0000 7f650de00640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f64ec065150 0x7f64ec067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f64fc034000 tx=0x7f64fc032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.431+0000 7f6501600640 1 -- 172.21.15.45:0/179702663 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f65040505e0 con 0x7f6508159350 2024-08-17T02:26:16.639 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.638+0000 7f6510800640 1 -- 172.21.15.45:0/179702663 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f65080b4540 con 0x7f64ec065150 2024-08-17T02:26:16.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.640+0000 7f6501600640 1 -- 172.21.15.45:0/179702663 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f65080b4540 con 0x7f64ec065150 2024-08-17T02:26:16.641 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2024-08-17T02:26:16.641 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:16.641 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephfs" 2024-08-17T02:26:16.641 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:16.641 INFO:teuthology.orchestra.run.smithi045.stdout:] 2024-08-17T02:26:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 -- 172.21.15.45:0/179702663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f64ec065150 msgr2=0x7f64ec067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f64ec065150 0x7f64ec067600 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f64fc034000 tx=0x7f64fc032000 comp rx=0 tx=0).stop 2024-08-17T02:26:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 -- 172.21.15.45:0/179702663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6508159350 msgr2=0x7f6508169ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6508159350 0x7f6508169ff0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f650400cbf0 tx=0x7f65040019b0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 -- 172.21.15.45:0/179702663 shutdown_connections 2024-08-17T02:26:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6508159350 0x7f6508169ff0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6508158f80 0x7f650815c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f64ec065150 0x7f64ec067600 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 --2- 172.21.15.45:0/179702663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65080cf280 0x7f650816bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 -- 172.21.15.45:0/179702663 >> 172.21.15.45:0/179702663 conn(0x7f65080cfd90 msgr2=0x7f6508067ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 -- 172.21.15.45:0/179702663 shutdown_connections 2024-08-17T02:26:16.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.642+0000 7f6510800640 1 -- 172.21.15.45:0/179702663 wait complete. 2024-08-17T02:26:16.659 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-08-17T02:26:16.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.812+0000 7f9597000640 1 Processor -- start 2024-08-17T02:26:16.813 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.812+0000 7f9597000640 1 -- start start 2024-08-17T02:26:16.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9597000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9590158d10 0x7f9590066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9597000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9590159190 0x7f9590067210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9597000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959006e660 con 0x7f9590158940 2024-08-17T02:26:16.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9597000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95900a9b70 con 0x7f9590158d10 2024-08-17T02:26:16.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9597000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959006da50 con 0x7f9590159190 2024-08-17T02:26:16.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9595c00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9590158940 0x7f959015d140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43868/0 (socket says 172.21.15.45:43868) 2024-08-17T02:26:16.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9595c00640 1 -- 172.21.15.45:0/3440573830 learned_addr learned my addr 172.21.15.45:0/3440573830 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:16.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9595200640 1 --2- 172.21.15.45:0/3440573830 >> v2:172.21.15.45:3300/0 conn(0x7f9590158d10 0x7f9590066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.815 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9596600640 1 --2- 172.21.15.45:0/3440573830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9590159190 0x7f9590067210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f958fe00640 1 -- 172.21.15.45:0/3440573830 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 692696017 0 0) 0x7f959006e660 con 0x7f9590158940 2024-08-17T02:26:16.816 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9595200640 1 -- 172.21.15.45:0/3440573830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9590159190 msgr2=0x7f9590067210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:16.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9595200640 1 --2- 172.21.15.45:0/3440573830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9590159190 0x7f9590067210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9595200640 1 -- 172.21.15.45:0/3440573830 >> v1:172.21.15.45:6789/0 conn(0x7f9590158940 legacy=0x7f959015d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9595200640 1 -- 172.21.15.45:0/3440573830 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959006dd30 con 0x7f9590158d10 2024-08-17T02:26:16.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.814+0000 7f9596600640 1 --2- 172.21.15.45:0/3440573830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9590159190 0x7f9590067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:26:16.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.815+0000 7f9595200640 1 --2- 172.21.15.45:0/3440573830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9590158d10 0x7f9590066cd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f957c009850 tx=0x7f957c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af54ca0a11e845ed server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.816+0000 7f958fe00640 1 -- 172.21.15.45:0/3440573830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c02ad00 con 0x7f9590158d10 2024-08-17T02:26:16.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.816+0000 7f958fe00640 1 -- 172.21.15.45:0/3440573830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c02ae60 con 0x7f9590158d10 2024-08-17T02:26:16.817 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.816+0000 7f958fe00640 1 -- 172.21.15.45:0/3440573830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c032670 con 0x7f9590158d10 2024-08-17T02:26:16.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.816+0000 7f9597000640 1 -- 172.21.15.45:0/3440573830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9590158d10 msgr2=0x7f9590066cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.816+0000 7f9597000640 1 --2- 172.21.15.45:0/3440573830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9590158d10 0x7f9590066cd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f957c009850 tx=0x7f957c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.816+0000 7f9597000640 1 -- 172.21.15.45:0/3440573830 shutdown_connections 2024-08-17T02:26:16.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.816+0000 7f9597000640 1 --2- 172.21.15.45:0/3440573830 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9590159190 0x7f9590067210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.816+0000 7f9597000640 1 --2- 172.21.15.45:0/3440573830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9590158d10 0x7f9590066cd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.816+0000 7f9597000640 1 -- 172.21.15.45:0/3440573830 >> 172.21.15.45:0/3440573830 conn(0x7f9590067de0 msgr2=0x7f95900681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:16.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.816+0000 7f9597000640 1 -- 172.21.15.45:0/3440573830 shutdown_connections 2024-08-17T02:26:16.818 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.817+0000 7f9597000640 1 -- 172.21.15.45:0/3440573830 wait complete. 2024-08-17T02:26:16.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.818+0000 7f9597000640 1 Processor -- start 2024-08-17T02:26:16.819 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.818+0000 7f9597000640 1 -- start start 2024-08-17T02:26:16.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.819+0000 7f9597000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9590158940 0x7f959013fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.819+0000 7f9597000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9590158d10 0x7f95901571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.819+0000 7f9597000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9590159190 0x7f9590157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.819+0000 7f9597000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959015d330 con 0x7f9590158940 2024-08-17T02:26:16.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.819+0000 7f9597000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9590169ed0 con 0x7f9590158d10 2024-08-17T02:26:16.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.819+0000 7f9597000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959016c660 con 0x7f9590159190 2024-08-17T02:26:16.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.819+0000 7f9595c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9590158940 0x7f959013fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.821 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.819+0000 7f9595c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9590158940 0x7f959013fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41256/0 (socket says 172.21.15.45:41256) 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.819+0000 7f9595c00640 1 -- 172.21.15.45:0/3810655985 learned_addr learned my addr 172.21.15.45:0/3810655985 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.819+0000 7f9595200640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9590158d10 0x7f95901571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.819+0000 7f9596600640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9590159190 0x7f9590157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.820+0000 7f9595c00640 1 -- 172.21.15.45:0/3810655985 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9590159190 msgr2=0x7f9590157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.820+0000 7f9595c00640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9590159190 0x7f9590157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.820+0000 7f9595c00640 1 -- 172.21.15.45:0/3810655985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9590158d10 msgr2=0x7f95901571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.820+0000 7f9595c00640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9590158d10 0x7f95901571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.820+0000 7f9595c00640 1 -- 172.21.15.45:0/3810655985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f957c009390 con 0x7f9590158940 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.820+0000 7f9595c00640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9590158940 0x7f959013fa30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f958400c5e0 tx=0x7f9584007d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.820+0000 7f958cc00640 1 -- 172.21.15.45:0/3810655985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584005aa0 con 0x7f9590158940 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.820+0000 7f958cc00640 1 -- 172.21.15.45:0/3810655985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9584005c00 con 0x7f9590158940 2024-08-17T02:26:16.822 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.820+0000 7f958cc00640 1 -- 172.21.15.45:0/3810655985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95840070f0 con 0x7f9590158940 2024-08-17T02:26:16.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.820+0000 7f9597000640 1 -- 172.21.15.45:0/3810655985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959016c940 con 0x7f9590158940 2024-08-17T02:26:16.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.820+0000 7f9597000640 1 -- 172.21.15.45:0/3810655985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959016cf00 con 0x7f9590158940 2024-08-17T02:26:16.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.821+0000 7f9597000640 1 -- 172.21.15.45:0/3810655985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9590071050 con 0x7f9590158940 2024-08-17T02:26:16.823 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.822+0000 7f958cc00640 1 -- 172.21.15.45:0/3810655985 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9584007520 con 0x7f9590158940 2024-08-17T02:26:16.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.824+0000 7f958cc00640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9570065150 0x7f9570067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:16.824 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.824+0000 7f958cc00640 1 -- 172.21.15.45:0/3810655985 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9584081e30 con 0x7f9590158940 2024-08-17T02:26:16.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.824+0000 7f9595200640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9570065150 0x7f9570067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:16.825 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.825+0000 7f9595200640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9570065150 0x7f9570067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f957c034000 tx=0x7f957c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:16.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:16.828+0000 7f958cc00640 1 -- 172.21.15.45:0/3810655985 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f958404ff80 con 0x7f9590158940 2024-08-17T02:26:17.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.008+0000 7f9597000640 1 -- 172.21.15.45:0/3810655985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9590068af0 con 0x7f9590158940 2024-08-17T02:26:17.009 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.009+0000 7f958cc00640 1 -- 172.21.15.45:0/3810655985 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f95840535a0 con 0x7f9590158940 2024-08-17T02:26:17.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.010+0000 7f9597000640 1 -- 172.21.15.45:0/3810655985 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9570065150 msgr2=0x7f9570067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.010+0000 7f9597000640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9570065150 0x7f9570067600 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f957c034000 tx=0x7f957c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.010+0000 7f9597000640 1 -- 172.21.15.45:0/3810655985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9590158940 msgr2=0x7f959013fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.010+0000 7f9597000640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9590158940 0x7f959013fa30 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f958400c5e0 tx=0x7f9584007d60 comp rx=0 tx=0).stop 2024-08-17T02:26:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.011+0000 7f9597000640 1 -- 172.21.15.45:0/3810655985 shutdown_connections 2024-08-17T02:26:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.011+0000 7f9597000640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9570065150 0x7f9570067600 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.011+0000 7f9597000640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9590159190 0x7f9590157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.011+0000 7f9597000640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9590158d10 0x7f95901571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.011+0000 7f9597000640 1 --2- 172.21.15.45:0/3810655985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9590158940 0x7f959013fa30 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.011+0000 7f9597000640 1 -- 172.21.15.45:0/3810655985 >> 172.21.15.45:0/3810655985 conn(0x7f9590067de0 msgr2=0x7f9590156320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.011+0000 7f9597000640 1 -- 172.21.15.45:0/3810655985 shutdown_connections 2024-08-17T02:26:17.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.011+0000 7f9597000640 1 -- 172.21.15.45:0/3810655985 wait complete. 2024-08-17T02:26:17.027 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000631254 2024-08-17T02:26:17.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.180+0000 7f8f81800640 1 Processor -- start 2024-08-17T02:26:17.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.180+0000 7f8f81800640 1 -- start start 2024-08-17T02:26:17.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.181+0000 7f8f81800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f8f7c158e30 0x7f8f7c0aa130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.181+0000 7f8f81800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f7c069710 0x7f8f7c06d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.181+0000 7f8f81800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f7c068540 con 0x7f8f7c159200 2024-08-17T02:26:17.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.181+0000 7f8f81800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7c067690 con 0x7f8f7c069710 2024-08-17T02:26:17.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.181+0000 7f8f81800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f7c0aa670 con 0x7f8f7c158e30 2024-08-17T02:26:17.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.181+0000 7f8f80e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f7c069710 0x7f8f7c06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.181+0000 7f8f73400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8f7c159200 0x7f8f7c069000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43878/0 (socket says 172.21.15.45:43878) 2024-08-17T02:26:17.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.181+0000 7f8f80e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f7c069710 0x7f8f7c06d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41264/0 (socket says 172.21.15.45:41264) 2024-08-17T02:26:17.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.181+0000 7f8f73400640 1 -- 172.21.15.45:0/3851814925 learned_addr learned my addr 172.21.15.45:0/3851814925 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:17.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.181+0000 7f8f7be00640 1 --2- 172.21.15.45:0/3851814925 >> v2:172.21.15.169:3300/0 conn(0x7f8f7c158e30 0x7f8f7c0aa130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.182+0000 7f8f80e00640 1 -- 172.21.15.45:0/3851814925 >> v2:172.21.15.169:3300/0 conn(0x7f8f7c158e30 msgr2=0x7f8f7c0aa130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:17.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.182+0000 7f8f80e00640 1 --2- 172.21.15.45:0/3851814925 >> v2:172.21.15.169:3300/0 conn(0x7f8f7c158e30 0x7f8f7c0aa130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.182+0000 7f8f7b400640 1 -- 172.21.15.45:0/3851814925 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481254096 0 0) 0x7f8f7c068540 con 0x7f8f7c159200 2024-08-17T02:26:17.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.182+0000 7f8f80e00640 1 -- 172.21.15.45:0/3851814925 >> v1:172.21.15.45:6789/0 conn(0x7f8f7c159200 legacy=0x7f8f7c069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.182+0000 7f8f80e00640 1 -- 172.21.15.45:0/3851814925 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f7c067930 con 0x7f8f7c069710 2024-08-17T02:26:17.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.183+0000 7f8f80e00640 1 --2- 172.21.15.45:0/3851814925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f7c069710 0x7f8f7c06d120 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c06cc40 tx=0x7f8f74009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c615277c16106d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.183+0000 7f8f7b400640 1 -- 172.21.15.45:0/3851814925 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74007550 con 0x7f8f7c069710 2024-08-17T02:26:17.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.183+0000 7f8f7b400640 1 -- 172.21.15.45:0/3851814925 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f7402d050 con 0x7f8f7c069710 2024-08-17T02:26:17.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.183+0000 7f8f7b400640 1 -- 172.21.15.45:0/3851814925 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740078e0 con 0x7f8f7c069710 2024-08-17T02:26:17.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.184+0000 7f8f81800640 1 -- 172.21.15.45:0/3851814925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f7c069710 msgr2=0x7f8f7c06d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.184+0000 7f8f81800640 1 --2- 172.21.15.45:0/3851814925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f7c069710 0x7f8f7c06d120 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c06cc40 tx=0x7f8f74009780 comp rx=0 tx=0).stop 2024-08-17T02:26:17.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.184+0000 7f8f81800640 1 -- 172.21.15.45:0/3851814925 shutdown_connections 2024-08-17T02:26:17.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.184+0000 7f8f81800640 1 --2- 172.21.15.45:0/3851814925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f7c069710 0x7f8f7c06d120 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.184+0000 7f8f81800640 1 --2- 172.21.15.45:0/3851814925 >> v2:172.21.15.169:3300/0 conn(0x7f8f7c158e30 0x7f8f7c0aa130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.184+0000 7f8f81800640 1 -- 172.21.15.45:0/3851814925 >> 172.21.15.45:0/3851814925 conn(0x7f8f7c0cc040 msgr2=0x7f8f7c0cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:17.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.184+0000 7f8f81800640 1 -- 172.21.15.45:0/3851814925 shutdown_connections 2024-08-17T02:26:17.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.184+0000 7f8f81800640 1 -- 172.21.15.45:0/3851814925 wait complete. 2024-08-17T02:26:17.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.185+0000 7f8f81800640 1 Processor -- start 2024-08-17T02:26:17.186 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.186+0000 7f8f81800640 1 -- start start 2024-08-17T02:26:17.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.186+0000 7f8f81800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7c069710 0x7f8f7c0c7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.186+0000 7f8f81800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f7c158e30 0x7f8f7c0c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.186+0000 7f8f81800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7c159200 0x7f8f7c0c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.186+0000 7f8f81800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0abb40 con 0x7f8f7c158e30 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.186+0000 7f8f81800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0ac9a0 con 0x7f8f7c159200 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.186+0000 7f8f81800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f7c0abd90 con 0x7f8f7c069710 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.187+0000 7f8f73400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f7c158e30 0x7f8f7c0c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.187+0000 7f8f73400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f7c158e30 0x7f8f7c0c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41272/0 (socket says 172.21.15.45:41272) 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.187+0000 7f8f73400640 1 -- 172.21.15.45:0/2519957778 learned_addr learned my addr 172.21.15.45:0/2519957778 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.187+0000 7f8f80e00640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7c159200 0x7f8f7c0c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.187+0000 7f8f7be00640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7c069710 0x7f8f7c0c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.187+0000 7f8f73400640 1 -- 172.21.15.45:0/2519957778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7c069710 msgr2=0x7f8f7c0c7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.187+0000 7f8f73400640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7c069710 0x7f8f7c0c7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.187+0000 7f8f73400640 1 -- 172.21.15.45:0/2519957778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7c159200 msgr2=0x7f8f7c0c6980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.187+0000 7f8f73400640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7c159200 0x7f8f7c0c6980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:17.189 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.187+0000 7f8f73400640 1 -- 172.21.15.45:0/2519957778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f74009a20 con 0x7f8f7c158e30 2024-08-17T02:26:17.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.187+0000 7f8f73400640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f7c158e30 0x7f8f7c0c7c50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c540 tx=0x7f8f6400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.188+0000 7f8f73e00640 1 -- 172.21.15.45:0/2519957778 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64005aa0 con 0x7f8f7c158e30 2024-08-17T02:26:17.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.188+0000 7f8f73e00640 1 -- 172.21.15.45:0/2519957778 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64005c00 con 0x7f8f7c158e30 2024-08-17T02:26:17.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.188+0000 7f8f73e00640 1 -- 172.21.15.45:0/2519957778 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f640070f0 con 0x7f8f7c158e30 2024-08-17T02:26:17.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.188+0000 7f8f81800640 1 -- 172.21.15.45:0/2519957778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7c0ac070 con 0x7f8f7c158e30 2024-08-17T02:26:17.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.188+0000 7f8f81800640 1 -- 172.21.15.45:0/2519957778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f7c0ac630 con 0x7f8f7c158e30 2024-08-17T02:26:17.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.189+0000 7f8f81800640 1 -- 172.21.15.45:0/2519957778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f7c0acb30 con 0x7f8f7c158e30 2024-08-17T02:26:17.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.190+0000 7f8f73e00640 1 -- 172.21.15.45:0/2519957778 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8f64007520 con 0x7f8f7c158e30 2024-08-17T02:26:17.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.191+0000 7f8f73e00640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8f58065150 0x7f8f58067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:17.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.191+0000 7f8f73e00640 1 -- 172.21.15.45:0/2519957778 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8f64081ec0 con 0x7f8f7c158e30 2024-08-17T02:26:17.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.191+0000 7f8f7be00640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8f58065150 0x7f8f58067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:17.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.192+0000 7f8f7be00640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8f58065150 0x7f8f58067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009360 tx=0x7f8f6c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:17.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.195+0000 7f8f73e00640 1 -- 172.21.15.45:0/2519957778 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f8f64050000 con 0x7f8f7c158e30 2024-08-17T02:26:17.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:17.402+0000 7f8f81800640 1 -- 172.21.15.45:0/2519957778 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000631254", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f7c071050 con 0x7f8f58065150 2024-08-17T02:26:20.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.281+0000 7f8f73e00640 1 -- 172.21.15.45:0/2519957778 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f8f7c071050 con 0x7f8f58065150 2024-08-17T02:26:20.282 INFO:teuthology.orchestra.run.smithi045.stderr:Volume created successfully (no MDS daemons created) 2024-08-17T02:26:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.286+0000 7f8f81800640 1 -- 172.21.15.45:0/2519957778 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8f58065150 msgr2=0x7f8f58067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.286+0000 7f8f81800640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8f58065150 0x7f8f58067600 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c009360 tx=0x7f8f6c008040 comp rx=0 tx=0).stop 2024-08-17T02:26:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.286+0000 7f8f81800640 1 -- 172.21.15.45:0/2519957778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f7c158e30 msgr2=0x7f8f7c0c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.286+0000 7f8f81800640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f7c158e30 0x7f8f7c0c7c50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c540 tx=0x7f8f6400c940 comp rx=0 tx=0).stop 2024-08-17T02:26:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.286+0000 7f8f81800640 1 -- 172.21.15.45:0/2519957778 shutdown_connections 2024-08-17T02:26:20.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.286+0000 7f8f81800640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f8f7c159200 0x7f8f7c0c6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.286+0000 7f8f81800640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f7c158e30 0x7f8f7c0c7c50 secure :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8f6400c540 tx=0x7f8f6400c940 comp rx=0 tx=0).stop 2024-08-17T02:26:20.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.286+0000 7f8f81800640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8f58065150 0x7f8f58067600 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.286+0000 7f8f81800640 1 --2- 172.21.15.45:0/2519957778 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f8f7c069710 0x7f8f7c0c7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.286+0000 7f8f81800640 1 -- 172.21.15.45:0/2519957778 >> 172.21.15.45:0/2519957778 conn(0x7f8f7c0cc040 msgr2=0x7f8f7c0cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:20.289 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.289+0000 7f8f81800640 1 -- 172.21.15.45:0/2519957778 shutdown_connections 2024-08-17T02:26:20.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.289+0000 7f8f81800640 1 -- 172.21.15.45:0/2519957778 wait complete. 2024-08-17T02:26:20.319 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-08-17T02:26:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.476+0000 7f8304800640 1 Processor -- start 2024-08-17T02:26:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.476+0000 7f8304800640 1 -- start start 2024-08-17T02:26:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.477+0000 7f8304800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc1401b0 0x7f82fc0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.477+0000 7f8304800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f82fc140580 0x7f82fc0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.478+0000 7f8304800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82fc0b16d0 con 0x7f82fc0b1270 2024-08-17T02:26:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.478+0000 7f8304800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82fc0cb450 con 0x7f82fc140580 2024-08-17T02:26:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.478+0000 7f8304800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc0caa80 con 0x7f82fc1401b0 2024-08-17T02:26:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.478+0000 7f8302800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f82fc0b1270 0x7f82fc0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43894/0 (socket says 172.21.15.45:43894) 2024-08-17T02:26:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.478+0000 7f8302800640 1 -- 172.21.15.45:0/1852028123 learned_addr learned my addr 172.21.15.45:0/1852028123 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.478+0000 7f8301400640 1 --2- 172.21.15.45:0/1852028123 >> v2:172.21.15.169:3300/0 conn(0x7f82fc140580 0x7f82fc0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.478+0000 7f8301e00640 1 --2- 172.21.15.45:0/1852028123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc1401b0 0x7f82fc0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.478+0000 7f8300a00640 1 -- 172.21.15.45:0/1852028123 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831025223 0 0) 0x7f82f8001490 con 0x7f82fc0b1270 2024-08-17T02:26:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.478+0000 7f8300a00640 1 -- 172.21.15.45:0/1852028123 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e40034e0 con 0x7f82fc0b1270 2024-08-17T02:26:20.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.479+0000 7f8301400640 1 -- 172.21.15.45:0/1852028123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc1401b0 msgr2=0x7f82fc0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:20.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.479+0000 7f8301400640 1 --2- 172.21.15.45:0/1852028123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc1401b0 0x7f82fc0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.479+0000 7f8301400640 1 -- 172.21.15.45:0/1852028123 >> v1:172.21.15.45:6789/0 conn(0x7f82fc0b1270 legacy=0x7f82fc0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.479+0000 7f8301400640 1 -- 172.21.15.45:0/1852028123 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc0c9e70 con 0x7f82fc140580 2024-08-17T02:26:20.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.479+0000 7f8301e00640 1 --2- 172.21.15.45:0/1852028123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc1401b0 0x7f82fc0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:26:20.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.480+0000 7f8301400640 1 --2- 172.21.15.45:0/1852028123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82fc140580 0x7f82fc0b0d30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009850 tx=0x7f82ec0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=530154872ca4dfc3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.480+0000 7f8300a00640 1 -- 172.21.15.45:0/1852028123 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec02ad00 con 0x7f82fc140580 2024-08-17T02:26:20.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.480+0000 7f8300a00640 1 -- 172.21.15.45:0/1852028123 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec02ae60 con 0x7f82fc140580 2024-08-17T02:26:20.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.480+0000 7f8300a00640 1 -- 172.21.15.45:0/1852028123 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec032670 con 0x7f82fc140580 2024-08-17T02:26:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.481+0000 7f8304800640 1 -- 172.21.15.45:0/1852028123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82fc140580 msgr2=0x7f82fc0b0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.481+0000 7f8304800640 1 --2- 172.21.15.45:0/1852028123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82fc140580 0x7f82fc0b0d30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009850 tx=0x7f82ec0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.481+0000 7f8304800640 1 -- 172.21.15.45:0/1852028123 shutdown_connections 2024-08-17T02:26:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.481+0000 7f8304800640 1 --2- 172.21.15.45:0/1852028123 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82fc140580 0x7f82fc0b0d30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.481+0000 7f8304800640 1 --2- 172.21.15.45:0/1852028123 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc1401b0 0x7f82fc0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.481+0000 7f8304800640 1 -- 172.21.15.45:0/1852028123 >> 172.21.15.45:0/1852028123 conn(0x7f82fc0cb9b0 msgr2=0x7f82fc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.481+0000 7f8304800640 1 -- 172.21.15.45:0/1852028123 shutdown_connections 2024-08-17T02:26:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.481+0000 7f8304800640 1 -- 172.21.15.45:0/1852028123 wait complete. 2024-08-17T02:26:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.482+0000 7f8304800640 1 Processor -- start 2024-08-17T02:26:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.482+0000 7f8304800640 1 -- start start 2024-08-17T02:26:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.483+0000 7f8304800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82fc0b1270 0x7f82fc167be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.483+0000 7f8304800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82fc1401b0 0x7f82fc0aadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.483+0000 7f8304800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc140580 0x7f82fc0ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.483+0000 7f8304800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc0a79e0 con 0x7f82fc1401b0 2024-08-17T02:26:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.483+0000 7f8304800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc0a6e60 con 0x7f82fc0b1270 2024-08-17T02:26:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.483+0000 7f8304800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82fc0a7140 con 0x7f82fc140580 2024-08-17T02:26:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.483+0000 7f8301400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82fc1401b0 0x7f82fc0aadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.483+0000 7f8301400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82fc1401b0 0x7f82fc0aadf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41286/0 (socket says 172.21.15.45:41286) 2024-08-17T02:26:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.483+0000 7f8301400640 1 -- 172.21.15.45:0/128947148 learned_addr learned my addr 172.21.15.45:0/128947148 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f8301e00640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82fc0b1270 0x7f82fc167be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f8302800640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc140580 0x7f82fc0ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f8301400640 1 -- 172.21.15.45:0/128947148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc140580 msgr2=0x7f82fc0ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f8301400640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc140580 0x7f82fc0ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f8301400640 1 -- 172.21.15.45:0/128947148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82fc0b1270 msgr2=0x7f82fc167be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f8301400640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82fc0b1270 0x7f82fc167be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f8301400640 1 -- 172.21.15.45:0/128947148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0009390 con 0x7f82fc1401b0 2024-08-17T02:26:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f8301e00640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82fc0b1270 0x7f82fc167be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f8302800640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc140580 0x7f82fc0ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:26:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f8301400640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82fc1401b0 0x7f82fc0aadf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009360 tx=0x7f82ec032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f82f5600640 1 -- 172.21.15.45:0/128947148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec03b6e0 con 0x7f82fc1401b0 2024-08-17T02:26:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f82f5600640 1 -- 172.21.15.45:0/128947148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82ec03b840 con 0x7f82fc1401b0 2024-08-17T02:26:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f82f5600640 1 -- 172.21.15.45:0/128947148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82ec03bc00 con 0x7f82fc1401b0 2024-08-17T02:26:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.484+0000 7f8304800640 1 -- 172.21.15.45:0/128947148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ec009390 con 0x7f82fc1401b0 2024-08-17T02:26:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.485+0000 7f8304800640 1 -- 172.21.15.45:0/128947148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82fc0a7700 con 0x7f82fc1401b0 2024-08-17T02:26:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.486+0000 7f8304800640 1 -- 172.21.15.45:0/128947148 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82fc168460 con 0x7f82fc1401b0 2024-08-17T02:26:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.487+0000 7f82f5600640 1 -- 172.21.15.45:0/128947148 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f82ec043030 con 0x7f82fc1401b0 2024-08-17T02:26:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.487+0000 7f82f5600640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82e0065150 0x7f82e0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.488+0000 7f82f5600640 1 -- 172.21.15.45:0/128947148 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f82ec041070 con 0x7f82fc1401b0 2024-08-17T02:26:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.488+0000 7f8301e00640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82e0065150 0x7f82e0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.489+0000 7f8301e00640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82e0065150 0x7f82e0067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009360 tx=0x7f82f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.492+0000 7f82f5600640 1 -- 172.21.15.45:0/128947148 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f82fc168460 con 0x7f82fc1401b0 2024-08-17T02:26:20.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.699+0000 7f8304800640 1 -- 172.21.15.45:0/128947148 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f82fc168460 con 0x7f82e0065150 2024-08-17T02:26:20.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.700+0000 7f82f5600640 1 -- 172.21.15.45:0/128947148 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f82fc168460 con 0x7f82e0065150 2024-08-17T02:26:20.701 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2024-08-17T02:26:20.701 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:20.701 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "cephfs" 2024-08-17T02:26:20.701 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2024-08-17T02:26:20.701 INFO:teuthology.orchestra.run.smithi045.stdout: { 2024-08-17T02:26:20.701 INFO:teuthology.orchestra.run.smithi045.stdout: "name": "volume_0000000000631254" 2024-08-17T02:26:20.701 INFO:teuthology.orchestra.run.smithi045.stdout: } 2024-08-17T02:26:20.701 INFO:teuthology.orchestra.run.smithi045.stdout:] 2024-08-17T02:26:20.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 -- 172.21.15.45:0/128947148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82e0065150 msgr2=0x7f82e0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82e0065150 0x7f82e0067600 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f82f0009360 tx=0x7f82f0008040 comp rx=0 tx=0).stop 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 -- 172.21.15.45:0/128947148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82fc1401b0 msgr2=0x7f82fc0aadf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82fc1401b0 0x7f82fc0aadf0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f82ec009360 tx=0x7f82ec032000 comp rx=0 tx=0).stop 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 -- 172.21.15.45:0/128947148 shutdown_connections 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f82e0065150 0x7f82e0067600 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82fc140580 0x7f82fc0ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82fc1401b0 0x7f82fc0aadf0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 --2- 172.21.15.45:0/128947148 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82fc0b1270 0x7f82fc167be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 -- 172.21.15.45:0/128947148 >> 172.21.15.45:0/128947148 conn(0x7f82fc0cb9b0 msgr2=0x7f82fc13edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 -- 172.21.15.45:0/128947148 shutdown_connections 2024-08-17T02:26:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.702+0000 7f8304800640 1 -- 172.21.15.45:0/128947148 wait complete. 2024-08-17T02:26:20.719 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2024-08-17T02:26:20.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.871+0000 7f1126200640 1 Processor -- start 2024-08-17T02:26:20.872 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.872+0000 7f1126200640 1 -- start start 2024-08-17T02:26:20.874 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.873+0000 7f1126200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f11200ade90 0x7f11200ac000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.873+0000 7f1126200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11200abb70 con 0x7f11200ae620 2024-08-17T02:26:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.873+0000 7f1126200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11200aaf60 con 0x7f11201569d0 2024-08-17T02:26:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.873+0000 7f1126200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11200ae2a0 con 0x7f11200ade90 2024-08-17T02:26:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.873+0000 7f1125800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f11200ae620 0x7f11200aea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43906/0 (socket says 172.21.15.45:43906) 2024-08-17T02:26:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.873+0000 7f1125800640 1 -- 172.21.15.45:0/447915218 learned_addr learned my addr 172.21.15.45:0/447915218 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:26:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.873+0000 7f111fe00640 1 --2- 172.21.15.45:0/447915218 >> v2:172.21.15.169:3300/0 conn(0x7f11200ade90 0x7f11200ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.873+0000 7f111f400640 1 -- 172.21.15.45:0/447915218 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460178908 0 0) 0x7f11200abb70 con 0x7f11200ae620 2024-08-17T02:26:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.874+0000 7f111f400640 1 -- 172.21.15.45:0/447915218 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11080034e0 con 0x7f11200ae620 2024-08-17T02:26:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.874+0000 7f111f400640 1 -- 172.21.15.45:0/447915218 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596123426 0 0) 0x7f11200aaf60 con 0x7f11201569d0 2024-08-17T02:26:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.874+0000 7f111f400640 1 -- 172.21.15.45:0/447915218 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11200abb70 con 0x7f11201569d0 2024-08-17T02:26:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.874+0000 7f111fe00640 1 -- 172.21.15.45:0/447915218 >> v1:172.21.15.169:6789/0 conn(0x7f11201569d0 legacy=0x7f11200aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.874+0000 7f111fe00640 1 -- 172.21.15.45:0/447915218 >> v1:172.21.15.45:6789/0 conn(0x7f11200ae620 legacy=0x7f11200aea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.876 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.874+0000 7f111fe00640 1 -- 172.21.15.45:0/447915218 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11200ab240 con 0x7f11200ade90 2024-08-17T02:26:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.875+0000 7f111fe00640 1 --2- 172.21.15.45:0/447915218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11200ade90 0x7f11200ac000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f110c009850 tx=0x7f110c0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f828bd3d14a0bb51 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.875+0000 7f111f400640 1 -- 172.21.15.45:0/447915218 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c02ad90 con 0x7f11200ade90 2024-08-17T02:26:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.875+0000 7f111f400640 1 -- 172.21.15.45:0/447915218 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c032440 con 0x7f11200ade90 2024-08-17T02:26:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.875+0000 7f111f400640 1 -- 172.21.15.45:0/447915218 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c0327e0 con 0x7f11200ade90 2024-08-17T02:26:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.876+0000 7f1126200640 1 -- 172.21.15.45:0/447915218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11200ade90 msgr2=0x7f11200ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.876+0000 7f1126200640 1 --2- 172.21.15.45:0/447915218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11200ade90 0x7f11200ac000 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f110c009850 tx=0x7f110c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.876+0000 7f1126200640 1 -- 172.21.15.45:0/447915218 shutdown_connections 2024-08-17T02:26:20.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.876+0000 7f1126200640 1 --2- 172.21.15.45:0/447915218 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11200ade90 0x7f11200ac000 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.876+0000 7f1126200640 1 -- 172.21.15.45:0/447915218 >> 172.21.15.45:0/447915218 conn(0x7f1120096a70 msgr2=0x7f1120096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:20.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.876+0000 7f1126200640 1 -- 172.21.15.45:0/447915218 shutdown_connections 2024-08-17T02:26:20.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.876+0000 7f1126200640 1 -- 172.21.15.45:0/447915218 wait complete. 2024-08-17T02:26:20.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.877+0000 7f1126200640 1 Processor -- start 2024-08-17T02:26:20.878 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.877+0000 7f1126200640 1 -- start start 2024-08-17T02:26:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.878+0000 7f1126200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11200ade90 0x7f1120157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.878+0000 7f1126200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11200ae620 0x7f112014ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.878+0000 7f1126200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11201569d0 0x7f112014c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.878+0000 7f1126200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1120158380 con 0x7f11200ade90 2024-08-17T02:26:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.878+0000 7f1126200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f112014dc70 con 0x7f11200ae620 2024-08-17T02:26:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.878+0000 7f1126200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1120158580 con 0x7f11201569d0 2024-08-17T02:26:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.879+0000 7f1124e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11200ade90 0x7f1120157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.879+0000 7f1124e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11200ade90 0x7f1120157e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41296/0 (socket says 172.21.15.45:41296) 2024-08-17T02:26:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.879+0000 7f1124e00640 1 -- 172.21.15.45:0/3770900329 learned_addr learned my addr 172.21.15.45:0/3770900329 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.879+0000 7f111fe00640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11200ae620 0x7f112014ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.879+0000 7f1125800640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11201569d0 0x7f112014c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.879+0000 7f1124e00640 1 -- 172.21.15.45:0/3770900329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11201569d0 msgr2=0x7f112014c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.879+0000 7f1124e00640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11201569d0 0x7f112014c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.879+0000 7f1124e00640 1 -- 172.21.15.45:0/3770900329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11200ae620 msgr2=0x7f112014ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.879+0000 7f1124e00640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11200ae620 0x7f112014ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.879+0000 7f1124e00640 1 -- 172.21.15.45:0/3770900329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c009390 con 0x7f11200ade90 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.879+0000 7f1124e00640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11200ade90 0x7f1120157e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f111400c4e0 tx=0x7f1114007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.880+0000 7f1113e00640 1 -- 172.21.15.45:0/3770900329 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114016070 con 0x7f11200ade90 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.880+0000 7f1113e00640 1 -- 172.21.15.45:0/3770900329 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1114011590 con 0x7f11200ade90 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.880+0000 7f1126200640 1 -- 172.21.15.45:0/3770900329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1120158b40 con 0x7f11200ade90 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.880+0000 7f1113e00640 1 -- 172.21.15.45:0/3770900329 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1114011990 con 0x7f11200ade90 2024-08-17T02:26:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.880+0000 7f1126200640 1 -- 172.21.15.45:0/3770900329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1120159100 con 0x7f11200ade90 2024-08-17T02:26:20.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.881+0000 7f1126200640 1 -- 172.21.15.45:0/3770900329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1120071050 con 0x7f11200ade90 2024-08-17T02:26:20.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.882+0000 7f1113e00640 1 -- 172.21.15.45:0/3770900329 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1114012420 con 0x7f11200ade90 2024-08-17T02:26:20.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.882+0000 7f1113e00640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1100065150 0x7f1100067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.882+0000 7f1113e00640 1 -- 172.21.15.45:0/3770900329 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f11140822b0 con 0x7f11200ade90 2024-08-17T02:26:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.883+0000 7f111fe00640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1100065150 0x7f1100067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.883+0000 7f111fe00640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1100065150 0x7f1100067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f110c034000 tx=0x7f110c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:20.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:20.887+0000 7f1113e00640 1 -- 172.21.15.45:0/3770900329 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f111404fff0 con 0x7f11200ade90 2024-08-17T02:26:21.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.069+0000 7f1126200640 1 -- 172.21.15.45:0/3770900329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f1120069a90 con 0x7f11200ade90 2024-08-17T02:26:21.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.070+0000 7f1113e00640 1 -- 172.21.15.45:0/3770900329 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f1114053610 con 0x7f11200ade90 2024-08-17T02:26:21.071 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 -- 172.21.15.45:0/3770900329 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1100065150 msgr2=0x7f1100067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1100065150 0x7f1100067600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f110c034000 tx=0x7f110c032000 comp rx=0 tx=0).stop 2024-08-17T02:26:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 -- 172.21.15.45:0/3770900329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11200ade90 msgr2=0x7f1120157e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11200ade90 0x7f1120157e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f111400c4e0 tx=0x7f1114007d80 comp rx=0 tx=0).stop 2024-08-17T02:26:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 -- 172.21.15.45:0/3770900329 shutdown_connections 2024-08-17T02:26:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1100065150 0x7f1100067600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f11201569d0 0x7f112014c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f11200ae620 0x7f112014ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 --2- 172.21.15.45:0/3770900329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11200ade90 0x7f1120157e40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 -- 172.21.15.45:0/3770900329 >> 172.21.15.45:0/3770900329 conn(0x7f1120096a70 msgr2=0x7f11200b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 -- 172.21.15.45:0/3770900329 shutdown_connections 2024-08-17T02:26:21.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.072+0000 7f1126200640 1 -- 172.21.15.45:0/3770900329 wait complete. 2024-08-17T02:26:21.087 INFO:teuthology.orchestra.run.smithi045.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:04.691522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:05.604365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000631254.meta","create_time":"2024-08-17T02:26:17.444576+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000631254"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000631254.data","create_time":"2024-08-17T02:26:18.306012+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000631254"}}}] 2024-08-17T02:26:21.088 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000631254 --format=json 2024-08-17T02:26:21.092 INFO:tasks.ceph.mds.a.smithi045.stderr:2024-08-17T02:26:21.091+0000 7f73b8c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:26:21.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.240+0000 7fa4e2e00640 1 Processor -- start 2024-08-17T02:26:21.241 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.240+0000 7fa4e2e00640 1 -- start start 2024-08-17T02:26:21.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.241+0000 7fa4e2e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa4dc0ca830 0x7fa4dc0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.241+0000 7fa4e2e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4dc0d0770 0x7fa4dc0cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.241+0000 7fa4e2e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4dc0cef60 con 0x7fa4dc158ed0 2024-08-17T02:26:21.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.241+0000 7fa4e2e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc0cf200 con 0x7fa4dc0d0770 2024-08-17T02:26:21.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.241+0000 7fa4e2e00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4dc0cf4c0 con 0x7fa4dc0ca830 2024-08-17T02:26:21.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.242+0000 7fa4e2400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4dc0d0770 0x7fa4dc0cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.242+0000 7fa4e2400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa4dc0d0770 0x7fa4dc0cdbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41302/0 (socket says 172.21.15.45:41302) 2024-08-17T02:26:21.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.242+0000 7fa4e2400640 1 -- 172.21.15.45:0/893550387 learned_addr learned my addr 172.21.15.45:0/893550387 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:21.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.242+0000 7fa4e1a00640 1 --1- 172.21.15.45:0/893550387 >> v1:172.21.15.45:6789/0 conn(0x7fa4dc158ed0 0x7fa4dc0ca120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:43916/0 (socket says 172.21.15.45:43916) 2024-08-17T02:26:21.243 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.242+0000 7fa4e1000640 1 --2- 172.21.15.45:0/893550387 >> v2:172.21.15.169:3300/0 conn(0x7fa4dc0ca830 0x7fa4dc0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.242+0000 7fa4e2400640 1 -- 172.21.15.45:0/893550387 >> v2:172.21.15.169:3300/0 conn(0x7fa4dc0ca830 msgr2=0x7fa4dc0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.242+0000 7fa4e2400640 1 --2- 172.21.15.45:0/893550387 >> v2:172.21.15.169:3300/0 conn(0x7fa4dc0ca830 0x7fa4dc0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.242+0000 7fa4e2400640 1 -- 172.21.15.45:0/893550387 >> v1:172.21.15.45:6789/0 conn(0x7fa4dc158ed0 legacy=0x7fa4dc0ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.244 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.242+0000 7fa4e2400640 1 -- 172.21.15.45:0/893550387 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4dc0cf7a0 con 0x7fa4dc0d0770 2024-08-17T02:26:21.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.243+0000 7fa4e2400640 1 --2- 172.21.15.45:0/893550387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4dc0d0770 0x7fa4dc0cdbf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc089a60 tx=0x7fa4d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc7be316612be3f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.243+0000 7fa4dbe00640 1 -- 172.21.15.45:0/893550387 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4032400 con 0x7fa4dc0d0770 2024-08-17T02:26:21.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.243+0000 7fa4dbe00640 1 -- 172.21.15.45:0/893550387 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d402e050 con 0x7fa4dc0d0770 2024-08-17T02:26:21.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.243+0000 7fa4dbe00640 1 -- 172.21.15.45:0/893550387 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40327f0 con 0x7fa4dc0d0770 2024-08-17T02:26:21.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.244+0000 7fa4e2e00640 1 -- 172.21.15.45:0/893550387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4dc0d0770 msgr2=0x7fa4dc0cdbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.244+0000 7fa4e2e00640 1 --2- 172.21.15.45:0/893550387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4dc0d0770 0x7fa4dc0cdbf0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc089a60 tx=0x7fa4d4009840 comp rx=0 tx=0).stop 2024-08-17T02:26:21.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.244+0000 7fa4e2e00640 1 -- 172.21.15.45:0/893550387 shutdown_connections 2024-08-17T02:26:21.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.244+0000 7fa4e2e00640 1 --2- 172.21.15.45:0/893550387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4dc0d0770 0x7fa4dc0cdbf0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.244+0000 7fa4e2e00640 1 --2- 172.21.15.45:0/893550387 >> v2:172.21.15.169:3300/0 conn(0x7fa4dc0ca830 0x7fa4dc0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.244+0000 7fa4e2e00640 1 -- 172.21.15.45:0/893550387 >> 172.21.15.45:0/893550387 conn(0x7fa4dc06eb90 msgr2=0x7fa4dc0cfb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.244+0000 7fa4e2e00640 1 -- 172.21.15.45:0/893550387 shutdown_connections 2024-08-17T02:26:21.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.244+0000 7fa4e2e00640 1 -- 172.21.15.45:0/893550387 wait complete. 2024-08-17T02:26:21.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.245+0000 7fa4e2e00640 1 Processor -- start 2024-08-17T02:26:21.246 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.246+0000 7fa4e2e00640 1 -- start start 2024-08-17T02:26:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.246+0000 7fa4e2e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4dc0ca830 0x7fa4dc1685f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.246+0000 7fa4e2e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4dc0d0770 0x7fa4dc0b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.246+0000 7fa4e2e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4dc158ed0 0x7fa4dc1562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e2e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0c5990 con 0x7fa4dc0d0770 2024-08-17T02:26:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e2e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0b4560 con 0x7fa4dc158ed0 2024-08-17T02:26:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e2e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4dc0c5060 con 0x7fa4dc0ca830 2024-08-17T02:26:21.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e1000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4dc0d0770 0x7fa4dc0b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e1000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4dc0d0770 0x7fa4dc0b3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41306/0 (socket says 172.21.15.45:41306) 2024-08-17T02:26:21.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e1000640 1 -- 172.21.15.45:0/1573143010 learned_addr learned my addr 172.21.15.45:0/1573143010 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:21.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e1a00640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4dc0ca830 0x7fa4dc1685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e2400640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4dc158ed0 0x7fa4dc1562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e1000640 1 -- 172.21.15.45:0/1573143010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4dc0ca830 msgr2=0x7fa4dc1685f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e1000640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4dc0ca830 0x7fa4dc1685f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e1000640 1 -- 172.21.15.45:0/1573143010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4dc158ed0 msgr2=0x7fa4dc1562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e1000640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4dc158ed0 0x7fa4dc1562f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e1000640 1 -- 172.21.15.45:0/1573143010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d4009ae0 con 0x7fa4dc0d0770 2024-08-17T02:26:21.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.247+0000 7fa4e1000640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4dc0d0770 0x7fa4dc0b3b10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009fd0 tx=0x7fa4c80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.248+0000 7fa4d8c00640 1 -- 172.21.15.45:0/1573143010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800c940 con 0x7fa4dc0d0770 2024-08-17T02:26:21.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.248+0000 7fa4d8c00640 1 -- 172.21.15.45:0/1573143010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c800caa0 con 0x7fa4dc0d0770 2024-08-17T02:26:21.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.248+0000 7fa4e2e00640 1 -- 172.21.15.45:0/1573143010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc0c5340 con 0x7fa4dc0d0770 2024-08-17T02:26:21.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.248+0000 7fa4d8c00640 1 -- 172.21.15.45:0/1573143010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c800ce20 con 0x7fa4dc0d0770 2024-08-17T02:26:21.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.248+0000 7fa4e2e00640 1 -- 172.21.15.45:0/1573143010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4dc0b37b0 con 0x7fa4dc0d0770 2024-08-17T02:26:21.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.249+0000 7fa4e2e00640 1 -- 172.21.15.45:0/1573143010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4dc0c5b40 con 0x7fa4dc0d0770 2024-08-17T02:26:21.251 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.250+0000 7fa4d8c00640 1 -- 172.21.15.45:0/1573143010 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa4c8013680 con 0x7fa4dc0d0770 2024-08-17T02:26:21.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.251+0000 7fa4d8c00640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa4bc065150 0x7fa4bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.251+0000 7fa4d8c00640 1 -- 172.21.15.45:0/1573143010 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fa4c8082b20 con 0x7fa4dc0d0770 2024-08-17T02:26:21.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.251+0000 7fa4e1a00640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa4bc065150 0x7fa4bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.252 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.252+0000 7fa4e1a00640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa4bc065150 0x7fa4bc067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0007790 tx=0x7fa4d0007ce0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.255+0000 7fa4d8c00640 1 -- 172.21.15.45:0/1573143010 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa4dc0c5b40 con 0x7fa4dc0d0770 2024-08-17T02:26:21.492 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.491+0000 7fa4e2e00640 1 -- 172.21.15.45:0/1573143010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000631254", "format": "json"} v 0) v1 -- 0x7fa4dc071050 con 0x7fa4dc0d0770 2024-08-17T02:26:21.493 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.492+0000 7fa4d8c00640 1 -- 172.21.15.45:0/1573143010 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000631254", "format": "json"}]=0 v20) v1 ==== 110+0+1841 (secure 0 0 0) 0x7fa4c80507c0 con 0x7fa4dc0d0770 2024-08-17T02:26:21.493 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:26:21.493 INFO:teuthology.orchestra.run.smithi045.stdout:{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:19.270401+0000","modified":"2024-08-17T02:26:20.776150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6837/569206503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":569206503},{"type":"v1","addr":"172.21.15.45:6837","nonce":569206503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000631254","balancer":"","standby_count_wanted":1},"id":3} 2024-08-17T02:26:21.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 -- 172.21.15.45:0/1573143010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa4bc065150 msgr2=0x7fa4bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa4bc065150 0x7fa4bc067600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0007790 tx=0x7fa4d0007ce0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 -- 172.21.15.45:0/1573143010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4dc0d0770 msgr2=0x7fa4dc0b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.496 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4dc0d0770 0x7fa4dc0b3b10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009fd0 tx=0x7fa4c80090f0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 -- 172.21.15.45:0/1573143010 shutdown_connections 2024-08-17T02:26:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa4dc158ed0 0x7fa4dc1562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa4dc0d0770 0x7fa4dc0b3b10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa4bc065150 0x7fa4bc067600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 --2- 172.21.15.45:0/1573143010 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa4dc0ca830 0x7fa4dc1685f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 -- 172.21.15.45:0/1573143010 >> 172.21.15.45:0/1573143010 conn(0x7fa4dc06eb90 msgr2=0x7fa4dc0cd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 -- 172.21.15.45:0/1573143010 shutdown_connections 2024-08-17T02:26:21.498 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.494+0000 7fa4e2e00640 1 -- 172.21.15.45:0/1573143010 wait complete. 2024-08-17T02:26:21.510 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000631254 --yes-i-really-mean-it 2024-08-17T02:26:21.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.664+0000 7f1b2d800640 1 Processor -- start 2024-08-17T02:26:21.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.664+0000 7f1b2d800640 1 -- start start 2024-08-17T02:26:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.665+0000 7f1b2d800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1b28156c50 0x7f1b280c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.665+0000 7f1b2d800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1b280c8bd0 0x7f1b280c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.666+0000 7f1b2d800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b280ab130 con 0x7f1b280adcf0 2024-08-17T02:26:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.666+0000 7f1b2d800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b280c9530 con 0x7f1b280c8bd0 2024-08-17T02:26:21.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.666+0000 7f1b2d800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b280ae5a0 con 0x7f1b28156c50 2024-08-17T02:26:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.666+0000 7f1b27400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1b280c8bd0 0x7f1b280c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.666+0000 7f1b27400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1b280c8bd0 0x7f1b280c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41308/0 (socket says 172.21.15.45:41308) 2024-08-17T02:26:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.666+0000 7f1b27400640 1 -- 172.21.15.45:0/2334375985 learned_addr learned my addr 172.21.15.45:0/2334375985 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.666+0000 7f1b26a00640 1 --2- 172.21.15.45:0/2334375985 >> v2:172.21.15.169:3300/0 conn(0x7f1b28156c50 0x7f1b280c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.666+0000 7f1b27400640 1 -- 172.21.15.45:0/2334375985 >> v2:172.21.15.169:3300/0 conn(0x7f1b28156c50 msgr2=0x7f1b280c7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.666+0000 7f1b27400640 1 --2- 172.21.15.45:0/2334375985 >> v2:172.21.15.169:3300/0 conn(0x7f1b28156c50 0x7f1b280c7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.666+0000 7f1b27400640 1 -- 172.21.15.45:0/2334375985 >> v1:172.21.15.169:6789/0 conn(0x7f1b280adcf0 legacy=0x7f1b280ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:26:21.669 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.666+0000 7f1b27400640 1 -- 172.21.15.45:0/2334375985 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b280ae2c0 con 0x7f1b280c8bd0 2024-08-17T02:26:21.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.667+0000 7f1b27400640 1 --2- 172.21.15.45:0/2334375985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b280c8bd0 0x7f1b280c8ff0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1b2806efd0 tx=0x7f1b20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0e4d28f7a21e8f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.667+0000 7f1b25600640 1 -- 172.21.15.45:0/2334375985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20031400 con 0x7f1b280c8bd0 2024-08-17T02:26:21.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.668+0000 7f1b25600640 1 -- 172.21.15.45:0/2334375985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b2002d050 con 0x7f1b280c8bd0 2024-08-17T02:26:21.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.668+0000 7f1b25600640 1 -- 172.21.15.45:0/2334375985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b200317d0 con 0x7f1b280c8bd0 2024-08-17T02:26:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.668+0000 7f1b2d800640 1 -- 172.21.15.45:0/2334375985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b280c8bd0 msgr2=0x7f1b280c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.668+0000 7f1b2d800640 1 --2- 172.21.15.45:0/2334375985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b280c8bd0 0x7f1b280c8ff0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1b2806efd0 tx=0x7f1b20009840 comp rx=0 tx=0).stop 2024-08-17T02:26:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.668+0000 7f1b2d800640 1 -- 172.21.15.45:0/2334375985 shutdown_connections 2024-08-17T02:26:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.668+0000 7f1b2d800640 1 --2- 172.21.15.45:0/2334375985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b280c8bd0 0x7f1b280c8ff0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.668+0000 7f1b2d800640 1 --2- 172.21.15.45:0/2334375985 >> v2:172.21.15.169:3300/0 conn(0x7f1b28156c50 0x7f1b280c7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.668+0000 7f1b2d800640 1 -- 172.21.15.45:0/2334375985 >> 172.21.15.45:0/2334375985 conn(0x7f1b28067750 msgr2=0x7f1b280c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:26:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.668+0000 7f1b2d800640 1 -- 172.21.15.45:0/2334375985 shutdown_connections 2024-08-17T02:26:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.668+0000 7f1b2d800640 1 -- 172.21.15.45:0/2334375985 wait complete. 2024-08-17T02:26:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.670+0000 7f1b2d800640 1 Processor -- start 2024-08-17T02:26:21.673 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.670+0000 7f1b2d800640 1 -- start start 2024-08-17T02:26:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b2d800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b280adcf0 0x7f1b2814f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b2d800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b280c8bd0 0x7f1b28157020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b2d800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b28156c50 0x7f1b28168d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b2d800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2814f6d0 con 0x7f1b280c8bd0 2024-08-17T02:26:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b2d800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28157aa0 con 0x7f1b280adcf0 2024-08-17T02:26:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b2d800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b28157d80 con 0x7f1b28156c50 2024-08-17T02:26:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b26000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b280c8bd0 0x7f1b28157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b26000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b280c8bd0 0x7f1b28157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41318/0 (socket says 172.21.15.45:41318) 2024-08-17T02:26:21.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b26000640 1 -- 172.21.15.45:0/3777557765 learned_addr learned my addr 172.21.15.45:0/3777557765 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b26a00640 1 --2- 172.21.15.45:0/3777557765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b280adcf0 0x7f1b2814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b27400640 1 --2- 172.21.15.45:0/3777557765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b28156c50 0x7f1b28168d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b26000640 1 -- 172.21.15.45:0/3777557765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b28156c50 msgr2=0x7f1b28168d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b26000640 1 --2- 172.21.15.45:0/3777557765 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b28156c50 0x7f1b28168d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b26000640 1 -- 172.21.15.45:0/3777557765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b280adcf0 msgr2=0x7f1b2814f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:26:21.679 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b26000640 1 --2- 172.21.15.45:0/3777557765 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b280adcf0 0x7f1b2814f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.671+0000 7f1b26000640 1 -- 172.21.15.45:0/3777557765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b20009ae0 con 0x7f1b280c8bd0 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.672+0000 7f1b26000640 1 --2- 172.21.15.45:0/3777557765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b280c8bd0 0x7f1b28157020 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1b1400c5e0 tx=0x7f1b14007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.672+0000 7f1b1e000640 1 -- 172.21.15.45:0/3777557765 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14012630 con 0x7f1b280c8bd0 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.672+0000 7f1b1e000640 1 -- 172.21.15.45:0/3777557765 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b140127b0 con 0x7f1b280c8bd0 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.672+0000 7f1b1e000640 1 -- 172.21.15.45:0/3777557765 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b14012bb0 con 0x7f1b280c8bd0 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.672+0000 7f1b2d800640 1 -- 172.21.15.45:0/3777557765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2806c830 con 0x7f1b280c8bd0 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.672+0000 7f1b2d800640 1 -- 172.21.15.45:0/3777557765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b2806cdf0 con 0x7f1b280c8bd0 2024-08-17T02:26:21.680 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.673+0000 7f1b2d800640 1 -- 172.21.15.45:0/3777557765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2806d010 con 0x7f1b280c8bd0 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.674+0000 7f1b1e000640 1 -- 172.21.15.45:0/3777557765 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1b1401a3b0 con 0x7f1b280c8bd0 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.675+0000 7f1b1e000640 1 --2- 172.21.15.45:0/3777557765 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1b08065150 0x7f1b08067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.675+0000 7f1b1e000640 1 -- 172.21.15.45:0/3777557765 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1b140822f0 con 0x7f1b280c8bd0 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.675+0000 7f1b26a00640 1 --2- 172.21.15.45:0/3777557765 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1b08065150 0x7f1b08067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.676+0000 7f1b26a00640 1 --2- 172.21.15.45:0/3777557765 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1b08065150 0x7f1b08067600 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1b1800bd40 tx=0x7f1b18008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:26:21.681 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.679+0000 7f1b1e000640 1 -- 172.21.15.45:0/3777557765 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1b14050040 con 0x7f1b280c8bd0 2024-08-17T02:26:21.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:26:21.885+0000 7f1b2d800640 1 -- 172.21.15.45:0/3777557765 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000631254", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b28071050 con 0x7f1b08065150 2024-08-17T02:26:44.176 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:26:44.182 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:14.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:14.278 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:44.394 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:27:44.400 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:14.500 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:14.506 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:21.580 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-08-17T02:28:21.581 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-08-17T02:28:21.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:21.673 DEBUG:teuthology.orchestra.run.smithi169:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-08-17T02:28:21.766 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-08-17T02:28:21.766 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-17T02:28:21.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:21.767 DEBUG:teuthology.orchestra.run.smithi045:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-17T02:28:21.835 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:28:21.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:21.835 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-17T02:28:21.874 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-08-17T02:28:21.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-08-17T02:28:21.874 DEBUG:teuthology.orchestra.run.smithi169:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-08-17T02:28:21.941 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:28:21.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:21.941 DEBUG:teuthology.orchestra.run.smithi169:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-08-17T02:28:21.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:22.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.130+0000 7fc636a00640 1 Processor -- start 2024-08-17T02:28:22.131 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.130+0000 7fc636a00640 1 -- start start 2024-08-17T02:28:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.131+0000 7fc636a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6301401b0 0x7fc6300caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.131+0000 7fc636a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc6300b1440 0x7fc6300c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.131+0000 7fc636a00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6300caa80 con 0x7fc630140580 2024-08-17T02:28:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.131+0000 7fc636a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300cb450 con 0x7fc6300b1440 2024-08-17T02:28:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.131+0000 7fc636a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300c9e70 con 0x7fc6301401b0 2024-08-17T02:28:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.132+0000 7fc62fe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6301401b0 0x7fc6300caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.132+0000 7fc62fe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6301401b0 0x7fc6300caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:34568/0 (socket says 172.21.15.45:34568) 2024-08-17T02:28:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.132+0000 7fc62fe00640 1 -- 172.21.15.45:0/1343054533 learned_addr learned my addr 172.21.15.45:0/1343054533 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.132+0000 7fc634a00640 1 --2- 172.21.15.45:0/1343054533 >> v2:172.21.15.169:3300/0 conn(0x7fc6300b1440 0x7fc6300c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.132+0000 7fc62fe00640 1 -- 172.21.15.45:0/1343054533 >> v2:172.21.15.169:3300/0 conn(0x7fc6300b1440 msgr2=0x7fc6300c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.132+0000 7fc62fe00640 1 --2- 172.21.15.45:0/1343054533 >> v2:172.21.15.169:3300/0 conn(0x7fc6300b1440 0x7fc6300c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.132+0000 7fc62ea00640 1 -- 172.21.15.45:0/1343054533 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 528561709 0 0) 0x7fc6300caa80 con 0x7fc630140580 2024-08-17T02:28:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.132+0000 7fc62fe00640 1 -- 172.21.15.45:0/1343054533 >> v1:172.21.15.169:6789/0 conn(0x7fc630140580 legacy=0x7fc6300b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.132+0000 7fc62fe00640 1 -- 172.21.15.45:0/1343054533 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300ca150 con 0x7fc6301401b0 2024-08-17T02:28:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.133+0000 7fc62fe00640 1 --2- 172.21.15.45:0/1343054533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6301401b0 0x7fc6300caf10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc620009910 tx=0x7fc6200091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=157c0f7831c77a06 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.134+0000 7fc62ea00640 1 -- 172.21.15.45:0/1343054533 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62002adb0 con 0x7fc6301401b0 2024-08-17T02:28:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.134+0000 7fc62ea00640 1 -- 172.21.15.45:0/1343054533 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620032440 con 0x7fc6301401b0 2024-08-17T02:28:22.135 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.134+0000 7fc62ea00640 1 -- 172.21.15.45:0/1343054533 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6200327e0 con 0x7fc6301401b0 2024-08-17T02:28:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.134+0000 7fc636a00640 1 -- 172.21.15.45:0/1343054533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6301401b0 msgr2=0x7fc6300caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.134+0000 7fc636a00640 1 --2- 172.21.15.45:0/1343054533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6301401b0 0x7fc6300caf10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc620009910 tx=0x7fc6200091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.135+0000 7fc636a00640 1 -- 172.21.15.45:0/1343054533 shutdown_connections 2024-08-17T02:28:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.135+0000 7fc636a00640 1 --2- 172.21.15.45:0/1343054533 >> v2:172.21.15.169:3300/0 conn(0x7fc6300b1440 0x7fc6300c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.135+0000 7fc636a00640 1 --2- 172.21.15.45:0/1343054533 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc6301401b0 0x7fc6300caf10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.135+0000 7fc636a00640 1 -- 172.21.15.45:0/1343054533 >> 172.21.15.45:0/1343054533 conn(0x7fc6300cb9b0 msgr2=0x7fc6300cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.135+0000 7fc636a00640 1 -- 172.21.15.45:0/1343054533 shutdown_connections 2024-08-17T02:28:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.135+0000 7fc636a00640 1 -- 172.21.15.45:0/1343054533 wait complete. 2024-08-17T02:28:22.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.136+0000 7fc636a00640 1 Processor -- start 2024-08-17T02:28:22.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.136+0000 7fc636a00640 1 -- start start 2024-08-17T02:28:22.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.137+0000 7fc636a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6300b1440 0x7fc6300a8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.137+0000 7fc636a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6301401b0 0x7fc6300ab280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.137+0000 7fc636a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc630140580 0x7fc630156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.137+0000 7fc636a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300a6240 con 0x7fc6300b1440 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.137+0000 7fc636a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300a5f10 con 0x7fc6301401b0 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.137+0000 7fc636a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300abaf0 con 0x7fc630140580 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.137+0000 7fc62fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6300b1440 0x7fc6300a8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.137+0000 7fc62fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6300b1440 0x7fc6300a8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53680/0 (socket says 172.21.15.45:53680) 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.137+0000 7fc62fe00640 1 -- 172.21.15.45:0/2522792045 learned_addr learned my addr 172.21.15.45:0/2522792045 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.137+0000 7fc634a00640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc630140580 0x7fc630156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.137+0000 7fc62f400640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6301401b0 0x7fc6300ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.138+0000 7fc62fe00640 1 -- 172.21.15.45:0/2522792045 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc630140580 msgr2=0x7fc630156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.139 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.138+0000 7fc62fe00640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc630140580 0x7fc630156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.138+0000 7fc62fe00640 1 -- 172.21.15.45:0/2522792045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6301401b0 msgr2=0x7fc6300ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.138+0000 7fc62fe00640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6301401b0 0x7fc6300ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.138+0000 7fc62fe00640 1 -- 172.21.15.45:0/2522792045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc620009450 con 0x7fc6300b1440 2024-08-17T02:28:22.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.138+0000 7fc62fe00640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6300b1440 0x7fc6300a8f90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc620009970 tx=0x7fc620032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.138+0000 7fc627400640 1 -- 172.21.15.45:0/2522792045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620000c40 con 0x7fc6300b1440 2024-08-17T02:28:22.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.138+0000 7fc627400640 1 -- 172.21.15.45:0/2522792045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620031a60 con 0x7fc6300b1440 2024-08-17T02:28:22.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.138+0000 7fc627400640 1 -- 172.21.15.45:0/2522792045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620031e20 con 0x7fc6300b1440 2024-08-17T02:28:22.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.138+0000 7fc636a00640 1 -- 172.21.15.45:0/2522792045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6300abdd0 con 0x7fc6300b1440 2024-08-17T02:28:22.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.139+0000 7fc636a00640 1 -- 172.21.15.45:0/2522792045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6300ab7c0 con 0x7fc6300b1440 2024-08-17T02:28:22.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.139+0000 7fc636a00640 1 -- 172.21.15.45:0/2522792045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc630064db0 con 0x7fc6300b1440 2024-08-17T02:28:22.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.140+0000 7fc627400640 1 -- 172.21.15.45:0/2522792045 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc62003c400 con 0x7fc6300b1440 2024-08-17T02:28:22.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.141+0000 7fc627400640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc610065150 0x7fc610067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.141+0000 7fc627400640 1 -- 172.21.15.45:0/2522792045 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fc6200a2900 con 0x7fc6300b1440 2024-08-17T02:28:22.142 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.142+0000 7fc62f400640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc610065150 0x7fc610067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.142+0000 7fc62f400640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc610065150 0x7fc610067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc63013ec50 tx=0x7fc61c007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.146+0000 7fc627400640 1 -- 172.21.15.45:0/2522792045 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc620070650 con 0x7fc6300b1440 2024-08-17T02:28:22.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.370+0000 7fc636a00640 1 -- 172.21.15.45:0/2522792045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6300b18f0 con 0x7fc6300b1440 2024-08-17T02:28:22.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.370+0000 7fc627400640 1 -- 172.21.15.45:0/2522792045 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5684 (secure 0 0 0) 0x7fc620037090 con 0x7fc6300b1440 2024-08-17T02:28:22.372 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:22.372 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2570743735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2570743735},{"type":"v1","addr":"172.21.15.169:6834","nonce":2570743735}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1704272549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1704272549},{"type":"v1","addr":"172.21.15.169:6835","nonce":1704272549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:06.620196+0000","modified":"2024-08-17T02:26:10.215482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6836/618002034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":618002034},{"type":"v1","addr":"172.21.15.45:6836","nonce":618002034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:19.270401+0000","modified":"2024-08-17T02:26:20.776150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6837/569206503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":569206503},{"type":"v1","addr":"172.21.15.45:6837","nonce":569206503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000631254","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:22.372 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 20 2024-08-17T02:28:22.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.372+0000 7fc636a00640 1 -- 172.21.15.45:0/2522792045 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc610065150 msgr2=0x7fc610067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.372+0000 7fc636a00640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc610065150 0x7fc610067600 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc63013ec50 tx=0x7fc61c007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.372+0000 7fc636a00640 1 -- 172.21.15.45:0/2522792045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6300b1440 msgr2=0x7fc6300a8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.372+0000 7fc636a00640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6300b1440 0x7fc6300a8f90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc620009970 tx=0x7fc620032000 comp rx=0 tx=0).stop 2024-08-17T02:28:22.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.372+0000 7fc636a00640 1 -- 172.21.15.45:0/2522792045 shutdown_connections 2024-08-17T02:28:22.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.372+0000 7fc636a00640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc610065150 0x7fc610067600 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.372+0000 7fc636a00640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc630140580 0x7fc630156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.372+0000 7fc636a00640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc6301401b0 0x7fc6300ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.372+0000 7fc636a00640 1 --2- 172.21.15.45:0/2522792045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6300b1440 0x7fc6300a8f90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.373+0000 7fc636a00640 1 -- 172.21.15.45:0/2522792045 >> 172.21.15.45:0/2522792045 conn(0x7fc6300cb9b0 msgr2=0x7fc63006dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.373+0000 7fc636a00640 1 -- 172.21.15.45:0/2522792045 shutdown_connections 2024-08-17T02:28:22.375 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.373+0000 7fc636a00640 1 -- 172.21.15.45:0/2522792045 wait complete. 2024-08-17T02:28:22.390 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:22.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.541+0000 7f0b55800640 1 Processor -- start 2024-08-17T02:28:22.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.541+0000 7f0b55800640 1 -- start start 2024-08-17T02:28:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.542+0000 7f0b55800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b5006df00 0x7f0b500adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.542+0000 7f0b55800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0b50155df0 0x7f0b500ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.542+0000 7f0b55800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b50156670 con 0x7f0b50155a20 2024-08-17T02:28:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.542+0000 7f0b55800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b500b0350 con 0x7f0b5006df00 2024-08-17T02:28:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.542+0000 7f0b55800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5006e5e0 con 0x7f0b50155df0 2024-08-17T02:28:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.543+0000 7f0b47e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b5006df00 0x7f0b500adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.543+0000 7f0b47e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b5006df00 0x7f0b500adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53690/0 (socket says 172.21.15.45:53690) 2024-08-17T02:28:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.543+0000 7f0b47e00640 1 -- 172.21.15.45:0/3707097646 learned_addr learned my addr 172.21.15.45:0/3707097646 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:22.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.543+0000 7f0b4f400640 1 --2- 172.21.15.45:0/3707097646 >> v2:172.21.15.169:3300/0 conn(0x7f0b50155df0 0x7f0b500ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.543+0000 7f0b47e00640 1 -- 172.21.15.45:0/3707097646 >> v2:172.21.15.169:3300/0 conn(0x7f0b50155df0 msgr2=0x7f0b500ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:22.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.543+0000 7f0b47e00640 1 --2- 172.21.15.45:0/3707097646 >> v2:172.21.15.169:3300/0 conn(0x7f0b50155df0 0x7f0b500ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.543+0000 7f0b47e00640 1 -- 172.21.15.45:0/3707097646 >> v1:172.21.15.169:6789/0 conn(0x7f0b50155a20 legacy=0x7f0b5006d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.543+0000 7f0b47e00640 1 -- 172.21.15.45:0/3707097646 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5006e8c0 con 0x7f0b5006df00 2024-08-17T02:28:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.544+0000 7f0b47e00640 1 --2- 172.21.15.45:0/3707097646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5006df00 0x7f0b500adf10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0b500b0710 tx=0x7f0b380091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd44900f6b8cf606 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.544+0000 7f0b4e000640 1 -- 172.21.15.45:0/3707097646 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3802add0 con 0x7f0b5006df00 2024-08-17T02:28:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.545+0000 7f0b4e000640 1 -- 172.21.15.45:0/3707097646 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b38032440 con 0x7f0b5006df00 2024-08-17T02:28:22.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.545+0000 7f0b4e000640 1 -- 172.21.15.45:0/3707097646 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38032820 con 0x7f0b5006df00 2024-08-17T02:28:22.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.545+0000 7f0b55800640 1 -- 172.21.15.45:0/3707097646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5006df00 msgr2=0x7f0b500adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.545+0000 7f0b55800640 1 --2- 172.21.15.45:0/3707097646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5006df00 0x7f0b500adf10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0b500b0710 tx=0x7f0b380091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.545+0000 7f0b55800640 1 -- 172.21.15.45:0/3707097646 shutdown_connections 2024-08-17T02:28:22.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.545+0000 7f0b55800640 1 --2- 172.21.15.45:0/3707097646 >> v2:172.21.15.169:3300/0 conn(0x7f0b50155df0 0x7f0b500ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.545+0000 7f0b55800640 1 --2- 172.21.15.45:0/3707097646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5006df00 0x7f0b500adf10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.545+0000 7f0b55800640 1 -- 172.21.15.45:0/3707097646 >> 172.21.15.45:0/3707097646 conn(0x7f0b500cb9b0 msgr2=0x7f0b500cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.545+0000 7f0b55800640 1 -- 172.21.15.45:0/3707097646 shutdown_connections 2024-08-17T02:28:22.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.545+0000 7f0b55800640 1 -- 172.21.15.45:0/3707097646 wait complete. 2024-08-17T02:28:22.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.547+0000 7f0b55800640 1 Processor -- start 2024-08-17T02:28:22.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.547+0000 7f0b55800640 1 -- start start 2024-08-17T02:28:22.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.547+0000 7f0b55800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5006df00 0x7f0b50168fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b55800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b50155a20 0x7f0b50144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b55800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b50155df0 0x7f0b50144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b55800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50144da0 con 0x7f0b5006df00 2024-08-17T02:28:22.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b55800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5016c360 con 0x7f0b50155a20 2024-08-17T02:28:22.556 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b55800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50144fe0 con 0x7f0b50155df0 2024-08-17T02:28:22.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b4ea00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5006df00 0x7f0b50168fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b4ea00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5006df00 0x7f0b50168fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53692/0 (socket says 172.21.15.45:53692) 2024-08-17T02:28:22.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b4ea00640 1 -- 172.21.15.45:0/1986512526 learned_addr learned my addr 172.21.15.45:0/1986512526 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:22.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b47e00640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b50155a20 0x7f0b50144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.557 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b4f400640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b50155df0 0x7f0b50144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b4ea00640 1 -- 172.21.15.45:0/1986512526 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b50155df0 msgr2=0x7f0b50144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b4ea00640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b50155df0 0x7f0b50144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b4ea00640 1 -- 172.21.15.45:0/1986512526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b50155a20 msgr2=0x7f0b50144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b4ea00640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b50155a20 0x7f0b50144320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.548+0000 7f0b4ea00640 1 -- 172.21.15.45:0/1986512526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b38009450 con 0x7f0b5006df00 2024-08-17T02:28:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.549+0000 7f0b4ea00640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5006df00 0x7f0b50168fb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c560 tx=0x7f0b40007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.549+0000 7f0b46000640 1 -- 172.21.15.45:0/1986512526 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40011590 con 0x7f0b5006df00 2024-08-17T02:28:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.549+0000 7f0b46000640 1 -- 172.21.15.45:0/1986512526 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b40011710 con 0x7f0b5006df00 2024-08-17T02:28:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.549+0000 7f0b55800640 1 -- 172.21.15.45:0/1986512526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b50146e60 con 0x7f0b5006df00 2024-08-17T02:28:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.549+0000 7f0b46000640 1 -- 172.21.15.45:0/1986512526 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b40011ad0 con 0x7f0b5006df00 2024-08-17T02:28:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.549+0000 7f0b55800640 1 -- 172.21.15.45:0/1986512526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b50147420 con 0x7f0b5006df00 2024-08-17T02:28:22.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.550+0000 7f0b55800640 1 -- 172.21.15.45:0/1986512526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b50145120 con 0x7f0b5006df00 2024-08-17T02:28:22.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.551+0000 7f0b46000640 1 -- 172.21.15.45:0/1986512526 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0b4001b3b0 con 0x7f0b5006df00 2024-08-17T02:28:22.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.552+0000 7f0b46000640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0b2c065150 0x7f0b2c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.552+0000 7f0b46000640 1 -- 172.21.15.45:0/1986512526 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f0b40081d60 con 0x7f0b5006df00 2024-08-17T02:28:22.560 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.552+0000 7f0b47e00640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0b2c065150 0x7f0b2c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.553+0000 7f0b47e00640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0b2c065150 0x7f0b2c067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b38034000 tx=0x7f0b38032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.561 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.556+0000 7f0b46000640 1 -- 172.21.15.45:0/1986512526 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f0b4004fab0 con 0x7f0b5006df00 2024-08-17T02:28:22.742 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.741+0000 7f0b55800640 1 -- 172.21.15.45:0/1986512526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b50064db0 con 0x7f0b5006df00 2024-08-17T02:28:22.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.742+0000 7f0b46000640 1 -- 172.21.15.45:0/1986512526 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18599 (secure 0 0 0) 0x7f0b40017070 con 0x7f0b5006df00 2024-08-17T02:28:22.743 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:22.744 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:26:22.268229+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:04.691522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:05.604365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000631254.meta","create_time":"2024-08-17T02:26:17.444576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000631254"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000631254.data","create_time":"2024-08-17T02:26:18.306012+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000631254"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.744+0000 7f0b55800640 1 -- 172.21.15.45:0/1986512526 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0b2c065150 msgr2=0x7f0b2c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.744+0000 7f0b55800640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0b2c065150 0x7f0b2c067600 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0b38034000 tx=0x7f0b38032000 comp rx=0 tx=0).stop 2024-08-17T02:28:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.745+0000 7f0b55800640 1 -- 172.21.15.45:0/1986512526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5006df00 msgr2=0x7f0b50168fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.745+0000 7f0b55800640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5006df00 0x7f0b50168fb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c560 tx=0x7f0b40007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.745+0000 7f0b55800640 1 -- 172.21.15.45:0/1986512526 shutdown_connections 2024-08-17T02:28:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.745+0000 7f0b55800640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0b2c065150 0x7f0b2c067600 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.746 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.745+0000 7f0b55800640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0b50155df0 0x7f0b50144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.745+0000 7f0b55800640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0b50155a20 0x7f0b50144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.745+0000 7f0b55800640 1 --2- 172.21.15.45:0/1986512526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5006df00 0x7f0b50168fb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.745+0000 7f0b55800640 1 -- 172.21.15.45:0/1986512526 >> 172.21.15.45:0/1986512526 conn(0x7f0b500cb9b0 msgr2=0x7f0b50158670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.745+0000 7f0b55800640 1 -- 172.21.15.45:0/1986512526 shutdown_connections 2024-08-17T02:28:22.747 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.745+0000 7f0b55800640 1 -- 172.21.15.45:0/1986512526 wait complete. 2024-08-17T02:28:22.762 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-17T02:26:04.691522+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-08-17T02:26:05.604365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000631254.meta', 'create_time': '2024-08-17T02:26:17.444576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000631254'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000631254.data', 'create_time': '2024-08-17T02:26:18.306012+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000631254'}}}] 2024-08-17T02:28:22.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:22.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.916+0000 7f23e5000640 1 Processor -- start 2024-08-17T02:28:22.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.916+0000 7f23e5000640 1 -- start start 2024-08-17T02:28:22.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.917+0000 7f23e5000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23e00accf0 0x7f23e00b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.917+0000 7f23e5000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e00ae540 con 0x7f23e0159610 2024-08-17T02:28:22.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.917+0000 7f23e5000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e00ad930 con 0x7f23e00afd90 2024-08-17T02:28:22.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.917+0000 7f23e5000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e00adc10 con 0x7f23e00accf0 2024-08-17T02:28:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.917+0000 7f23dde00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23e00accf0 0x7f23e00b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.917+0000 7f23dde00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f23e00accf0 0x7f23e00b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53708/0 (socket says 172.21.15.45:53708) 2024-08-17T02:28:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.917+0000 7f23dde00640 1 -- 172.21.15.45:0/3190814811 learned_addr learned my addr 172.21.15.45:0/3190814811 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.917+0000 7f23d7e00640 1 --1- 172.21.15.45:0/3190814811 >> v1:172.21.15.45:6789/0 conn(0x7f23e0159610 0x7f23e00af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53306/0 (socket says 172.21.15.45:53306) 2024-08-17T02:28:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.918+0000 7f23dde00640 1 -- 172.21.15.45:0/3190814811 >> v1:172.21.15.169:6789/0 conn(0x7f23e00afd90 legacy=0x7f23e0157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.918+0000 7f23dde00640 1 -- 172.21.15.45:0/3190814811 >> v1:172.21.15.45:6789/0 conn(0x7f23e0159610 legacy=0x7f23e00af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.918+0000 7f23dde00640 1 -- 172.21.15.45:0/3190814811 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e00adef0 con 0x7f23e00accf0 2024-08-17T02:28:22.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.918+0000 7f23dd400640 1 -- 172.21.15.45:0/3190814811 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119996798 0 0) 0x7f23e00ae540 con 0x7f23e0159610 2024-08-17T02:28:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.919+0000 7f23dde00640 1 --2- 172.21.15.45:0/3190814811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e00accf0 0x7f23e00b1670 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009910 tx=0x7f23d00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8766f5d4d3c8877 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.919+0000 7f23dd400640 1 -- 172.21.15.45:0/3190814811 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0032440 con 0x7f23e00accf0 2024-08-17T02:28:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.919+0000 7f23dd400640 1 -- 172.21.15.45:0/3190814811 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d00325a0 con 0x7f23e00accf0 2024-08-17T02:28:22.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.919+0000 7f23dd400640 1 -- 172.21.15.45:0/3190814811 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0032940 con 0x7f23e00accf0 2024-08-17T02:28:22.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.920+0000 7f23e5000640 1 -- 172.21.15.45:0/3190814811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e00accf0 msgr2=0x7f23e00b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.920+0000 7f23e5000640 1 --2- 172.21.15.45:0/3190814811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e00accf0 0x7f23e00b1670 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009910 tx=0x7f23d00091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.920+0000 7f23e5000640 1 -- 172.21.15.45:0/3190814811 shutdown_connections 2024-08-17T02:28:22.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.920+0000 7f23e5000640 1 --2- 172.21.15.45:0/3190814811 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e00accf0 0x7f23e00b1670 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.920+0000 7f23e5000640 1 -- 172.21.15.45:0/3190814811 >> 172.21.15.45:0/3190814811 conn(0x7f23e0067750 msgr2=0x7f23e00cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:22.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.920+0000 7f23e5000640 1 -- 172.21.15.45:0/3190814811 shutdown_connections 2024-08-17T02:28:22.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.920+0000 7f23e5000640 1 -- 172.21.15.45:0/3190814811 wait complete. 2024-08-17T02:28:22.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.921+0000 7f23e5000640 1 Processor -- start 2024-08-17T02:28:22.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.921+0000 7f23e5000640 1 -- start start 2024-08-17T02:28:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.922+0000 7f23e5000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23e00accf0 0x7f23e01537e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.922+0000 7f23e5000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f23e00afd90 0x7f23e00abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.924 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.922+0000 7f23e5000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e0159610 0x7f23e015a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.922+0000 7f23e5000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0153d20 con 0x7f23e0159610 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.922+0000 7f23e5000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0152740 con 0x7f23e00accf0 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.922+0000 7f23e5000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0152a20 con 0x7f23e00afd90 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23de800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e0159610 0x7f23e015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23de800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e0159610 0x7f23e015a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53722/0 (socket says 172.21.15.45:53722) 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23de800640 1 -- 172.21.15.45:0/4286934032 learned_addr learned my addr 172.21.15.45:0/4286934032 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23dde00640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23e00accf0 0x7f23e01537e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23d7e00640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f23e00afd90 0x7f23e00abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23de800640 1 -- 172.21.15.45:0/4286934032 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f23e00afd90 msgr2=0x7f23e00abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23de800640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f23e00afd90 0x7f23e00abab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23de800640 1 -- 172.21.15.45:0/4286934032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23e00accf0 msgr2=0x7f23e01537e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:22.925 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23de800640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23e00accf0 0x7f23e01537e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23de800640 1 -- 172.21.15.45:0/4286934032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d0009450 con 0x7f23e0159610 2024-08-17T02:28:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23dde00640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23e00accf0 0x7f23e01537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23d7e00640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f23e00afd90 0x7f23e00abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.923+0000 7f23de800640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e0159610 0x7f23e015a910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f23d800c860 tx=0x7f23d8001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.924+0000 7f23d5600640 1 -- 172.21.15.45:0/4286934032 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d800ce50 con 0x7f23e0159610 2024-08-17T02:28:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.924+0000 7f23d5600640 1 -- 172.21.15.45:0/4286934032 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d800a850 con 0x7f23e0159610 2024-08-17T02:28:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.924+0000 7f23d5600640 1 -- 172.21.15.45:0/4286934032 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d800ac10 con 0x7f23e0159610 2024-08-17T02:28:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.924+0000 7f23e5000640 1 -- 172.21.15.45:0/4286934032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e0152d00 con 0x7f23e0159610 2024-08-17T02:28:22.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.924+0000 7f23e5000640 1 -- 172.21.15.45:0/4286934032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e0153340 con 0x7f23e0159610 2024-08-17T02:28:22.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.925+0000 7f23e5000640 1 -- 172.21.15.45:0/4286934032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e0153500 con 0x7f23e0159610 2024-08-17T02:28:22.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.926+0000 7f23d5600640 1 -- 172.21.15.45:0/4286934032 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f23d8012420 con 0x7f23e0159610 2024-08-17T02:28:22.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.926+0000 7f23d5600640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23bc065150 0x7f23bc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:22.927 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.927+0000 7f23d5600640 1 -- 172.21.15.45:0/4286934032 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f23d8082ae0 con 0x7f23e0159610 2024-08-17T02:28:22.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.927+0000 7f23dde00640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23bc065150 0x7f23bc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:22.928 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.927+0000 7f23dde00640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23bc065150 0x7f23bc067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f23d0034000 tx=0x7f23d0032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:22.931 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:22.931+0000 7f23d5600640 1 -- 172.21.15.45:0/4286934032 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f23e0153500 con 0x7f23e0159610 2024-08-17T02:28:23.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.114+0000 7f23e5000640 1 -- 172.21.15.45:0/4286934032 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23e0153500 con 0x7f23e0159610 2024-08-17T02:28:23.115 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.114+0000 7f23d5600640 1 -- 172.21.15.45:0/4286934032 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23e0153500 con 0x7f23e0159610 2024-08-17T02:28:23.115 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:28:23.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 -- 172.21.15.45:0/4286934032 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23bc065150 msgr2=0x7f23bc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23bc065150 0x7f23bc067600 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f23d0034000 tx=0x7f23d0032000 comp rx=0 tx=0).stop 2024-08-17T02:28:23.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 -- 172.21.15.45:0/4286934032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e0159610 msgr2=0x7f23e015a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.117 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e0159610 0x7f23e015a910 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f23d800c860 tx=0x7f23d8001690 comp rx=0 tx=0).stop 2024-08-17T02:28:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 -- 172.21.15.45:0/4286934032 shutdown_connections 2024-08-17T02:28:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23e0159610 0x7f23e015a910 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f23bc065150 0x7f23bc067600 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f23e00afd90 0x7f23e00abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 --2- 172.21.15.45:0/4286934032 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f23e00accf0 0x7f23e01537e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 -- 172.21.15.45:0/4286934032 >> 172.21.15.45:0/4286934032 conn(0x7f23e0067750 msgr2=0x7f23e00cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 -- 172.21.15.45:0/4286934032 shutdown_connections 2024-08-17T02:28:23.118 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.116+0000 7f23e5000640 1 -- 172.21.15.45:0/4286934032 wait complete. 2024-08-17T02:28:23.132 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-17T02:28:23.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.289+0000 7f989fe00640 1 Processor -- start 2024-08-17T02:28:23.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.289+0000 7f989fe00640 1 -- start start 2024-08-17T02:28:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.290+0000 7f989fe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98980c7db0 0x7f98980c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.290+0000 7f989fe00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98981598f0 con 0x7f9898155e50 2024-08-17T02:28:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.290+0000 7f989fe00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9898159bd0 con 0x7f9898155a80 2024-08-17T02:28:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.290+0000 7f989fe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9898159eb0 con 0x7f98980c7db0 2024-08-17T02:28:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f989de00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9898155e50 0x7f98980aea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53312/0 (socket says 172.21.15.45:53312) 2024-08-17T02:28:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f989de00640 1 -- 172.21.15.45:0/2507871786 learned_addr learned my addr 172.21.15.45:0/2507871786 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:23.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f989ca00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98980c7db0 0x7f98980c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294545023 0 0) 0x7f98981598f0 con 0x7f9898155e50 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98800034e0 con 0x7f9898155e50 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192263657 0 0) 0x7f9898159bd0 con 0x7f9898155a80 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98981598f0 con 0x7f9898155a80 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 122814784 0 0) 0x7f98800034e0 con 0x7f9898155e50 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98980c7db0 msgr2=0x7f98980c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f9897e00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98980c7db0 0x7f98980c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 >> v1:172.21.15.169:6789/0 conn(0x7f9898155a80 legacy=0x7f989806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f989815a190 con 0x7f9898155e50 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7f98900017f0 con 0x7f9898155e50 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.291+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 >> v1:172.21.15.45:6789/0 conn(0x7f9898155e50 legacy=0x7f98980aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f9897e00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98980c7db0 0x7f9880003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f9897e00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98800040f0 0x7f9880004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f9897e00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9880004cc0 0x7f9880005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898159eb0 con 0x7f98800040f0 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988000bb10 con 0x7f9880004cc0 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988000bcd0 con 0x7f98980c7db0 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f989ca00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98800040f0 0x7f9880004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f989d400640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98980c7db0 0x7f9880003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f989de00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9880004cc0 0x7f9880005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f989ca00640 1 -- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98980c7db0 msgr2=0x7f9880003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f989ca00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98980c7db0 0x7f9880003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f989ca00640 1 -- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9880004cc0 msgr2=0x7f9880005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f989ca00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9880004cc0 0x7f9880005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f989ca00640 1 -- 172.21.15.45:0/2507871786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98800034e0 con 0x7f98800040f0 2024-08-17T02:28:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.292+0000 7f989de00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9880004cc0 0x7f9880005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.293+0000 7f989ca00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98800040f0 0x7f9880004780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9884009b50 tx=0x7f98840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83b904e94100f902 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.294+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884031400 con 0x7f98800040f0 2024-08-17T02:28:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.294+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988402d050 con 0x7f98800040f0 2024-08-17T02:28:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.294+0000 7f9897e00640 1 -- 172.21.15.45:0/2507871786 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884031790 con 0x7f98800040f0 2024-08-17T02:28:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.294+0000 7f989fe00640 1 -- 172.21.15.45:0/2507871786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98800040f0 msgr2=0x7f9880004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.294+0000 7f989fe00640 1 --2- 172.21.15.45:0/2507871786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98800040f0 0x7f9880004780 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9884009b50 tx=0x7f98840090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.294+0000 7f989de00640 1 -- 172.21.15.45:0/2507871786 reap_dead start 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.294+0000 7f989fe00640 1 -- 172.21.15.45:0/2507871786 shutdown_connections 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.294+0000 7f989fe00640 1 -- 172.21.15.45:0/2507871786 >> 172.21.15.45:0/2507871786 conn(0x7f9898067750 msgr2=0x7f98980c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.294+0000 7f989fe00640 1 -- 172.21.15.45:0/2507871786 shutdown_connections 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.294+0000 7f989fe00640 1 -- 172.21.15.45:0/2507871786 wait complete. 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.296+0000 7f989fe00640 1 Processor -- start 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.296+0000 7f989fe00640 1 -- start start 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989fe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98800040f0 0x7f989814d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989fe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98981575f0 0x7f989814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989fe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9898157a60 0x7f989814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989fe00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898156340 con 0x7f98981575f0 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989fe00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9898157160 con 0x7f9898157a60 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989fe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9898156550 con 0x7f98800040f0 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989ca00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98981575f0 0x7f989814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989ca00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98981575f0 0x7f989814ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53744/0 (socket says 172.21.15.45:53744) 2024-08-17T02:28:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989ca00640 1 -- 172.21.15.45:0/2900673793 learned_addr learned my addr 172.21.15.45:0/2900673793 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989d400640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98800040f0 0x7f989814d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989de00640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9898157a60 0x7f989814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989ca00640 1 -- 172.21.15.45:0/2900673793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98800040f0 msgr2=0x7f989814d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989ca00640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98800040f0 0x7f989814d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989ca00640 1 -- 172.21.15.45:0/2900673793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9898157a60 msgr2=0x7f989814f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989ca00640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9898157a60 0x7f989814f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989ca00640 1 -- 172.21.15.45:0/2900673793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9898156830 con 0x7f98981575f0 2024-08-17T02:28:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.297+0000 7f989d400640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98800040f0 0x7f989814d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.298+0000 7f989ca00640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98981575f0 0x7f989814ecf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9884009bb0 tx=0x7f9884035000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.298+0000 7f9894c00640 1 -- 172.21.15.45:0/2900673793 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988402fa90 con 0x7f98981575f0 2024-08-17T02:28:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.298+0000 7f9894c00640 1 -- 172.21.15.45:0/2900673793 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988402fbf0 con 0x7f98981575f0 2024-08-17T02:28:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.298+0000 7f9894c00640 1 -- 172.21.15.45:0/2900673793 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9884045470 con 0x7f98981575f0 2024-08-17T02:28:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.298+0000 7f989fe00640 1 -- 172.21.15.45:0/2900673793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9898156b10 con 0x7f98981575f0 2024-08-17T02:28:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.298+0000 7f989fe00640 1 -- 172.21.15.45:0/2900673793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f989814db10 con 0x7f98981575f0 2024-08-17T02:28:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.299+0000 7f989fe00640 1 -- 172.21.15.45:0/2900673793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9898071050 con 0x7f98981575f0 2024-08-17T02:28:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.300+0000 7f9894c00640 1 -- 172.21.15.45:0/2900673793 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9884042070 con 0x7f98981575f0 2024-08-17T02:28:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.301+0000 7f9894c00640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9878065150 0x7f9878067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.301+0000 7f9894c00640 1 -- 172.21.15.45:0/2900673793 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f98840a3d70 con 0x7f98981575f0 2024-08-17T02:28:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.301+0000 7f989d400640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9878065150 0x7f9878067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.303 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.302+0000 7f989d400640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9878065150 0x7f9878067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f988c007fd0 tx=0x7f988c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.306 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.305+0000 7f9894c00640 1 -- 172.21.15.45:0/2900673793 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f98840a9020 con 0x7f98981575f0 2024-08-17T02:28:23.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.485+0000 7f989fe00640 1 -- 172.21.15.45:0/2900673793 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f98981572a0 con 0x7f98981575f0 2024-08-17T02:28:23.486 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.485+0000 7f9894c00640 1 -- 172.21.15.45:0/2900673793 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f988404a0a0 con 0x7f98981575f0 2024-08-17T02:28:23.486 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:28:23.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 -- 172.21.15.45:0/2900673793 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9878065150 msgr2=0x7f9878067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9878065150 0x7f9878067600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f988c007fd0 tx=0x7f988c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:23.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 -- 172.21.15.45:0/2900673793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98981575f0 msgr2=0x7f989814ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.488 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98981575f0 0x7f989814ecf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9884009bb0 tx=0x7f9884035000 comp rx=0 tx=0).stop 2024-08-17T02:28:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 -- 172.21.15.45:0/2900673793 shutdown_connections 2024-08-17T02:28:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9898157a60 0x7f989814f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f98981575f0 0x7f989814ecf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9878065150 0x7f9878067600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 --2- 172.21.15.45:0/2900673793 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f98800040f0 0x7f989814d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 -- 172.21.15.45:0/2900673793 >> 172.21.15.45:0/2900673793 conn(0x7f9898067750 msgr2=0x7f98980c8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 -- 172.21.15.45:0/2900673793 shutdown_connections 2024-08-17T02:28:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.487+0000 7f989fe00640 1 -- 172.21.15.45:0/2900673793 wait complete. 2024-08-17T02:28:23.503 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-17T02:28:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.656+0000 7f2fad800640 1 Processor -- start 2024-08-17T02:28:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.656+0000 7f2fad800640 1 -- start start 2024-08-17T02:28:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.657+0000 7f2fad800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2fa8155a80 0x7f2fa806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.658+0000 7f2fad800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2fa80c92e0 0x7f2fa80aea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.658+0000 7f2fad800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fa81598f0 con 0x7f2fa80c7db0 2024-08-17T02:28:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.658+0000 7f2fad800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa8159bd0 con 0x7f2fa8155a80 2024-08-17T02:28:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.658+0000 7f2fad800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fa8159eb0 con 0x7f2fa80c92e0 2024-08-17T02:28:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.658+0000 7f2fa6a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2fa8155a80 0x7f2fa806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.658+0000 7f2fa6a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2fa8155a80 0x7f2fa806dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53746/0 (socket says 172.21.15.45:53746) 2024-08-17T02:28:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.658+0000 7f2fa6a00640 1 -- 172.21.15.45:0/3889056703 learned_addr learned my addr 172.21.15.45:0/3889056703 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.658+0000 7f2fa6a00640 1 -- 172.21.15.45:0/3889056703 >> v2:172.21.15.169:3300/0 conn(0x7f2fa80c92e0 msgr2=0x7f2fa80aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.658+0000 7f2fa6a00640 1 --2- 172.21.15.45:0/3889056703 >> v2:172.21.15.169:3300/0 conn(0x7f2fa80c92e0 0x7f2fa80aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.658+0000 7f2fa6a00640 1 -- 172.21.15.45:0/3889056703 >> v1:172.21.15.169:6789/0 conn(0x7f2fa80c7db0 legacy=0x7f2fa80c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:23.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.658+0000 7f2fa6a00640 1 -- 172.21.15.45:0/3889056703 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa815a190 con 0x7f2fa8155a80 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.659+0000 7f2fa6a00640 1 --2- 172.21.15.45:0/3889056703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8155a80 0x7f2fa806dc00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80b1c60 tx=0x7f2f980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e46f55ed04f0dc server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.659+0000 7f2fa6000640 1 -- 172.21.15.45:0/3889056703 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9802ae60 con 0x7f2fa8155a80 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.660+0000 7f2fa6000640 1 -- 172.21.15.45:0/3889056703 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f98032440 con 0x7f2fa8155a80 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.660+0000 7f2fa6000640 1 -- 172.21.15.45:0/3889056703 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f980327e0 con 0x7f2fa8155a80 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.660+0000 7f2fad800640 1 -- 172.21.15.45:0/3889056703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8155a80 msgr2=0x7f2fa806dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.660+0000 7f2fad800640 1 --2- 172.21.15.45:0/3889056703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8155a80 0x7f2fa806dc00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2fa80b1c60 tx=0x7f2f980091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.660+0000 7f2fad800640 1 -- 172.21.15.45:0/3889056703 shutdown_connections 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.660+0000 7f2fad800640 1 --2- 172.21.15.45:0/3889056703 >> v2:172.21.15.169:3300/0 conn(0x7f2fa80c92e0 0x7f2fa80aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.660+0000 7f2fad800640 1 --2- 172.21.15.45:0/3889056703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8155a80 0x7f2fa806dc00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.660+0000 7f2fad800640 1 -- 172.21.15.45:0/3889056703 >> 172.21.15.45:0/3889056703 conn(0x7f2fa8067750 msgr2=0x7f2fa80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.660+0000 7f2fad800640 1 -- 172.21.15.45:0/3889056703 shutdown_connections 2024-08-17T02:28:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.660+0000 7f2fad800640 1 -- 172.21.15.45:0/3889056703 wait complete. 2024-08-17T02:28:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.662+0000 7f2fad800640 1 Processor -- start 2024-08-17T02:28:23.662 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.662+0000 7f2fad800640 1 -- start start 2024-08-17T02:28:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fad800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fa80c7db0 0x7f2fa814c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fad800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa80c92e0 0x7f2fa81492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fad800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8155a80 0x7f2fa814a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fad800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa814cb60 con 0x7f2fa8155a80 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fad800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa814ce40 con 0x7f2fa80c7db0 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fad800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fa814d120 con 0x7f2fa80c92e0 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fa7400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8155a80 0x7f2fa814a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fa7400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8155a80 0x7f2fa814a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53760/0 (socket says 172.21.15.45:53760) 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fa7400640 1 -- 172.21.15.45:0/2228668807 learned_addr learned my addr 172.21.15.45:0/2228668807 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fa6a00640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fa80c7db0 0x7f2fa814c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2f9fe00640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa80c92e0 0x7f2fa81492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fa7400640 1 -- 172.21.15.45:0/2228668807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa80c92e0 msgr2=0x7f2fa81492d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fa7400640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa80c92e0 0x7f2fa81492d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fa7400640 1 -- 172.21.15.45:0/2228668807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fa80c7db0 msgr2=0x7f2fa814c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fa7400640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fa80c7db0 0x7f2fa814c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fa7400640 1 -- 172.21.15.45:0/2228668807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f98009450 con 0x7f2fa8155a80 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.663+0000 7f2fa7400640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8155a80 0x7f2fa814a720 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000bc30 tx=0x7f2fa0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.664+0000 7f2f9e000640 1 -- 172.21.15.45:0/2228668807 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00092e0 con 0x7f2fa8155a80 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.664+0000 7f2f9e000640 1 -- 172.21.15.45:0/2228668807 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa000c860 con 0x7f2fa8155a80 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.664+0000 7f2f9e000640 1 -- 172.21.15.45:0/2228668807 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa000cc40 con 0x7f2fa8155a80 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.664+0000 7f2fad800640 1 -- 172.21.15.45:0/2228668807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fa8149f20 con 0x7f2fa8155a80 2024-08-17T02:28:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.664+0000 7f2fad800640 1 -- 172.21.15.45:0/2228668807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fa814c7c0 con 0x7f2fa8155a80 2024-08-17T02:28:23.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.665+0000 7f2fad800640 1 -- 172.21.15.45:0/2228668807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fa814a420 con 0x7f2fa8155a80 2024-08-17T02:28:23.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.666+0000 7f2f9e000640 1 -- 172.21.15.45:0/2228668807 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2fa0012070 con 0x7f2fa8155a80 2024-08-17T02:28:23.667 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.667+0000 7f2f9e000640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2f84065150 0x7f2f84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.667+0000 7f2f9e000640 1 -- 172.21.15.45:0/2228668807 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f2fa00824a0 con 0x7f2fa8155a80 2024-08-17T02:28:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.667+0000 7f2fa6a00640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2f84065150 0x7f2f84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.668+0000 7f2fa6a00640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2f84065150 0x7f2f84067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2f98034000 tx=0x7f2f98032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.670+0000 7f2f9e000640 1 -- 172.21.15.45:0/2228668807 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2fa0053bd0 con 0x7f2fa8155a80 2024-08-17T02:28:23.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.851+0000 7f2fad800640 1 -- 172.21.15.45:0/2228668807 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2fa8071050 con 0x7f2fa8155a80 2024-08-17T02:28:23.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.852+0000 7f2f9e000640 1 -- 172.21.15.45:0/2228668807 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2fa0053760 con 0x7f2fa8155a80 2024-08-17T02:28:23.853 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2024-08-17T02:28:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 -- 172.21.15.45:0/2228668807 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2f84065150 msgr2=0x7f2f84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2f84065150 0x7f2f84067600 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2f98034000 tx=0x7f2f98032000 comp rx=0 tx=0).stop 2024-08-17T02:28:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 -- 172.21.15.45:0/2228668807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8155a80 msgr2=0x7f2fa814a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8155a80 0x7f2fa814a720 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000bc30 tx=0x7f2fa0009840 comp rx=0 tx=0).stop 2024-08-17T02:28:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 -- 172.21.15.45:0/2228668807 shutdown_connections 2024-08-17T02:28:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2fa8155a80 0x7f2fa814a720 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2f84065150 0x7f2f84067600 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2fa80c92e0 0x7f2fa81492d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 --2- 172.21.15.45:0/2228668807 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2fa80c7db0 0x7f2fa814c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:23.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 -- 172.21.15.45:0/2228668807 >> 172.21.15.45:0/2228668807 conn(0x7f2fa8067750 msgr2=0x7f2fa81515b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:23.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 -- 172.21.15.45:0/2228668807 shutdown_connections 2024-08-17T02:28:23.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:23.854+0000 7f2fad800640 1 -- 172.21.15.45:0/2228668807 wait complete. 2024-08-17T02:28:23.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000631254.meta pg_num 2024-08-17T02:28:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.027+0000 7feb90000640 1 Processor -- start 2024-08-17T02:28:24.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.027+0000 7feb90000640 1 -- start start 2024-08-17T02:28:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.028+0000 7feb90000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7feb88155a80 0x7feb8806dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.028+0000 7feb90000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb880c7db0 0x7feb880c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.028+0000 7feb90000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb881598f0 con 0x7feb88155e50 2024-08-17T02:28:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.029+0000 7feb90000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb88159bd0 con 0x7feb88155a80 2024-08-17T02:28:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.029+0000 7feb90000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb88159eb0 con 0x7feb880c7db0 2024-08-17T02:28:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.029+0000 7feb8e000640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feb88155e50 0x7feb8806c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53318/0 (socket says 172.21.15.45:53318) 2024-08-17T02:28:24.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.029+0000 7feb8e000640 1 -- 172.21.15.45:0/2496798452 learned_addr learned my addr 172.21.15.45:0/2496798452 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.029+0000 7feb8d600640 1 --2- 172.21.15.45:0/2496798452 >> v2:172.21.15.169:3300/0 conn(0x7feb88155a80 0x7feb8806dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.029+0000 7feb8cc00640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb880c7db0 0x7feb880c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.029+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603733496 0 0) 0x7feb881598f0 con 0x7feb88155e50 2024-08-17T02:28:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.029+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb700034e0 con 0x7feb88155e50 2024-08-17T02:28:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2755466182 0 0) 0x7feb700034e0 con 0x7feb88155e50 2024-08-17T02:28:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb880c7db0 msgr2=0x7feb880c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb880c7db0 0x7feb880c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 >> v2:172.21.15.169:3300/0 conn(0x7feb88155a80 msgr2=0x7feb8806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 --2- 172.21.15.45:0/2496798452 >> v2:172.21.15.169:3300/0 conn(0x7feb88155a80 0x7feb8806dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8815a190 con 0x7feb88155e50 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7feb800017f0 con 0x7feb88155e50 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb8cc00640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb880c7db0 0x7feb880c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb8d600640 1 --2- 172.21.15.45:0/2496798452 >> v2:172.21.15.169:3300/0 conn(0x7feb88155a80 0x7feb8806dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 >> v1:172.21.15.45:6789/0 conn(0x7feb88155e50 legacy=0x7feb8806c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb70003a50 0x7feb70003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb880c7db0 0x7feb70004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 0x7feb70005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb88159bd0 con 0x7feb70004cc0 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb88159eb0 con 0x7feb70003a50 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7000dc60 con 0x7feb880c7db0 2024-08-17T02:28:24.034 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb8e000640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 0x7feb70005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb8d600640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb70003a50 0x7feb70003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb8cc00640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb880c7db0 0x7feb70004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb8e000640 1 -- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb880c7db0 msgr2=0x7feb70004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb8e000640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb880c7db0 0x7feb70004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb8e000640 1 -- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb70003a50 msgr2=0x7feb70003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.030+0000 7feb8e000640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb70003a50 0x7feb70003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.031+0000 7feb8e000640 1 -- 172.21.15.45:0/2496798452 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb74009390 con 0x7feb70004cc0 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.031+0000 7feb8e000640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 0x7feb70005130 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feb8000a8a0 tx=0x7feb80002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc14168de56f9b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.032+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb800070f0 con 0x7feb70004cc0 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.032+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb80007270 con 0x7feb70004cc0 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.032+0000 7feb87e00640 1 -- 172.21.15.45:0/2496798452 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb80007670 con 0x7feb70004cc0 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.032+0000 7feb90000640 1 -- 172.21.15.45:0/2496798452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 msgr2=0x7feb70005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.032+0000 7feb90000640 1 --2- 172.21.15.45:0/2496798452 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 0x7feb70005130 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7feb8000a8a0 tx=0x7feb80002140 comp rx=0 tx=0).stop 2024-08-17T02:28:24.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.032+0000 7feb8e000640 1 -- 172.21.15.45:0/2496798452 reap_dead start 2024-08-17T02:28:24.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.032+0000 7feb90000640 1 -- 172.21.15.45:0/2496798452 shutdown_connections 2024-08-17T02:28:24.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.032+0000 7feb90000640 1 -- 172.21.15.45:0/2496798452 >> 172.21.15.45:0/2496798452 conn(0x7feb88067750 msgr2=0x7feb880c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.032+0000 7feb90000640 1 -- 172.21.15.45:0/2496798452 shutdown_connections 2024-08-17T02:28:24.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.032+0000 7feb90000640 1 -- 172.21.15.45:0/2496798452 wait complete. 2024-08-17T02:28:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.034+0000 7feb90000640 1 Processor -- start 2024-08-17T02:28:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.034+0000 7feb90000640 1 -- start start 2024-08-17T02:28:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb90000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 0x7feb881575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb90000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb8814efd0 0x7feb88150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb90000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb881511e0 0x7feb88156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb90000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb881500c0 con 0x7feb70004cc0 2024-08-17T02:28:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb90000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8814f440 con 0x7feb8814efd0 2024-08-17T02:28:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb90000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8814f720 con 0x7feb881511e0 2024-08-17T02:28:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb8d600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 0x7feb881575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb8d600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 0x7feb881575c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53774/0 (socket says 172.21.15.45:53774) 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb8d600640 1 -- 172.21.15.45:0/2579225991 learned_addr learned my addr 172.21.15.45:0/2579225991 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb8d600640 1 -- 172.21.15.45:0/2579225991 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb881511e0 msgr2=0x7feb88156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb8d600640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb881511e0 0x7feb88156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb8d600640 1 -- 172.21.15.45:0/2579225991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb8814efd0 msgr2=0x7feb88150ca0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb8d600640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb8814efd0 0x7feb88150ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.035+0000 7feb8d600640 1 -- 172.21.15.45:0/2579225991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8814fa00 con 0x7feb70004cc0 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.036+0000 7feb8d600640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 0x7feb881575c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feb7c011d70 tx=0x7feb7c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.036+0000 7feb84c00640 1 -- 172.21.15.45:0/2579225991 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00fcb0 con 0x7feb70004cc0 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.036+0000 7feb84c00640 1 -- 172.21.15.45:0/2579225991 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c00fe10 con 0x7feb70004cc0 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.036+0000 7feb90000640 1 -- 172.21.15.45:0/2579225991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8814fce0 con 0x7feb70004cc0 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.036+0000 7feb84c00640 1 -- 172.21.15.45:0/2579225991 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c01d6b0 con 0x7feb70004cc0 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.036+0000 7feb90000640 1 -- 172.21.15.45:0/2579225991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb88157ca0 con 0x7feb70004cc0 2024-08-17T02:28:24.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.037+0000 7feb90000640 1 -- 172.21.15.45:0/2579225991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb88071050 con 0x7feb70004cc0 2024-08-17T02:28:24.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.038+0000 7feb84c00640 1 -- 172.21.15.45:0/2579225991 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feb7c01daa0 con 0x7feb70004cc0 2024-08-17T02:28:24.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.039+0000 7feb84c00640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb68065150 0x7feb68067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.039+0000 7feb84c00640 1 -- 172.21.15.45:0/2579225991 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7feb7c018070 con 0x7feb70004cc0 2024-08-17T02:28:24.040 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.039+0000 7feb8cc00640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb68065150 0x7feb68067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.041 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.040+0000 7feb8cc00640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb68065150 0x7feb68067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feb88151c00 tx=0x7feb740090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.043+0000 7feb84c00640 1 -- 172.21.15.45:0/2579225991 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feb7c051770 con 0x7feb70004cc0 2024-08-17T02:28:24.226 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.225+0000 7feb90000640 1 -- 172.21.15.45:0/2579225991 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000631254.meta", "var": "pg_num"} v 0) v1 -- 0x7feb8806aa10 con 0x7feb70004cc0 2024-08-17T02:28:24.227 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.226+0000 7feb84c00640 1 -- 172.21.15.45:0/2579225991 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000631254.meta", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7feb7c054d90 con 0x7feb70004cc0 2024-08-17T02:28:24.227 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:28:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 -- 172.21.15.45:0/2579225991 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb68065150 msgr2=0x7feb68067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb68065150 0x7feb68067600 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feb88151c00 tx=0x7feb740090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.229 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 -- 172.21.15.45:0/2579225991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 msgr2=0x7feb881575c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 0x7feb881575c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feb7c011d70 tx=0x7feb7c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 -- 172.21.15.45:0/2579225991 shutdown_connections 2024-08-17T02:28:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb68065150 0x7feb68067600 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb881511e0 0x7feb88156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb8814efd0 0x7feb88150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 --2- 172.21.15.45:0/2579225991 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb70004cc0 0x7feb881575c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 -- 172.21.15.45:0/2579225991 >> 172.21.15.45:0/2579225991 conn(0x7feb88067750 msgr2=0x7feb88068820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 -- 172.21.15.45:0/2579225991 shutdown_connections 2024-08-17T02:28:24.230 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.228+0000 7feb90000640 1 -- 172.21.15.45:0/2579225991 wait complete. 2024-08-17T02:28:24.244 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000631254.data pg_num 2024-08-17T02:28:24.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.397+0000 7f509ae00640 1 Processor -- start 2024-08-17T02:28:24.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.398+0000 7f509ae00640 1 -- start start 2024-08-17T02:28:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f509ae00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5094155090 0x7f50940abc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f509ae00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5094155460 0x7f50940ad560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f509ae00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f50940adaa0 0x7f509406d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f509ae00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5094156870 con 0x7f5094155090 2024-08-17T02:28:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f509ae00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5094155c60 con 0x7f50940adaa0 2024-08-17T02:28:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f509ae00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5094155f40 con 0x7f5094155460 2024-08-17T02:28:24.400 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f5099a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5094155090 0x7f50940abc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f5099a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5094155090 0x7f50940abc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53780/0 (socket says 172.21.15.45:53780) 2024-08-17T02:28:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f5099a00640 1 -- 172.21.15.45:0/1633132846 learned_addr learned my addr 172.21.15.45:0/1633132846 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f5099000640 1 --2- 172.21.15.45:0/1633132846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5094155460 0x7f50940ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f509a400640 1 --2- 172.21.15.45:0/1633132846 >> v2:172.21.15.169:3300/0 conn(0x7f50940adaa0 0x7f509406d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f5099a00640 1 -- 172.21.15.45:0/1633132846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5094155460 msgr2=0x7f50940ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f5099a00640 1 --2- 172.21.15.45:0/1633132846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5094155460 0x7f50940ad560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f5099a00640 1 -- 172.21.15.45:0/1633132846 >> v2:172.21.15.169:3300/0 conn(0x7f50940adaa0 msgr2=0x7f509406d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.399+0000 7f5099a00640 1 --2- 172.21.15.45:0/1633132846 >> v2:172.21.15.169:3300/0 conn(0x7f50940adaa0 0x7f509406d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.400+0000 7f5099a00640 1 -- 172.21.15.45:0/1633132846 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5094156220 con 0x7f5094155090 2024-08-17T02:28:24.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.400+0000 7f509a400640 1 --2- 172.21.15.45:0/1633132846 >> v2:172.21.15.169:3300/0 conn(0x7f50940adaa0 0x7f509406d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:24.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.400+0000 7f5099a00640 1 --2- 172.21.15.45:0/1633132846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094155090 0x7f50940abc60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f50940667f0 tx=0x7f50880091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b497be995a686b4e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.402 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.401+0000 7f5093e00640 1 -- 172.21.15.45:0/1633132846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508802add0 con 0x7f5094155090 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.401+0000 7f5093e00640 1 -- 172.21.15.45:0/1633132846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5088032440 con 0x7f5094155090 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.401+0000 7f5093e00640 1 -- 172.21.15.45:0/1633132846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088032820 con 0x7f5094155090 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.401+0000 7f509ae00640 1 -- 172.21.15.45:0/1633132846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094155090 msgr2=0x7f50940abc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.401+0000 7f509ae00640 1 --2- 172.21.15.45:0/1633132846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094155090 0x7f50940abc60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f50940667f0 tx=0x7f50880091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.401+0000 7f509ae00640 1 -- 172.21.15.45:0/1633132846 shutdown_connections 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.401+0000 7f509ae00640 1 --2- 172.21.15.45:0/1633132846 >> v2:172.21.15.169:3300/0 conn(0x7f50940adaa0 0x7f509406d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.401+0000 7f509ae00640 1 --2- 172.21.15.45:0/1633132846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5094155460 0x7f50940ad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.401+0000 7f509ae00640 1 --2- 172.21.15.45:0/1633132846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094155090 0x7f50940abc60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.401+0000 7f509ae00640 1 -- 172.21.15.45:0/1633132846 >> 172.21.15.45:0/1633132846 conn(0x7f5094066cd0 msgr2=0x7f50940670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.402+0000 7f509ae00640 1 -- 172.21.15.45:0/1633132846 shutdown_connections 2024-08-17T02:28:24.403 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.402+0000 7f509ae00640 1 -- 172.21.15.45:0/1633132846 wait complete. 2024-08-17T02:28:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.403+0000 7f509ae00640 1 Processor -- start 2024-08-17T02:28:24.404 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.403+0000 7f509ae00640 1 -- start start 2024-08-17T02:28:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.404+0000 7f509ae00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50940adaa0 0x7f509413fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.404+0000 7f509ae00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094155090 0x7f50940a87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.404+0000 7f509ae00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5094155460 0x7f50940a8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.404+0000 7f509ae00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50941688f0 con 0x7f5094155090 2024-08-17T02:28:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.404+0000 7f509ae00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50940c94e0 con 0x7f50940adaa0 2024-08-17T02:28:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.404+0000 7f509ae00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5094140090 con 0x7f5094155460 2024-08-17T02:28:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.404+0000 7f5099000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094155090 0x7f50940a87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.404+0000 7f5099000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094155090 0x7f50940a87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53786/0 (socket says 172.21.15.45:53786) 2024-08-17T02:28:24.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.404+0000 7f5099000640 1 -- 172.21.15.45:0/2063995782 learned_addr learned my addr 172.21.15.45:0/2063995782 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.404+0000 7f509a400640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5094155460 0x7f50940a8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.404+0000 7f5099a00640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50940adaa0 0x7f509413fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f5099000640 1 -- 172.21.15.45:0/2063995782 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5094155460 msgr2=0x7f50940a8cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f5099000640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5094155460 0x7f50940a8cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f5099000640 1 -- 172.21.15.45:0/2063995782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50940adaa0 msgr2=0x7f509413fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f5099000640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50940adaa0 0x7f509413fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f5099000640 1 -- 172.21.15.45:0/2063995782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5088009450 con 0x7f5094155090 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f5099a00640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50940adaa0 0x7f509413fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f5099000640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094155090 0x7f50940a87b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f508000d8f0 tx=0x7f5080008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f5090c00640 1 -- 172.21.15.45:0/2063995782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508000de80 con 0x7f5094155090 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f5090c00640 1 -- 172.21.15.45:0/2063995782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50800098b0 con 0x7f5094155090 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f5090c00640 1 -- 172.21.15.45:0/2063995782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080009c50 con 0x7f5094155090 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f509ae00640 1 -- 172.21.15.45:0/2063995782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50940a65a0 con 0x7f5094155090 2024-08-17T02:28:24.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.405+0000 7f509ae00640 1 -- 172.21.15.45:0/2063995782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50940c9200 con 0x7f5094155090 2024-08-17T02:28:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.406+0000 7f509ae00640 1 -- 172.21.15.45:0/2063995782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50940a5df0 con 0x7f5094155090 2024-08-17T02:28:24.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.407+0000 7f5090c00640 1 -- 172.21.15.45:0/2063995782 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5080014620 con 0x7f5094155090 2024-08-17T02:28:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.408+0000 7f5090c00640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5074065150 0x7f5074067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.408+0000 7f5090c00640 1 -- 172.21.15.45:0/2063995782 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f5080083070 con 0x7f5094155090 2024-08-17T02:28:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.408+0000 7f5099a00640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5074065150 0x7f5074067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.409+0000 7f5099a00640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5074065150 0x7f5074067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5088034000 tx=0x7f5088032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.412 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.412+0000 7f5090c00640 1 -- 172.21.15.45:0/2063995782 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f50800b4e40 con 0x7f5094155090 2024-08-17T02:28:24.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.591+0000 7f509ae00640 1 -- 172.21.15.45:0/2063995782 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000631254.data", "var": "pg_num"} v 0) v1 -- 0x7f50940a6730 con 0x7f5094155090 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.592+0000 7f5090c00640 1 -- 172.21.15.45:0/2063995782 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000631254.data", "var": "pg_num"}]=0 v37) v1 ==== 124+0+11 (secure 0 0 0) 0x7f50940a5df0 con 0x7f5094155090 2024-08-17T02:28:24.593 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 -- 172.21.15.45:0/2063995782 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5074065150 msgr2=0x7f5074067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5074065150 0x7f5074067600 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5088034000 tx=0x7f5088032000 comp rx=0 tx=0).stop 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 -- 172.21.15.45:0/2063995782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094155090 msgr2=0x7f50940a87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094155090 0x7f50940a87b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f508000d8f0 tx=0x7f5080008040 comp rx=0 tx=0).stop 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 -- 172.21.15.45:0/2063995782 shutdown_connections 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5074065150 0x7f5074067600 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.595 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5094155460 0x7f50940a8cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5094155090 0x7f50940a87b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 --2- 172.21.15.45:0/2063995782 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f50940adaa0 0x7f509413fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 -- 172.21.15.45:0/2063995782 >> 172.21.15.45:0/2063995782 conn(0x7f5094066cd0 msgr2=0x7f50940afe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 -- 172.21.15.45:0/2063995782 shutdown_connections 2024-08-17T02:28:24.596 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.594+0000 7f509ae00640 1 -- 172.21.15.45:0/2063995782 wait complete. 2024-08-17T02:28:24.610 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:24.761 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.761+0000 7f45f1000640 1 Processor -- start 2024-08-17T02:28:24.762 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.761+0000 7f45f1000640 1 -- start start 2024-08-17T02:28:24.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.762+0000 7f45f1000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45ec1401b0 0x7f45ec0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.762+0000 7f45f1000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45ec0b1440 0x7f45ec0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.763 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.762+0000 7f45f1000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ec0caa80 con 0x7f45ec140580 2024-08-17T02:28:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.762+0000 7f45f1000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45ec0cb450 con 0x7f45ec0b1440 2024-08-17T02:28:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.762+0000 7f45f1000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0c9e70 con 0x7f45ec1401b0 2024-08-17T02:28:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.762+0000 7f45ea800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45ec0b1440 0x7f45ec0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.762+0000 7f45ea800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f45ec0b1440 0x7f45ec0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53796/0 (socket says 172.21.15.45:53796) 2024-08-17T02:28:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.762+0000 7f45ea800640 1 -- 172.21.15.45:0/4103845235 learned_addr learned my addr 172.21.15.45:0/4103845235 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.762+0000 7f45e9e00640 1 --2- 172.21.15.45:0/4103845235 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45ec1401b0 0x7f45ec0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.763+0000 7f45ea800640 1 -- 172.21.15.45:0/4103845235 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45ec1401b0 msgr2=0x7f45ec0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.763+0000 7f45ea800640 1 --2- 172.21.15.45:0/4103845235 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45ec1401b0 0x7f45ec0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.763+0000 7f45ea800640 1 -- 172.21.15.45:0/4103845235 >> v1:172.21.15.169:6789/0 conn(0x7f45ec140580 legacy=0x7f45ec0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.764 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.763+0000 7f45ea800640 1 -- 172.21.15.45:0/4103845235 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec0ca150 con 0x7f45ec0b1440 2024-08-17T02:28:24.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.764+0000 7f45ea800640 1 --2- 172.21.15.45:0/4103845235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec0b1440 0x7f45ec0c9040 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009f20 tx=0x7f45e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815efcd500d864d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.764+0000 7f45e9400640 1 -- 172.21.15.45:0/4103845235 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4031400 con 0x7f45ec0b1440 2024-08-17T02:28:24.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.764+0000 7f45e9400640 1 -- 172.21.15.45:0/4103845235 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e402d050 con 0x7f45ec0b1440 2024-08-17T02:28:24.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.764+0000 7f45e9400640 1 -- 172.21.15.45:0/4103845235 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40317d0 con 0x7f45ec0b1440 2024-08-17T02:28:24.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.764+0000 7f45f1000640 1 -- 172.21.15.45:0/4103845235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec0b1440 msgr2=0x7f45ec0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.766 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.764+0000 7f45f1000640 1 --2- 172.21.15.45:0/4103845235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec0b1440 0x7f45ec0c9040 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009f20 tx=0x7f45e4009840 comp rx=0 tx=0).stop 2024-08-17T02:28:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.765+0000 7f45f1000640 1 -- 172.21.15.45:0/4103845235 shutdown_connections 2024-08-17T02:28:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.765+0000 7f45f1000640 1 --2- 172.21.15.45:0/4103845235 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec0b1440 0x7f45ec0c9040 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.765+0000 7f45f1000640 1 --2- 172.21.15.45:0/4103845235 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45ec1401b0 0x7f45ec0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.765+0000 7f45f1000640 1 -- 172.21.15.45:0/4103845235 >> 172.21.15.45:0/4103845235 conn(0x7f45ec0cb9b0 msgr2=0x7f45ec0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.765+0000 7f45f1000640 1 -- 172.21.15.45:0/4103845235 shutdown_connections 2024-08-17T02:28:24.767 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.765+0000 7f45f1000640 1 -- 172.21.15.45:0/4103845235 wait complete. 2024-08-17T02:28:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.766+0000 7f45f1000640 1 Processor -- start 2024-08-17T02:28:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.766+0000 7f45f1000640 1 -- start start 2024-08-17T02:28:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.767+0000 7f45f1000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45ec0b1440 0x7f45ec157840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.767+0000 7f45f1000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45ec1401b0 0x7f45ec156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.767+0000 7f45f1000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec140580 0x7f45ec0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.768 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.767+0000 7f45f1000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec16b070 con 0x7f45ec140580 2024-08-17T02:28:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.767+0000 7f45f1000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec16a460 con 0x7f45ec1401b0 2024-08-17T02:28:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.767+0000 7f45f1000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec16a740 con 0x7f45ec0b1440 2024-08-17T02:28:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.767+0000 7f45ea800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec140580 0x7f45ec0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.767+0000 7f45ea800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec140580 0x7f45ec0c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53806/0 (socket says 172.21.15.45:53806) 2024-08-17T02:28:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.767+0000 7f45ea800640 1 -- 172.21.15.45:0/1544187438 learned_addr learned my addr 172.21.15.45:0/1544187438 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.767+0000 7f45e9e00640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45ec0b1440 0x7f45ec157840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.768+0000 7f45e3e00640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45ec1401b0 0x7f45ec156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.768+0000 7f45ea800640 1 -- 172.21.15.45:0/1544187438 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45ec0b1440 msgr2=0x7f45ec157840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.768+0000 7f45ea800640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45ec0b1440 0x7f45ec157840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.768+0000 7f45ea800640 1 -- 172.21.15.45:0/1544187438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45ec1401b0 msgr2=0x7f45ec156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.768+0000 7f45ea800640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45ec1401b0 0x7f45ec156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:24.770 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.768+0000 7f45ea800640 1 -- 172.21.15.45:0/1544187438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e4009ae0 con 0x7f45ec140580 2024-08-17T02:28:24.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.768+0000 7f45ea800640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec140580 0x7f45ec0c71d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009f80 tx=0x7f45e4036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.768+0000 7f45e1600640 1 -- 172.21.15.45:0/1544187438 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e4008e50 con 0x7f45ec140580 2024-08-17T02:28:24.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.769+0000 7f45e1600640 1 -- 172.21.15.45:0/1544187438 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e403b410 con 0x7f45ec140580 2024-08-17T02:28:24.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.769+0000 7f45f1000640 1 -- 172.21.15.45:0/1544187438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ec16aa20 con 0x7f45ec140580 2024-08-17T02:28:24.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.769+0000 7f45e1600640 1 -- 172.21.15.45:0/1544187438 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e403b7d0 con 0x7f45ec140580 2024-08-17T02:28:24.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.769+0000 7f45f1000640 1 -- 172.21.15.45:0/1544187438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec16a0f0 con 0x7f45ec140580 2024-08-17T02:28:24.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.770+0000 7f45f1000640 1 -- 172.21.15.45:0/1544187438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ec16b220 con 0x7f45ec140580 2024-08-17T02:28:24.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.771+0000 7f45e1600640 1 -- 172.21.15.45:0/1544187438 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f45e4038050 con 0x7f45ec140580 2024-08-17T02:28:24.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.771+0000 7f45e1600640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f45c8065150 0x7f45c8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:24.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.771+0000 7f45e1600640 1 -- 172.21.15.45:0/1544187438 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f45e40a32f0 con 0x7f45ec140580 2024-08-17T02:28:24.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.772+0000 7f45e9e00640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f45c8065150 0x7f45c8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:24.773 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.772+0000 7f45e9e00640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f45c8065150 0x7f45c8067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009d20 tx=0x7f45dc0090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:24.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.776+0000 7f45e1600640 1 -- 172.21.15.45:0/1544187438 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f45e40710e0 con 0x7f45ec140580 2024-08-17T02:28:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.996+0000 7f45f1000640 1 -- 172.21.15.45:0/1544187438 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45ec064db0 con 0x7f45ec140580 2024-08-17T02:28:24.997 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.997+0000 7f45e1600640 1 -- 172.21.15.45:0/1544187438 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5684 (secure 0 0 0) 0x7f45e4074700 con 0x7f45ec140580 2024-08-17T02:28:24.998 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:24.998 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2570743735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2570743735},{"type":"v1","addr":"172.21.15.169:6834","nonce":2570743735}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1704272549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1704272549},{"type":"v1","addr":"172.21.15.169:6835","nonce":1704272549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:06.620196+0000","modified":"2024-08-17T02:26:10.215482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6836/618002034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":618002034},{"type":"v1","addr":"172.21.15.45:6836","nonce":618002034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:19.270401+0000","modified":"2024-08-17T02:26:20.776150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6837/569206503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":569206503},{"type":"v1","addr":"172.21.15.45:6837","nonce":569206503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000631254","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:24.998 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 20 2024-08-17T02:28:25.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 -- 172.21.15.45:0/1544187438 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f45c8065150 msgr2=0x7f45c8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f45c8065150 0x7f45c8067600 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009d20 tx=0x7f45dc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 -- 172.21.15.45:0/1544187438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec140580 msgr2=0x7f45ec0c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec140580 0x7f45ec0c71d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009f80 tx=0x7f45e4036000 comp rx=0 tx=0).stop 2024-08-17T02:28:25.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 -- 172.21.15.45:0/1544187438 shutdown_connections 2024-08-17T02:28:25.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f45ec140580 0x7f45ec0c71d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f45ec1401b0 0x7f45ec156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f45c8065150 0x7f45c8067600 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.000 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 --2- 172.21.15.45:0/1544187438 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f45ec0b1440 0x7f45ec157840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 -- 172.21.15.45:0/1544187438 >> 172.21.15.45:0/1544187438 conn(0x7f45ec0cb9b0 msgr2=0x7f45ec0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 -- 172.21.15.45:0/1544187438 shutdown_connections 2024-08-17T02:28:25.001 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:24.999+0000 7f45f1000640 1 -- 172.21.15.45:0/1544187438 wait complete. 2024-08-17T02:28:25.016 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.166+0000 7f299a600640 1 Processor -- start 2024-08-17T02:28:25.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.167+0000 7f299a600640 1 -- start start 2024-08-17T02:28:25.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.168+0000 7f299a600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940cbea0 0x7f2994156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.168+0000 7f299a600640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f299406dc80 0x7f29941577f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.168+0000 7f299a600640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29940cc2d0 con 0x7f2994156ad0 2024-08-17T02:28:25.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.168+0000 7f299a600640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29940ca900 con 0x7f299406dc80 2024-08-17T02:28:25.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.168+0000 7f299a600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29940cc560 con 0x7f29940cbea0 2024-08-17T02:28:25.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.168+0000 7f2999200640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2994156ad0 0x7f299406d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53334/0 (socket says 172.21.15.45:53334) 2024-08-17T02:28:25.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.168+0000 7f2999200640 1 -- 172.21.15.45:0/2350764457 learned_addr learned my addr 172.21.15.45:0/2350764457 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:25.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.168+0000 7f298be00640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940cbea0 0x7f2994156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.168+0000 7f2999c00640 1 --2- 172.21.15.45:0/2350764457 >> v2:172.21.15.169:3300/0 conn(0x7f299406dc80 0x7f29941577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782552792 0 0) 0x7f29940cc2d0 con 0x7f2994156ad0 2024-08-17T02:28:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29780034e0 con 0x7f2994156ad0 2024-08-17T02:28:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1497465637 0 0) 0x7f29780034e0 con 0x7f2994156ad0 2024-08-17T02:28:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940cbea0 msgr2=0x7f2994156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940cbea0 0x7f2994156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 >> v2:172.21.15.169:3300/0 conn(0x7f299406dc80 msgr2=0x7f29941577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 --2- 172.21.15.45:0/2350764457 >> v2:172.21.15.169:3300/0 conn(0x7f299406dc80 0x7f29941577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940caaf0 con 0x7f2994156ad0 2024-08-17T02:28:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7f2984001470 con 0x7f2994156ad0 2024-08-17T02:28:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 >> v1:172.21.15.45:6789/0 conn(0x7f2994156ad0 legacy=0x7f299406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940cbea0 0x7f2978003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2978003f80 0x7f2978004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 0x7f2978005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29940cc560 con 0x7f2978004cc0 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297800b9d0 con 0x7f2978003f80 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297800bb60 con 0x7f29940cbea0 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2999c00640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 0x7f2978005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f2999200640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940cbea0 0x7f2978003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.169+0000 7f298be00640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2978003f80 0x7f2978004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.170+0000 7f2999c00640 1 -- 172.21.15.45:0/2350764457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940cbea0 msgr2=0x7f2978003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.170+0000 7f2999c00640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940cbea0 0x7f2978003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.170+0000 7f2999c00640 1 -- 172.21.15.45:0/2350764457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2978003f80 msgr2=0x7f2978004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.170+0000 7f2999c00640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2978003f80 0x7f2978004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.170+0000 7f2999c00640 1 -- 172.21.15.45:0/2350764457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29780034e0 con 0x7f2978004cc0 2024-08-17T02:28:25.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.171+0000 7f2999c00640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 0x7f2978005130 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f298c00e210 tx=0x7f298c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2904ea6fdf63c1c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.171+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c02c040 con 0x7f2978004cc0 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.171+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00f040 con 0x7f2978004cc0 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.171+0000 7f2993e00640 1 -- 172.21.15.45:0/2350764457 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c030630 con 0x7f2978004cc0 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.172+0000 7f299a600640 1 -- 172.21.15.45:0/2350764457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 msgr2=0x7f2978005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.172+0000 7f299a600640 1 --2- 172.21.15.45:0/2350764457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 0x7f2978005130 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f298c00e210 tx=0x7f298c00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.172+0000 7f2999c00640 1 -- 172.21.15.45:0/2350764457 reap_dead start 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.172+0000 7f299a600640 1 -- 172.21.15.45:0/2350764457 shutdown_connections 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.172+0000 7f299a600640 1 -- 172.21.15.45:0/2350764457 >> 172.21.15.45:0/2350764457 conn(0x7f2994067750 msgr2=0x7f29940cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.172+0000 7f299a600640 1 -- 172.21.15.45:0/2350764457 shutdown_connections 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.172+0000 7f299a600640 1 -- 172.21.15.45:0/2350764457 wait complete. 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.173+0000 7f299a600640 1 Processor -- start 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.173+0000 7f299a600640 1 -- start start 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.174+0000 7f299a600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 0x7f299414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.174+0000 7f299a600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f299414f130 0x7f299414e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.174+0000 7f299a600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940aef10 0x7f29940af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.174+0000 7f299a600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29940af8f0 con 0x7f2978004cc0 2024-08-17T02:28:25.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.174+0000 7f299a600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2994150c80 con 0x7f299414f130 2024-08-17T02:28:25.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.174+0000 7f299a600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29941503e0 con 0x7f29940aef10 2024-08-17T02:28:25.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.175+0000 7f2999200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 0x7f299414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.175+0000 7f2999200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 0x7f299414fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53822/0 (socket says 172.21.15.45:53822) 2024-08-17T02:28:25.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.175+0000 7f2999200640 1 -- 172.21.15.45:0/1292865699 learned_addr learned my addr 172.21.15.45:0/1292865699 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:25.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.175+0000 7f2999c00640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940aef10 0x7f29940af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.175+0000 7f298be00640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f299414f130 0x7f299414e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.175+0000 7f2999200640 1 -- 172.21.15.45:0/1292865699 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940aef10 msgr2=0x7f29940af3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.175+0000 7f2999200640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940aef10 0x7f29940af3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.175+0000 7f2999200640 1 -- 172.21.15.45:0/1292865699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f299414f130 msgr2=0x7f299414e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.175+0000 7f2999200640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f299414f130 0x7f299414e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.175+0000 7f2999200640 1 -- 172.21.15.45:0/1292865699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29941506c0 con 0x7f2978004cc0 2024-08-17T02:28:25.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.175+0000 7f2999200640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 0x7f299414fd50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2984004ad0 tx=0x7f29940cac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.176+0000 7f2990c00640 1 -- 172.21.15.45:0/1292865699 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298400fa90 con 0x7f2978004cc0 2024-08-17T02:28:25.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.176+0000 7f2990c00640 1 -- 172.21.15.45:0/1292865699 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298400fc10 con 0x7f2978004cc0 2024-08-17T02:28:25.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.176+0000 7f2990c00640 1 -- 172.21.15.45:0/1292865699 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29840133f0 con 0x7f2978004cc0 2024-08-17T02:28:25.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.176+0000 7f299a600640 1 -- 172.21.15.45:0/1292865699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29941509a0 con 0x7f2978004cc0 2024-08-17T02:28:25.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.176+0000 7f299a600640 1 -- 172.21.15.45:0/1292865699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299414f930 con 0x7f2978004cc0 2024-08-17T02:28:25.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.177+0000 7f299a600640 1 -- 172.21.15.45:0/1292865699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29941550d0 con 0x7f2978004cc0 2024-08-17T02:28:25.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.178+0000 7f2990c00640 1 -- 172.21.15.45:0/1292865699 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2984013760 con 0x7f2978004cc0 2024-08-17T02:28:25.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.178+0000 7f2990c00640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2970065180 0x7f2970067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.178+0000 7f2990c00640 1 -- 172.21.15.45:0/1292865699 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f2984082bb0 con 0x7f2978004cc0 2024-08-17T02:28:25.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.179+0000 7f298be00640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2970065180 0x7f2970067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.179+0000 7f298be00640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2970065180 0x7f2970067630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f29940b0700 tx=0x7f297c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.182+0000 7f2990c00640 1 -- 172.21.15.45:0/1292865699 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f29941550d0 con 0x7f2978004cc0 2024-08-17T02:28:25.367 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.366+0000 7f299a600640 1 -- 172.21.15.45:0/1292865699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29941550d0 con 0x7f2978004cc0 2024-08-17T02:28:25.368 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.367+0000 7f2990c00640 1 -- 172.21.15.45:0/1292865699 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18599 (secure 0 0 0) 0x7f29941550d0 con 0x7f2978004cc0 2024-08-17T02:28:25.368 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:25.369 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:26:22.268229+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:04.691522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:05.604365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000631254.meta","create_time":"2024-08-17T02:26:17.444576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000631254"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000631254.data","create_time":"2024-08-17T02:26:18.306012+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000631254"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.369+0000 7f299a600640 1 -- 172.21.15.45:0/1292865699 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2970065180 msgr2=0x7f2970067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.369+0000 7f299a600640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2970065180 0x7f2970067630 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f29940b0700 tx=0x7f297c008040 comp rx=0 tx=0).stop 2024-08-17T02:28:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.369+0000 7f299a600640 1 -- 172.21.15.45:0/1292865699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 msgr2=0x7f299414fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.369+0000 7f299a600640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 0x7f299414fd50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2984004ad0 tx=0x7f29940cac80 comp rx=0 tx=0).stop 2024-08-17T02:28:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.370+0000 7f299a600640 1 -- 172.21.15.45:0/1292865699 shutdown_connections 2024-08-17T02:28:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.370+0000 7f299a600640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2970065180 0x7f2970067630 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.370+0000 7f299a600640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f29940aef10 0x7f29940af3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.370+0000 7f299a600640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f299414f130 0x7f299414e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.370+0000 7f299a600640 1 --2- 172.21.15.45:0/1292865699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2978004cc0 0x7f299414fd50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.370+0000 7f299a600640 1 -- 172.21.15.45:0/1292865699 >> 172.21.15.45:0/1292865699 conn(0x7f2994067750 msgr2=0x7f2994155430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.370+0000 7f299a600640 1 -- 172.21.15.45:0/1292865699 shutdown_connections 2024-08-17T02:28:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.370+0000 7f299a600640 1 -- 172.21.15.45:0/1292865699 wait complete. 2024-08-17T02:28:25.386 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:28:25.386 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:25.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.536+0000 7f1ab3c00640 1 Processor -- start 2024-08-17T02:28:25.537 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.536+0000 7f1ab3c00640 1 -- start start 2024-08-17T02:28:25.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.537+0000 7f1ab3c00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1aac15a090 0x7f1aac0aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.537+0000 7f1ab3c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac0afb50 con 0x7f1aac158cb0 2024-08-17T02:28:25.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.537+0000 7f1ab3c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac0abc80 con 0x7f1aac0af6d0 2024-08-17T02:28:25.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.537+0000 7f1ab3c00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac0aae50 con 0x7f1aac15a090 2024-08-17T02:28:25.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.537+0000 7f1ab1200640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1aac158cb0 0x7f1aac0ac110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53346/0 (socket says 172.21.15.45:53346) 2024-08-17T02:28:25.538 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.537+0000 7f1ab1200640 1 -- 172.21.15.45:0/484607405 learned_addr learned my addr 172.21.15.45:0/484607405 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:25.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.538+0000 7f1ab1c00640 1 --2- 172.21.15.45:0/484607405 >> v2:172.21.15.169:3300/0 conn(0x7f1aac15a090 0x7f1aac0aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.538+0000 7f1aab400640 1 -- 172.21.15.45:0/484607405 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248259349 0 0) 0x7f1aa0001110 con 0x7f1aac158cb0 2024-08-17T02:28:25.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.538+0000 7f1aab400640 1 -- 172.21.15.45:0/484607405 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a940034e0 con 0x7f1aac158cb0 2024-08-17T02:28:25.539 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.538+0000 7f1ab1c00640 1 -- 172.21.15.45:0/484607405 >> v1:172.21.15.169:6789/0 conn(0x7f1aac0af6d0 legacy=0x7f1aac0ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.538+0000 7f1ab1c00640 1 -- 172.21.15.45:0/484607405 >> v1:172.21.15.45:6789/0 conn(0x7f1aac158cb0 legacy=0x7f1aac0ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.538+0000 7f1ab1c00640 1 -- 172.21.15.45:0/484607405 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0ab070 con 0x7f1aac15a090 2024-08-17T02:28:25.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.539+0000 7f1ab1c00640 1 --2- 172.21.15.45:0/484607405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aac15a090 0x7f1aac0aa910 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009e60 tx=0x7f1aa4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b1cc7b8308592b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.540 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.540+0000 7f1aab400640 1 -- 172.21.15.45:0/484607405 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4007550 con 0x7f1aac15a090 2024-08-17T02:28:25.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.540+0000 7f1aab400640 1 -- 172.21.15.45:0/484607405 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa402d050 con 0x7f1aac15a090 2024-08-17T02:28:25.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.540+0000 7f1aab400640 1 -- 172.21.15.45:0/484607405 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4007900 con 0x7f1aac15a090 2024-08-17T02:28:25.541 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.540+0000 7f1ab3c00640 1 -- 172.21.15.45:0/484607405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aac15a090 msgr2=0x7f1aac0aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.540+0000 7f1ab3c00640 1 --2- 172.21.15.45:0/484607405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aac15a090 0x7f1aac0aa910 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009e60 tx=0x7f1aa4009780 comp rx=0 tx=0).stop 2024-08-17T02:28:25.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.541+0000 7f1ab3c00640 1 -- 172.21.15.45:0/484607405 shutdown_connections 2024-08-17T02:28:25.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.541+0000 7f1ab3c00640 1 --2- 172.21.15.45:0/484607405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aac15a090 0x7f1aac0aa910 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.541+0000 7f1ab3c00640 1 -- 172.21.15.45:0/484607405 >> 172.21.15.45:0/484607405 conn(0x7f1aac096a70 msgr2=0x7f1aac096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.541+0000 7f1ab3c00640 1 -- 172.21.15.45:0/484607405 shutdown_connections 2024-08-17T02:28:25.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.541+0000 7f1ab3c00640 1 -- 172.21.15.45:0/484607405 wait complete. 2024-08-17T02:28:25.542 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.542+0000 7f1ab3c00640 1 Processor -- start 2024-08-17T02:28:25.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.542+0000 7f1ab3c00640 1 -- start start 2024-08-17T02:28:25.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.543+0000 7f1ab3c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1aac0af6d0 0x7f1aac1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.543+0000 7f1ab3c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aac158cb0 0x7f1aac1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.544 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.543+0000 7f1ab3c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aac15a090 0x7f1aac14d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.543+0000 7f1ab3c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac14f680 con 0x7f1aac0af6d0 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.543+0000 7f1ab3c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac154b20 con 0x7f1aac15a090 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.543+0000 7f1ab3c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac14f8d0 con 0x7f1aac158cb0 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.543+0000 7f1ab1200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1aac0af6d0 0x7f1aac1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.543+0000 7f1ab1200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1aac0af6d0 0x7f1aac1523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53836/0 (socket says 172.21.15.45:53836) 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.543+0000 7f1ab1200640 1 -- 172.21.15.45:0/3991233674 learned_addr learned my addr 172.21.15.45:0/3991233674 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.543+0000 7f1aabe00640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aac158cb0 0x7f1aac1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.543+0000 7f1ab1c00640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aac15a090 0x7f1aac14d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.544+0000 7f1ab1200640 1 -- 172.21.15.45:0/3991233674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aac158cb0 msgr2=0x7f1aac1540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.544+0000 7f1ab1200640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aac158cb0 0x7f1aac1540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.544+0000 7f1ab1200640 1 -- 172.21.15.45:0/3991233674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aac15a090 msgr2=0x7f1aac14d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.544+0000 7f1ab1200640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aac15a090 0x7f1aac14d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.544+0000 7f1ab1200640 1 -- 172.21.15.45:0/3991233674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa4009a20 con 0x7f1aac0af6d0 2024-08-17T02:28:25.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.544+0000 7f1ab1200640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1aac0af6d0 0x7f1aac1523f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000c7c0 tx=0x7f1aa0007be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.544+0000 7f1a9fe00640 1 -- 172.21.15.45:0/3991233674 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa000ce90 con 0x7f1aac0af6d0 2024-08-17T02:28:25.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.544+0000 7f1a9fe00640 1 -- 172.21.15.45:0/3991233674 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa0005870 con 0x7f1aac0af6d0 2024-08-17T02:28:25.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.544+0000 7f1a9fe00640 1 -- 172.21.15.45:0/3991233674 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa0005c90 con 0x7f1aac0af6d0 2024-08-17T02:28:25.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.544+0000 7f1ab3c00640 1 -- 172.21.15.45:0/3991233674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac14fbb0 con 0x7f1aac0af6d0 2024-08-17T02:28:25.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.545+0000 7f1ab3c00640 1 -- 172.21.15.45:0/3991233674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac152930 con 0x7f1aac0af6d0 2024-08-17T02:28:25.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.546+0000 7f1ab3c00640 1 -- 172.21.15.45:0/3991233674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac064db0 con 0x7f1aac0af6d0 2024-08-17T02:28:25.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.546+0000 7f1a9fe00640 1 -- 172.21.15.45:0/3991233674 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1aa0007300 con 0x7f1aac0af6d0 2024-08-17T02:28:25.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.547+0000 7f1a9fe00640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1a8c065150 0x7f1a8c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.547+0000 7f1a9fe00640 1 -- 172.21.15.45:0/3991233674 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f1aa0082070 con 0x7f1aac0af6d0 2024-08-17T02:28:25.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.547+0000 7f1aabe00640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1a8c065150 0x7f1a8c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.548+0000 7f1aabe00640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1a8c065150 0x7f1a8c067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1aac14f610 tx=0x7f1a98007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.551+0000 7f1a9fe00640 1 -- 172.21.15.45:0/3991233674 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1aa004fe40 con 0x7f1aac0af6d0 2024-08-17T02:28:25.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.770+0000 7f1ab3c00640 1 -- 172.21.15.45:0/3991233674 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1aac0afb50 con 0x7f1aac0af6d0 2024-08-17T02:28:25.772 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.771+0000 7f1a9fe00640 1 -- 172.21.15.45:0/3991233674 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5684 (secure 0 0 0) 0x7f1aac0afb50 con 0x7f1aac0af6d0 2024-08-17T02:28:25.772 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:25.772 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2570743735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2570743735},{"type":"v1","addr":"172.21.15.169:6834","nonce":2570743735}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1704272549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1704272549},{"type":"v1","addr":"172.21.15.169:6835","nonce":1704272549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:06.620196+0000","modified":"2024-08-17T02:26:10.215482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6836/618002034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":618002034},{"type":"v1","addr":"172.21.15.45:6836","nonce":618002034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:19.270401+0000","modified":"2024-08-17T02:26:20.776150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6837/569206503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":569206503},{"type":"v1","addr":"172.21.15.45:6837","nonce":569206503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000631254","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:25.773 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 20 2024-08-17T02:28:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 -- 172.21.15.45:0/3991233674 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1a8c065150 msgr2=0x7f1a8c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1a8c065150 0x7f1a8c067600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1aac14f610 tx=0x7f1a98007e30 comp rx=0 tx=0).stop 2024-08-17T02:28:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 -- 172.21.15.45:0/3991233674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1aac0af6d0 msgr2=0x7f1aac1523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1aac0af6d0 0x7f1aac1523f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1aa000c7c0 tx=0x7f1aa0007be0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 -- 172.21.15.45:0/3991233674 shutdown_connections 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1aac15a090 0x7f1aac14d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1a8c065150 0x7f1a8c067600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1aac158cb0 0x7f1aac1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 --2- 172.21.15.45:0/3991233674 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1aac0af6d0 0x7f1aac1523f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 -- 172.21.15.45:0/3991233674 >> 172.21.15.45:0/3991233674 conn(0x7f1aac096a70 msgr2=0x7f1aac067da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 -- 172.21.15.45:0/3991233674 shutdown_connections 2024-08-17T02:28:25.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.773+0000 7f1ab3c00640 1 -- 172.21.15.45:0/3991233674 wait complete. 2024-08-17T02:28:25.789 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:25.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.941+0000 7f183ce00640 1 Processor -- start 2024-08-17T02:28:25.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.941+0000 7f183ce00640 1 -- start start 2024-08-17T02:28:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.942+0000 7f183ce00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f18380d08d0 0x7f18380c68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.942+0000 7f183ce00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18380cb340 0x7f18381590b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.942+0000 7f183ce00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18380cb7c0 con 0x7f1838158ce0 2024-08-17T02:28:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.942+0000 7f183ce00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18380cf0c0 con 0x7f18380d08d0 2024-08-17T02:28:25.944 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.942+0000 7f183ce00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1838089000 con 0x7f18380cb340 2024-08-17T02:28:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.942+0000 7f1835e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1838158ce0 0x7f18380cac30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53360/0 (socket says 172.21.15.45:53360) 2024-08-17T02:28:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.943+0000 7f1835e00640 1 -- 172.21.15.45:0/1669493079 learned_addr learned my addr 172.21.15.45:0/1669493079 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.943+0000 7f1835400640 1 --2- 172.21.15.45:0/1669493079 >> v2:172.21.15.169:3300/0 conn(0x7f18380d08d0 0x7f18380c68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.943+0000 7f1836800640 1 --2- 172.21.15.45:0/1669493079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18380cb340 0x7f18381590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.943+0000 7f1834a00640 1 -- 172.21.15.45:0/1669493079 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122014279 0 0) 0x7f18380cb7c0 con 0x7f1838158ce0 2024-08-17T02:28:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.943+0000 7f1834a00640 1 -- 172.21.15.45:0/1669493079 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f181c0034e0 con 0x7f1838158ce0 2024-08-17T02:28:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.943+0000 7f1836800640 1 -- 172.21.15.45:0/1669493079 >> v2:172.21.15.169:3300/0 conn(0x7f18380d08d0 msgr2=0x7f18380c68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.943+0000 7f1836800640 1 --2- 172.21.15.45:0/1669493079 >> v2:172.21.15.169:3300/0 conn(0x7f18380d08d0 0x7f18380c68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.943+0000 7f1836800640 1 -- 172.21.15.45:0/1669493079 >> v1:172.21.15.45:6789/0 conn(0x7f1838158ce0 legacy=0x7f18380cac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.943+0000 7f1836800640 1 -- 172.21.15.45:0/1669493079 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18380ceb20 con 0x7f18380cb340 2024-08-17T02:28:25.945 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.943+0000 7f1835400640 1 --2- 172.21.15.45:0/1669493079 >> v2:172.21.15.169:3300/0 conn(0x7f18380d08d0 0x7f18380c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:25.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.944+0000 7f1836800640 1 --2- 172.21.15.45:0/1669493079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18380cb340 0x7f18381590b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1830009e60 tx=0x7f1830009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9635720cc50926d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.946 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.945+0000 7f1834a00640 1 -- 172.21.15.45:0/1669493079 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830007550 con 0x7f18380cb340 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.945+0000 7f1834a00640 1 -- 172.21.15.45:0/1669493079 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183002d050 con 0x7f18380cb340 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.945+0000 7f1834a00640 1 -- 172.21.15.45:0/1669493079 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18300078c0 con 0x7f18380cb340 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.945+0000 7f183ce00640 1 -- 172.21.15.45:0/1669493079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18380cb340 msgr2=0x7f18381590b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.945+0000 7f183ce00640 1 --2- 172.21.15.45:0/1669493079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18380cb340 0x7f18381590b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1830009e60 tx=0x7f1830009780 comp rx=0 tx=0).stop 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.945+0000 7f183ce00640 1 -- 172.21.15.45:0/1669493079 shutdown_connections 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.945+0000 7f183ce00640 1 --2- 172.21.15.45:0/1669493079 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18380cb340 0x7f18381590b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.945+0000 7f183ce00640 1 --2- 172.21.15.45:0/1669493079 >> v2:172.21.15.169:3300/0 conn(0x7f18380d08d0 0x7f18380c68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.945+0000 7f183ce00640 1 -- 172.21.15.45:0/1669493079 >> 172.21.15.45:0/1669493079 conn(0x7f18380cfdc0 msgr2=0x7f18380d01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.946+0000 7f183ce00640 1 -- 172.21.15.45:0/1669493079 shutdown_connections 2024-08-17T02:28:25.947 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.946+0000 7f183ce00640 1 -- 172.21.15.45:0/1669493079 wait complete. 2024-08-17T02:28:25.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.947+0000 7f183ce00640 1 Processor -- start 2024-08-17T02:28:25.948 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.947+0000 7f183ce00640 1 -- start start 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.948+0000 7f183ce00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18380cb340 0x7f1838168600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.948+0000 7f183ce00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18380d08d0 0x7f1838169640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.948+0000 7f183ce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1838158ce0 0x7f183815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.948+0000 7f183ce00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18380c9c90 con 0x7f1838158ce0 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.948+0000 7f183ce00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183815a1a0 con 0x7f18380d08d0 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.948+0000 7f183ce00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1838169b80 con 0x7f18380cb340 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.948+0000 7f1836800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1838158ce0 0x7f183815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.948+0000 7f1836800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1838158ce0 0x7f183815af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53842/0 (socket says 172.21.15.45:53842) 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.948+0000 7f1836800640 1 -- 172.21.15.45:0/3421708312 learned_addr learned my addr 172.21.15.45:0/3421708312 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.948+0000 7f1835400640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18380d08d0 0x7f1838169640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.948+0000 7f1835e00640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18380cb340 0x7f1838168600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.950 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.949+0000 7f1836800640 1 -- 172.21.15.45:0/3421708312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18380cb340 msgr2=0x7f1838168600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.949+0000 7f1836800640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18380cb340 0x7f1838168600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.949+0000 7f1836800640 1 -- 172.21.15.45:0/3421708312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18380d08d0 msgr2=0x7f1838169640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.949+0000 7f1836800640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18380d08d0 0x7f1838169640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.949+0000 7f1836800640 1 -- 172.21.15.45:0/3421708312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1824009390 con 0x7f1838158ce0 2024-08-17T02:28:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.949+0000 7f1836800640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1838158ce0 0x7f183815af80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f18300097c0 tx=0x7f1830037000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.949+0000 7f182d600640 1 -- 172.21.15.45:0/3421708312 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830041070 con 0x7f1838158ce0 2024-08-17T02:28:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.949+0000 7f182d600640 1 -- 172.21.15.45:0/3421708312 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1830031ac0 con 0x7f1838158ce0 2024-08-17T02:28:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.949+0000 7f183ce00640 1 -- 172.21.15.45:0/3421708312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1830009a20 con 0x7f1838158ce0 2024-08-17T02:28:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.949+0000 7f182d600640 1 -- 172.21.15.45:0/3421708312 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1830031e60 con 0x7f1838158ce0 2024-08-17T02:28:25.951 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.949+0000 7f183ce00640 1 -- 172.21.15.45:0/3421708312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1838159870 con 0x7f1838158ce0 2024-08-17T02:28:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.951+0000 7f183ce00640 1 -- 172.21.15.45:0/3421708312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183815a350 con 0x7f1838158ce0 2024-08-17T02:28:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.951+0000 7f182d600640 1 -- 172.21.15.45:0/3421708312 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1830003040 con 0x7f1838158ce0 2024-08-17T02:28:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.952+0000 7f182d600640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1818065150 0x7f1818067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.952+0000 7f182d600640 1 -- 172.21.15.45:0/3421708312 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f18300a3640 con 0x7f1838158ce0 2024-08-17T02:28:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.952+0000 7f1835e00640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1818065150 0x7f1818067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.953+0000 7f1835e00640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1818065150 0x7f1818067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1828005840 tx=0x7f1828009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:25.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:25.957+0000 7f182d600640 1 -- 172.21.15.45:0/3421708312 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f183815a350 con 0x7f1838158ce0 2024-08-17T02:28:26.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.180+0000 7f183ce00640 1 -- 172.21.15.45:0/3421708312 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1838064de0 con 0x7f1838158ce0 2024-08-17T02:28:26.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.180+0000 7f182d600640 1 -- 172.21.15.45:0/3421708312 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+5684 (secure 0 0 0) 0x7f1830071390 con 0x7f1838158ce0 2024-08-17T02:28:26.181 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:26.181 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":20,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2570743735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2570743735},{"type":"v1","addr":"172.21.15.169:6834","nonce":2570743735}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1704272549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1704272549},{"type":"v1","addr":"172.21.15.169:6835","nonce":1704272549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:06.620196+0000","modified":"2024-08-17T02:26:10.215482+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4926},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4926":{"gid":4926,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6836/618002034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":618002034},{"type":"v1","addr":"172.21.15.45:6836","nonce":618002034}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:19.270401+0000","modified":"2024-08-17T02:26:20.776150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6837/569206503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":569206503},{"type":"v1","addr":"172.21.15.45:6837","nonce":569206503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000631254","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:26.182 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 20 2024-08-17T02:28:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 -- 172.21.15.45:0/3421708312 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1818065150 msgr2=0x7f1818067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1818065150 0x7f1818067600 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1828005840 tx=0x7f1828009040 comp rx=0 tx=0).stop 2024-08-17T02:28:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 -- 172.21.15.45:0/3421708312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1838158ce0 msgr2=0x7f183815af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1838158ce0 0x7f183815af80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f18300097c0 tx=0x7f1830037000 comp rx=0 tx=0).stop 2024-08-17T02:28:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 -- 172.21.15.45:0/3421708312 shutdown_connections 2024-08-17T02:28:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1838158ce0 0x7f183815af80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f18380d08d0 0x7f1838169640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1818065150 0x7f1818067600 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 --2- 172.21.15.45:0/3421708312 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f18380cb340 0x7f1838168600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 -- 172.21.15.45:0/3421708312 >> 172.21.15.45:0/3421708312 conn(0x7f18380cfdc0 msgr2=0x7f1838068e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 -- 172.21.15.45:0/3421708312 shutdown_connections 2024-08-17T02:28:26.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.183+0000 7f183ce00640 1 -- 172.21.15.45:0/3421708312 wait complete. 2024-08-17T02:28:26.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:26.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.349+0000 7f8227e00640 1 Processor -- start 2024-08-17T02:28:26.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.349+0000 7f8227e00640 1 -- start start 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.350+0000 7f8227e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82280cc010 0x7f82280ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.350+0000 7f8227e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f822815c7c0 0x7f822815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.350+0000 7f8227e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82280ab950 con 0x7f82280a98e0 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.350+0000 7f8227e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f822815d110 con 0x7f82280cc010 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.350+0000 7f8227e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82280abc30 con 0x7f822815c7c0 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.350+0000 7f8226a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82280cc010 0x7f82280ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.350+0000 7f8226a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82280cc010 0x7f82280ab2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53858/0 (socket says 172.21.15.45:53858) 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.350+0000 7f8226a00640 1 -- 172.21.15.45:0/3625072856 learned_addr learned my addr 172.21.15.45:0/3625072856 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.350+0000 7f8227400640 1 --2- 172.21.15.45:0/3625072856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f822815c7c0 0x7f822815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.351+0000 7f8226a00640 1 -- 172.21.15.45:0/3625072856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f822815c7c0 msgr2=0x7f822815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.351+0000 7f8226a00640 1 --2- 172.21.15.45:0/3625072856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f822815c7c0 0x7f822815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.351+0000 7f8226a00640 1 -- 172.21.15.45:0/3625072856 >> v1:172.21.15.45:6789/0 conn(0x7f82280a98e0 legacy=0x7f82280afe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.351+0000 7f8226a00640 1 -- 172.21.15.45:0/3625072856 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82280abf10 con 0x7f82280cc010 2024-08-17T02:28:26.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.352+0000 7f8226a00640 1 --2- 172.21.15.45:0/3625072856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280cc010 0x7f82280ab2b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8218009910 tx=0x7f82180091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee221fbecc1fb09d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.352+0000 7f8226000640 1 -- 172.21.15.45:0/3625072856 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821802add0 con 0x7f82280cc010 2024-08-17T02:28:26.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.352+0000 7f8226000640 1 -- 172.21.15.45:0/3625072856 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8218032440 con 0x7f82280cc010 2024-08-17T02:28:26.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.352+0000 7f8226000640 1 -- 172.21.15.45:0/3625072856 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8218032820 con 0x7f82280cc010 2024-08-17T02:28:26.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.352+0000 7f8227e00640 1 -- 172.21.15.45:0/3625072856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280cc010 msgr2=0x7f82280ab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.352+0000 7f8227e00640 1 --2- 172.21.15.45:0/3625072856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280cc010 0x7f82280ab2b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8218009910 tx=0x7f82180091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.353+0000 7f8227e00640 1 -- 172.21.15.45:0/3625072856 shutdown_connections 2024-08-17T02:28:26.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.353+0000 7f8227e00640 1 --2- 172.21.15.45:0/3625072856 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f822815c7c0 0x7f822815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.353+0000 7f8227e00640 1 --2- 172.21.15.45:0/3625072856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82280cc010 0x7f82280ab2b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.353+0000 7f8227e00640 1 -- 172.21.15.45:0/3625072856 >> 172.21.15.45:0/3625072856 conn(0x7f8228067de0 msgr2=0x7f82280681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.353+0000 7f8227e00640 1 -- 172.21.15.45:0/3625072856 shutdown_connections 2024-08-17T02:28:26.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.353+0000 7f8227e00640 1 -- 172.21.15.45:0/3625072856 wait complete. 2024-08-17T02:28:26.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.354+0000 7f8227e00640 1 Processor -- start 2024-08-17T02:28:26.355 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.354+0000 7f8227e00640 1 -- start start 2024-08-17T02:28:26.360 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.355+0000 7f8227e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82280a98e0 0x7f8228156720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.355+0000 7f8227e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82280cc010 0x7f82280c2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.355+0000 7f8227e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f822815c7c0 0x7f82280c2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.355+0000 7f8227e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822815a2b0 con 0x7f822815c7c0 2024-08-17T02:28:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.355+0000 7f8227e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822815ac00 con 0x7f82280a98e0 2024-08-17T02:28:26.361 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.355+0000 7f8227e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8228159fd0 con 0x7f82280cc010 2024-08-17T02:28:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.355+0000 7f8227400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f822815c7c0 0x7f82280c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.355+0000 7f8227400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f822815c7c0 0x7f82280c2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53872/0 (socket says 172.21.15.45:53872) 2024-08-17T02:28:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.356+0000 7f8227400640 1 -- 172.21.15.45:0/2814622249 learned_addr learned my addr 172.21.15.45:0/2814622249 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.356+0000 7f8226a00640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82280a98e0 0x7f8228156720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.356+0000 7f821fe00640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82280cc010 0x7f82280c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.356+0000 7f8227400640 1 -- 172.21.15.45:0/2814622249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82280cc010 msgr2=0x7f82280c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.356+0000 7f8227400640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82280cc010 0x7f82280c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.356+0000 7f8227400640 1 -- 172.21.15.45:0/2814622249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82280a98e0 msgr2=0x7f8228156720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.356+0000 7f8227400640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82280a98e0 0x7f8228156720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.356+0000 7f8227400640 1 -- 172.21.15.45:0/2814622249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8218009450 con 0x7f822815c7c0 2024-08-17T02:28:26.363 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.356+0000 7f8226a00640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82280a98e0 0x7f8228156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:26.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.356+0000 7f8227400640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f822815c7c0 0x7f82280c2670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8220007f20 tx=0x7f8220009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.356+0000 7f821e000640 1 -- 172.21.15.45:0/2814622249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822000ee30 con 0x7f822815c7c0 2024-08-17T02:28:26.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.357+0000 7f821e000640 1 -- 172.21.15.45:0/2814622249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8220014420 con 0x7f822815c7c0 2024-08-17T02:28:26.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.357+0000 7f8227e00640 1 -- 172.21.15.45:0/2814622249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f822815a5b0 con 0x7f822815c7c0 2024-08-17T02:28:26.364 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.357+0000 7f821e000640 1 -- 172.21.15.45:0/2814622249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82200147e0 con 0x7f822815c7c0 2024-08-17T02:28:26.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.357+0000 7f8227e00640 1 -- 172.21.15.45:0/2814622249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822816a740 con 0x7f822815c7c0 2024-08-17T02:28:26.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.358+0000 7f8227e00640 1 -- 172.21.15.45:0/2814622249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f822815a410 con 0x7f822815c7c0 2024-08-17T02:28:26.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.359+0000 7f821e000640 1 -- 172.21.15.45:0/2814622249 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f8220014b50 con 0x7f822815c7c0 2024-08-17T02:28:26.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.359+0000 7f821e000640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8204065150 0x7f8204067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.360+0000 7f821e000640 1 -- 172.21.15.45:0/2814622249 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f8220082f10 con 0x7f822815c7c0 2024-08-17T02:28:26.365 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.360+0000 7f8226a00640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8204065150 0x7f8204067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.360+0000 7f8226a00640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8204065150 0x7f8204067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8218034000 tx=0x7f8218032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.366 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.363+0000 7f821e000640 1 -- 172.21.15.45:0/2814622249 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f822815a410 con 0x7f822815c7c0 2024-08-17T02:28:26.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.546+0000 7f8227e00640 1 -- 172.21.15.45:0/2814622249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f822815a410 con 0x7f822815c7c0 2024-08-17T02:28:26.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.547+0000 7f821e000640 1 -- 172.21.15.45:0/2814622249 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+18599 (secure 0 0 0) 0x7f822815a410 con 0x7f822815c7c0 2024-08-17T02:28:26.549 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:26.549 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:26:22.268229+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-08-17T02:26:04.691522+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-08-17T02:26:05.604365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":6,"pool_name":"cephfs.volume_0000000000631254.meta","create_time":"2024-08-17T02:26:17.444576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000631254"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000631254.data","create_time":"2024-08-17T02:26:18.306012+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000631254"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:26.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 -- 172.21.15.45:0/2814622249 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8204065150 msgr2=0x7f8204067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8204065150 0x7f8204067600 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8218034000 tx=0x7f8218032000 comp rx=0 tx=0).stop 2024-08-17T02:28:26.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 -- 172.21.15.45:0/2814622249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f822815c7c0 msgr2=0x7f82280c2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f822815c7c0 0x7f82280c2670 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8220007f20 tx=0x7f8220009860 comp rx=0 tx=0).stop 2024-08-17T02:28:26.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 -- 172.21.15.45:0/2814622249 shutdown_connections 2024-08-17T02:28:26.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f822815c7c0 0x7f82280c2670 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f8204065150 0x7f8204067600 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f82280cc010 0x7f82280c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 --2- 172.21.15.45:0/2814622249 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f82280a98e0 0x7f8228156720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 -- 172.21.15.45:0/2814622249 >> 172.21.15.45:0/2814622249 conn(0x7f8228067de0 msgr2=0x7f822806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 -- 172.21.15.45:0/2814622249 shutdown_connections 2024-08-17T02:28:26.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.550+0000 7f8227e00640 1 -- 172.21.15.45:0/2814622249 wait complete. 2024-08-17T02:28:26.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-08-17T02:28:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.719+0000 7f4199600640 1 Processor -- start 2024-08-17T02:28:26.720 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.720+0000 7f4199600640 1 -- start start 2024-08-17T02:28:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.721+0000 7f4199600640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f41940aec80 0x7f41940ad010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.721 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.721+0000 7f4199600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41940abfe0 0x7f41940ad550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.721+0000 7f4199600640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41940aab40 con 0x7f4194154760 2024-08-17T02:28:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.721+0000 7f4199600640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4194154b30 con 0x7f41940aec80 2024-08-17T02:28:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.721+0000 7f4199600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41940b08a0 con 0x7f41940abfe0 2024-08-17T02:28:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.721+0000 7f4193e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4194154760 0x7f41940ae570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53380/0 (socket says 172.21.15.45:53380) 2024-08-17T02:28:26.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.721+0000 7f4193e00640 1 -- 172.21.15.45:0/3790246637 learned_addr learned my addr 172.21.15.45:0/3790246637 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.721+0000 7f4198c00640 1 --2- 172.21.15.45:0/3790246637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41940abfe0 0x7f41940ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.721+0000 7f418be00640 1 --2- 172.21.15.45:0/3790246637 >> v2:172.21.15.169:3300/0 conn(0x7f41940aec80 0x7f41940ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.721+0000 7f4193400640 1 -- 172.21.15.45:0/3790246637 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150790013 0 0) 0x7f41940aab40 con 0x7f4194154760 2024-08-17T02:28:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.722+0000 7f4193400640 1 -- 172.21.15.45:0/3790246637 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41780034e0 con 0x7f4194154760 2024-08-17T02:28:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.722+0000 7f4198c00640 1 -- 172.21.15.45:0/3790246637 >> v2:172.21.15.169:3300/0 conn(0x7f41940aec80 msgr2=0x7f41940ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.722+0000 7f4198c00640 1 --2- 172.21.15.45:0/3790246637 >> v2:172.21.15.169:3300/0 conn(0x7f41940aec80 0x7f41940ad010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.722+0000 7f4198c00640 1 -- 172.21.15.45:0/3790246637 >> v1:172.21.15.45:6789/0 conn(0x7f4194154760 legacy=0x7f41940ae570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.722+0000 7f4198c00640 1 -- 172.21.15.45:0/3790246637 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41940ae320 con 0x7f41940abfe0 2024-08-17T02:28:26.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.723+0000 7f4198c00640 1 --2- 172.21.15.45:0/3790246637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41940abfe0 0x7f41940ad550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f418c009e60 tx=0x7f418c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d992b89af8ef660 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.723+0000 7f4193400640 1 -- 172.21.15.45:0/3790246637 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c007550 con 0x7f41940abfe0 2024-08-17T02:28:26.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.723+0000 7f4193400640 1 -- 172.21.15.45:0/3790246637 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c02d050 con 0x7f41940abfe0 2024-08-17T02:28:26.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.723+0000 7f4193400640 1 -- 172.21.15.45:0/3790246637 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c007920 con 0x7f41940abfe0 2024-08-17T02:28:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.724+0000 7f4199600640 1 -- 172.21.15.45:0/3790246637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41940abfe0 msgr2=0x7f41940ad550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.724+0000 7f4199600640 1 --2- 172.21.15.45:0/3790246637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41940abfe0 0x7f41940ad550 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f418c009e60 tx=0x7f418c009780 comp rx=0 tx=0).stop 2024-08-17T02:28:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.724+0000 7f4199600640 1 -- 172.21.15.45:0/3790246637 shutdown_connections 2024-08-17T02:28:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.724+0000 7f4199600640 1 --2- 172.21.15.45:0/3790246637 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f41940abfe0 0x7f41940ad550 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.724+0000 7f4199600640 1 --2- 172.21.15.45:0/3790246637 >> v2:172.21.15.169:3300/0 conn(0x7f41940aec80 0x7f41940ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.724+0000 7f4199600640 1 -- 172.21.15.45:0/3790246637 >> 172.21.15.45:0/3790246637 conn(0x7f4194096a70 msgr2=0x7f4194096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.724+0000 7f4199600640 1 -- 172.21.15.45:0/3790246637 shutdown_connections 2024-08-17T02:28:26.725 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.724+0000 7f4199600640 1 -- 172.21.15.45:0/3790246637 wait complete. 2024-08-17T02:28:26.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.725+0000 7f4199600640 1 Processor -- start 2024-08-17T02:28:26.726 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.725+0000 7f4199600640 1 -- start start 2024-08-17T02:28:26.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.726+0000 7f4199600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41940abfe0 0x7f41940b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.727 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.726+0000 7f4199600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41940aec80 0x7f419414da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.726+0000 7f4199600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4194154760 0x7f41940b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.726+0000 7f4199600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419414ca70 con 0x7f41940aec80 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.726+0000 7f4199600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41940b1c50 con 0x7f41940abfe0 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.726+0000 7f4199600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419414cc80 con 0x7f4194154760 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.726+0000 7f418be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41940aec80 0x7f419414da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.726+0000 7f418be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41940aec80 0x7f419414da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53880/0 (socket says 172.21.15.45:53880) 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.726+0000 7f418be00640 1 -- 172.21.15.45:0/2179580627 learned_addr learned my addr 172.21.15.45:0/2179580627 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f4198c00640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4194154760 0x7f41940b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f4193e00640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41940abfe0 0x7f41940b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f418be00640 1 -- 172.21.15.45:0/2179580627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4194154760 msgr2=0x7f41940b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f418be00640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4194154760 0x7f41940b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f418be00640 1 -- 172.21.15.45:0/2179580627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41940abfe0 msgr2=0x7f41940b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f418be00640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41940abfe0 0x7f41940b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f418be00640 1 -- 172.21.15.45:0/2179580627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c009a20 con 0x7f41940aec80 2024-08-17T02:28:26.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f418be00640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41940aec80 0x7f419414da40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f417c009fd0 tx=0x7f417c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f418b400640 1 -- 172.21.15.45:0/2179580627 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00c940 con 0x7f41940aec80 2024-08-17T02:28:26.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f418b400640 1 -- 172.21.15.45:0/2179580627 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c00caa0 con 0x7f41940aec80 2024-08-17T02:28:26.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f4199600640 1 -- 172.21.15.45:0/2179580627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419414cf60 con 0x7f41940aec80 2024-08-17T02:28:26.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.727+0000 7f418b400640 1 -- 172.21.15.45:0/2179580627 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c00ce40 con 0x7f41940aec80 2024-08-17T02:28:26.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.728+0000 7f4199600640 1 -- 172.21.15.45:0/2179580627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419414d5a0 con 0x7f41940aec80 2024-08-17T02:28:26.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.729+0000 7f4199600640 1 -- 172.21.15.45:0/2179580627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4194071050 con 0x7f41940aec80 2024-08-17T02:28:26.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.729+0000 7f418b400640 1 -- 172.21.15.45:0/2179580627 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f417c013680 con 0x7f41940aec80 2024-08-17T02:28:26.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.730+0000 7f418b400640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4170065150 0x7f4170067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:26.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.730+0000 7f418b400640 1 -- 172.21.15.45:0/2179580627 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f417c082b10 con 0x7f41940aec80 2024-08-17T02:28:26.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.730+0000 7f4193e00640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4170065150 0x7f4170067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:26.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.731+0000 7f4193e00640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4170065150 0x7f4170067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4184005840 tx=0x7f4184009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:26.734 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.734+0000 7f418b400640 1 -- 172.21.15.45:0/2179580627 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f417c0507b0 con 0x7f41940aec80 2024-08-17T02:28:26.954 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.953+0000 7f4199600640 1 -- 172.21.15.45:0/2179580627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4194152530 con 0x7f41940aec80 2024-08-17T02:28:26.954 INFO:tasks.ceph.mon.a.smithi045.stderr:2024-08-17T02:28:26.954+0000 7f430de00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:28:26.959 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.958+0000 7f418b400640 1 -- 172.21.15.45:0/2179580627 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7f417c053dd0 con 0x7f41940aec80 2024-08-17T02:28:26.959 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:28:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 -- 172.21.15.45:0/2179580627 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4170065150 msgr2=0x7f4170067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4170065150 0x7f4170067600 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4184005840 tx=0x7f4184009040 comp rx=0 tx=0).stop 2024-08-17T02:28:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 -- 172.21.15.45:0/2179580627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41940aec80 msgr2=0x7f419414da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41940aec80 0x7f419414da40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f417c009fd0 tx=0x7f417c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 -- 172.21.15.45:0/2179580627 shutdown_connections 2024-08-17T02:28:26.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4170065150 0x7f4170067600 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4194154760 0x7f41940b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41940aec80 0x7f419414da40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 --2- 172.21.15.45:0/2179580627 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f41940abfe0 0x7f41940b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 -- 172.21.15.45:0/2179580627 >> 172.21.15.45:0/2179580627 conn(0x7f4194096a70 msgr2=0x7f419414e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 -- 172.21.15.45:0/2179580627 shutdown_connections 2024-08-17T02:28:26.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:26.961+0000 7f4199600640 1 -- 172.21.15.45:0/2179580627 wait complete. 2024-08-17T02:28:26.971 INFO:tasks.ceph.mds.c.smithi045.stderr: -7241> 2024-08-17T02:26:10.087+0000 7f6fb3e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:26.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-08-17T02:28:27.015 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2024-08-17T02:28:27.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.135+0000 7f2dd6400640 1 Processor -- start 2024-08-17T02:28:27.136 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.135+0000 7f2dd6400640 1 -- start start 2024-08-17T02:28:27.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.136+0000 7f2dd6400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f2dd00af580 0x7f2dd00af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.136+0000 7f2dd6400640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd00aff20 con 0x7f2dd0155980 2024-08-17T02:28:27.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.137+0000 7f2dd6400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dd0158400 con 0x7f2dd00a54d0 2024-08-17T02:28:27.137 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.137+0000 7f2dd6400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dd01577f0 con 0x7f2dd00af580 2024-08-17T02:28:27.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.137+0000 7f2dcf400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2dd0155980 0x7f2dd0156f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53386/0 (socket says 172.21.15.45:53386) 2024-08-17T02:28:27.138 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.137+0000 7f2dcf400640 1 -- 172.21.15.45:0/4010047703 learned_addr learned my addr 172.21.15.45:0/4010047703 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.137+0000 7f2dcfe00640 1 --2- 172.21.15.45:0/4010047703 >> v2:172.21.15.169:3300/0 conn(0x7f2dd00af580 0x7f2dd00af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.137+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595669876 0 0) 0x7f2dc0001110 con 0x7f2dd0155980 2024-08-17T02:28:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.137+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db40034e0 con 0x7f2dd0155980 2024-08-17T02:28:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 870882528 0 0) 0x7f2db40034e0 con 0x7f2dd0155980 2024-08-17T02:28:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 >> v2:172.21.15.169:3300/0 conn(0x7f2dd00af580 msgr2=0x7f2dd00af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 --2- 172.21.15.45:0/4010047703 >> v2:172.21.15.169:3300/0 conn(0x7f2dd00af580 0x7f2dd00af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 >> v1:172.21.15.169:6789/0 conn(0x7f2dd00a54d0 legacy=0x7f2dd0155d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd0157ad0 con 0x7f2dd0155980 2024-08-17T02:28:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7f2dc0001600 con 0x7f2dd0155980 2024-08-17T02:28:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 >> v1:172.21.15.45:6789/0 conn(0x7f2dd0155980 legacy=0x7f2dd0156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.140 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 --2- 172.21.15.45:0/4010047703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db40039d0 0x7f2db4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 --2- 172.21.15.45:0/4010047703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db4004780 0x7f2db4004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 --2- 172.21.15.45:0/4010047703 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db4005130 0x7f2db400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd01577f0 con 0x7f2db4004780 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db400bfc0 con 0x7f2db4005130 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db400c180 con 0x7f2db40039d0 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dc7e00640 1 --2- 172.21.15.45:0/4010047703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db4004780 0x7f2db4004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcf400640 1 --2- 172.21.15.45:0/4010047703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db40039d0 0x7f2db4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dcfe00640 1 --2- 172.21.15.45:0/4010047703 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db4005130 0x7f2db400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dc7e00640 1 -- 172.21.15.45:0/4010047703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db40039d0 msgr2=0x7f2db4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dc7e00640 1 --2- 172.21.15.45:0/4010047703 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db40039d0 0x7f2db4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dc7e00640 1 -- 172.21.15.45:0/4010047703 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db4005130 msgr2=0x7f2db400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.138+0000 7f2dc7e00640 1 --2- 172.21.15.45:0/4010047703 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2db4005130 0x7f2db400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.139+0000 7f2dc7e00640 1 -- 172.21.15.45:0/4010047703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db40034e0 con 0x7f2db4004780 2024-08-17T02:28:27.141 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.139+0000 7f2dcfe00640 1 -- 172.21.15.45:0/4010047703 reap_dead start 2024-08-17T02:28:27.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.139+0000 7f2dc7e00640 1 --2- 172.21.15.45:0/4010047703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db4004780 0x7f2db4004bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2db8001920 tx=0x7f2db8007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129a93e77a5e8c27 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.140+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db802aac0 con 0x7f2db4004780 2024-08-17T02:28:27.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.140+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db802ac40 con 0x7f2db4004780 2024-08-17T02:28:27.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.140+0000 7f2dcea00640 1 -- 172.21.15.45:0/4010047703 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db80323f0 con 0x7f2db4004780 2024-08-17T02:28:27.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.140+0000 7f2dd6400640 1 -- 172.21.15.45:0/4010047703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db4004780 msgr2=0x7f2db4004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.140+0000 7f2dd6400640 1 --2- 172.21.15.45:0/4010047703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db4004780 0x7f2db4004bf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2db8001920 tx=0x7f2db8007c80 comp rx=0 tx=0).stop 2024-08-17T02:28:27.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.140+0000 7f2dd6400640 1 -- 172.21.15.45:0/4010047703 shutdown_connections 2024-08-17T02:28:27.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.140+0000 7f2dd6400640 1 --2- 172.21.15.45:0/4010047703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2db4004780 0x7f2db4004bf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.143 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.140+0000 7f2dd6400640 1 -- 172.21.15.45:0/4010047703 >> 172.21.15.45:0/4010047703 conn(0x7f2dd0067750 msgr2=0x7f2dd00cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:27.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.140+0000 7f2dd6400640 1 -- 172.21.15.45:0/4010047703 shutdown_connections 2024-08-17T02:28:27.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.140+0000 7f2dd6400640 1 -- 172.21.15.45:0/4010047703 wait complete. 2024-08-17T02:28:27.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.142+0000 7f2dd6400640 1 Processor -- start 2024-08-17T02:28:27.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.142+0000 7f2dd6400640 1 -- start start 2024-08-17T02:28:27.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dd6400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db4004780 0x7f2dd013da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dd6400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd00aa6f0 0x7f2dd00aab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dd6400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd00ac710 0x7f2dd00acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dd6400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd01656b0 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dd6400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00ab0a0 con 0x7f2dd00ac710 2024-08-17T02:28:27.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dd6400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dd00ad420 con 0x7f2db4004780 2024-08-17T02:28:27.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dc7e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd00aa6f0 0x7f2dd00aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dc7e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd00aa6f0 0x7f2dd00aab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53912/0 (socket says 172.21.15.45:53912) 2024-08-17T02:28:27.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dc7e00640 1 -- 172.21.15.45:0/2954834313 learned_addr learned my addr 172.21.15.45:0/2954834313 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:27.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dcf400640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db4004780 0x7f2dd013da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dc7e00640 1 -- 172.21.15.45:0/2954834313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db4004780 msgr2=0x7f2dd013da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dc7e00640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db4004780 0x7f2dd013da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dc7e00640 1 -- 172.21.15.45:0/2954834313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd00ac710 msgr2=0x7f2dd00acb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dc7e00640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd00ac710 0x7f2dd00acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dc7e00640 1 -- 172.21.15.45:0/2954834313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd00ad700 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.143+0000 7f2dcf400640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db4004780 0x7f2dd013da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:27.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.144+0000 7f2dc7e00640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd00aa6f0 0x7f2dd00aab60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2db8001920 tx=0x7f2db8003000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.144+0000 7f2dc6a00640 1 -- 172.21.15.45:0/2954834313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db8040070 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.144+0000 7f2dc6a00640 1 -- 172.21.15.45:0/2954834313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db8007320 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.144+0000 7f2dc6a00640 1 -- 172.21.15.45:0/2954834313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db80076c0 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.147 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.144+0000 7f2dd6400640 1 -- 172.21.15.45:0/2954834313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dd00ad9e0 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.144+0000 7f2dd6400640 1 -- 172.21.15.45:0/2954834313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dd00ad0c0 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.145+0000 7f2dd6400640 1 -- 172.21.15.45:0/2954834313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dd00ade60 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.146+0000 7f2dc6a00640 1 -- 172.21.15.45:0/2954834313 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f2db80069a0 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.147+0000 7f2dc6a00640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2dac065180 0x7f2dac067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:27.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.147+0000 7f2dc6a00640 1 -- 172.21.15.45:0/2954834313 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f2db80a1ff0 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.147+0000 7f2dcf400640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2dac065180 0x7f2dac067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:27.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.148+0000 7f2dcf400640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2dac065180 0x7f2dac067630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0001730 tx=0x7f2dc0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:27.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.151+0000 7f2dc6a00640 1 -- 172.21.15.45:0/2954834313 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f2db80d3e40 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.372 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.372+0000 7f2dd6400640 1 -- 172.21.15.45:0/2954834313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2dd0071050 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.972 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.971+0000 7f2dc6a00640 1 -- 172.21.15.45:0/2954834313 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2db806fc50 con 0x7f2dd00aa6f0 2024-08-17T02:28:27.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.974+0000 7f2dd6400640 1 -- 172.21.15.45:0/2954834313 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2dac065180 msgr2=0x7f2dac067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.974+0000 7f2dd6400640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2dac065180 0x7f2dac067630 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2dc0001730 tx=0x7f2dc0009040 comp rx=0 tx=0).stop 2024-08-17T02:28:27.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.974+0000 7f2dd6400640 1 -- 172.21.15.45:0/2954834313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd00aa6f0 msgr2=0x7f2dd00aab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:27.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.974+0000 7f2dd6400640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd00aa6f0 0x7f2dd00aab60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2db8001920 tx=0x7f2db8003000 comp rx=0 tx=0).stop 2024-08-17T02:28:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.974+0000 7f2dd6400640 1 -- 172.21.15.45:0/2954834313 shutdown_connections 2024-08-17T02:28:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.974+0000 7f2dd6400640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f2dd00ac710 0x7f2dd00acb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.974+0000 7f2dd6400640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2dd00aa6f0 0x7f2dd00aab60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.974+0000 7f2dd6400640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2dac065180 0x7f2dac067630 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.974+0000 7f2dd6400640 1 --2- 172.21.15.45:0/2954834313 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f2db4004780 0x7f2dd013da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.974+0000 7f2dd6400640 1 -- 172.21.15.45:0/2954834313 >> 172.21.15.45:0/2954834313 conn(0x7f2dd0067750 msgr2=0x7f2dd01520d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.974+0000 7f2dd6400640 1 -- 172.21.15.45:0/2954834313 shutdown_connections 2024-08-17T02:28:27.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:27.975+0000 7f2dd6400640 1 -- 172.21.15.45:0/2954834313 wait complete. 2024-08-17T02:28:27.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-17T02:28:28.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.189+0000 7f08e5c00640 1 Processor -- start 2024-08-17T02:28:28.190 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.189+0000 7f08e5c00640 1 -- start start 2024-08-17T02:28:28.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.190+0000 7f08e5c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08e0156d40 0x7f08e006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.190+0000 7f08e5c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08e006e420 0x7f08e00ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.190+0000 7f08e5c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e01568b0 con 0x7f08e0150130 2024-08-17T02:28:28.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.190+0000 7f08e5c00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e006e8a0 con 0x7f08e006e420 2024-08-17T02:28:28.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.190+0000 7f08e5c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e0150500 con 0x7f08e0156d40 2024-08-17T02:28:28.191 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.190+0000 7f08df400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08e006e420 0x7f08e00ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.190+0000 7f08df400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f08e006e420 0x7f08e00ab510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53928/0 (socket says 172.21.15.45:53928) 2024-08-17T02:28:28.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.190+0000 7f08df400640 1 -- 172.21.15.45:0/2808433391 learned_addr learned my addr 172.21.15.45:0/2808433391 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:28.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.191+0000 7f08de000640 1 --2- 172.21.15.45:0/2808433391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08e0156d40 0x7f08e006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.191+0000 7f08df400640 1 -- 172.21.15.45:0/2808433391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08e0156d40 msgr2=0x7f08e006dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:28.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.191+0000 7f08df400640 1 --2- 172.21.15.45:0/2808433391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08e0156d40 0x7f08e006dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.192 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.191+0000 7f08df400640 1 -- 172.21.15.45:0/2808433391 >> v1:172.21.15.169:6789/0 conn(0x7f08e0150130 legacy=0x7f08e00aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.191+0000 7f08df400640 1 -- 172.21.15.45:0/2808433391 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0155fc0 con 0x7f08e006e420 2024-08-17T02:28:28.193 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.192+0000 7f08df400640 1 --2- 172.21.15.45:0/2808433391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08e006e420 0x7f08e00ab510 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009f20 tx=0x7f08d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acea8d2282083208 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.192+0000 7f08dd600640 1 -- 172.21.15.45:0/2808433391 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d8031400 con 0x7f08e006e420 2024-08-17T02:28:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.192+0000 7f08dd600640 1 -- 172.21.15.45:0/2808433391 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d802d050 con 0x7f08e006e420 2024-08-17T02:28:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.192+0000 7f08dd600640 1 -- 172.21.15.45:0/2808433391 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d80317d0 con 0x7f08e006e420 2024-08-17T02:28:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.193+0000 7f08e5c00640 1 -- 172.21.15.45:0/2808433391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08e006e420 msgr2=0x7f08e00ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.193+0000 7f08e5c00640 1 --2- 172.21.15.45:0/2808433391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08e006e420 0x7f08e00ab510 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f08d8009f20 tx=0x7f08d8009840 comp rx=0 tx=0).stop 2024-08-17T02:28:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.193+0000 7f08e5c00640 1 -- 172.21.15.45:0/2808433391 shutdown_connections 2024-08-17T02:28:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.193+0000 7f08e5c00640 1 --2- 172.21.15.45:0/2808433391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08e006e420 0x7f08e00ab510 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.193+0000 7f08e5c00640 1 --2- 172.21.15.45:0/2808433391 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08e0156d40 0x7f08e006dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.193+0000 7f08e5c00640 1 -- 172.21.15.45:0/2808433391 >> 172.21.15.45:0/2808433391 conn(0x7f08e0067750 msgr2=0x7f08e006c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.193+0000 7f08e5c00640 1 -- 172.21.15.45:0/2808433391 shutdown_connections 2024-08-17T02:28:28.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.193+0000 7f08e5c00640 1 -- 172.21.15.45:0/2808433391 wait complete. 2024-08-17T02:28:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.194+0000 7f08e5c00640 1 Processor -- start 2024-08-17T02:28:28.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.194+0000 7f08e5c00640 1 -- start start 2024-08-17T02:28:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.195+0000 7f08e5c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08e006e420 0x7f08e0155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.195+0000 7f08e5c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08e0150130 0x7f08e013dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.195+0000 7f08e5c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08e0156d40 0x7f08e0168f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.195+0000 7f08e5c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e0154ad0 con 0x7f08e0150130 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.195+0000 7f08e5c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e00a6130 con 0x7f08e0156d40 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.195+0000 7f08e5c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e0155a60 con 0x7f08e006e420 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08de000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08e0150130 0x7f08e013dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08de000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08e0150130 0x7f08e013dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53938/0 (socket says 172.21.15.45:53938) 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08de000640 1 -- 172.21.15.45:0/483188444 learned_addr learned my addr 172.21.15.45:0/483188444 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08dea00640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08e006e420 0x7f08e0155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08df400640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08e0156d40 0x7f08e0168f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08de000640 1 -- 172.21.15.45:0/483188444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08e006e420 msgr2=0x7f08e0155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08de000640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08e006e420 0x7f08e0155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08de000640 1 -- 172.21.15.45:0/483188444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08e0156d40 msgr2=0x7f08e0168f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08de000640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08e0156d40 0x7f08e0168f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08de000640 1 -- 172.21.15.45:0/483188444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d8009ae0 con 0x7f08e0150130 2024-08-17T02:28:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08df400640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08e0156d40 0x7f08e0168f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.196+0000 7f08de000640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08e0150130 0x7f08e013dc20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00d860 tx=0x7f08cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.197+0000 7f08d6000640 1 -- 172.21.15.45:0/483188444 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc0096a0 con 0x7f08e0150130 2024-08-17T02:28:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.197+0000 7f08d6000640 1 -- 172.21.15.45:0/483188444 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc009800 con 0x7f08e0150130 2024-08-17T02:28:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.197+0000 7f08d6000640 1 -- 172.21.15.45:0/483188444 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc009bc0 con 0x7f08e0150130 2024-08-17T02:28:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.197+0000 7f08e5c00640 1 -- 172.21.15.45:0/483188444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e0169aa0 con 0x7f08e0150130 2024-08-17T02:28:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.197+0000 7f08e5c00640 1 -- 172.21.15.45:0/483188444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e0154d20 con 0x7f08e0150130 2024-08-17T02:28:28.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.198+0000 7f08e5c00640 1 -- 172.21.15.45:0/483188444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e00710c0 con 0x7f08e0150130 2024-08-17T02:28:28.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.199+0000 7f08d6000640 1 -- 172.21.15.45:0/483188444 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f08cc014410 con 0x7f08e0150130 2024-08-17T02:28:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.200+0000 7f08d6000640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f08c0065150 0x7f08c0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.200+0000 7f08d6000640 1 -- 172.21.15.45:0/483188444 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6689+0+0 (secure 0 0 0) 0x7f08cc082fe0 con 0x7f08e0150130 2024-08-17T02:28:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.200+0000 7f08dea00640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f08c0065150 0x7f08c0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:28.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.201+0000 7f08dea00640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f08c0065150 0x7f08c0067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f08d00037c0 tx=0x7f08d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:28.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.204+0000 7f08d6000640 1 -- 172.21.15.45:0/483188444 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f08cc050d20 con 0x7f08e0150130 2024-08-17T02:28:28.390 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.389+0000 7f08e5c00640 1 -- 172.21.15.45:0/483188444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f08e00b0310 con 0x7f08e0150130 2024-08-17T02:28:28.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.973+0000 7f08d6000640 1 -- 172.21.15.45:0/483188444 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f08cc054340 con 0x7f08e0150130 2024-08-17T02:28:28.974 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2024-08-17T02:28:28.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.976+0000 7f08e5c00640 1 -- 172.21.15.45:0/483188444 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f08c0065150 msgr2=0x7f08c0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.976+0000 7f08e5c00640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f08c0065150 0x7f08c0067600 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f08d00037c0 tx=0x7f08d0009040 comp rx=0 tx=0).stop 2024-08-17T02:28:28.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.976+0000 7f08e5c00640 1 -- 172.21.15.45:0/483188444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08e0150130 msgr2=0x7f08e013dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:28.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.976+0000 7f08e5c00640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08e0150130 0x7f08e013dc20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f08cc00d860 tx=0x7f08cc008040 comp rx=0 tx=0).stop 2024-08-17T02:28:28.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.977+0000 7f08e5c00640 1 -- 172.21.15.45:0/483188444 shutdown_connections 2024-08-17T02:28:28.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.977+0000 7f08e5c00640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f08e0156d40 0x7f08e0168f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.977+0000 7f08e5c00640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08e0150130 0x7f08e013dc20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.977+0000 7f08e5c00640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f08c0065150 0x7f08c0067600 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.977+0000 7f08e5c00640 1 --2- 172.21.15.45:0/483188444 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f08e006e420 0x7f08e0155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:28.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.977+0000 7f08e5c00640 1 -- 172.21.15.45:0/483188444 >> 172.21.15.45:0/483188444 conn(0x7f08e0067750 msgr2=0x7f08e00ac290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:28.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.977+0000 7f08e5c00640 1 -- 172.21.15.45:0/483188444 shutdown_connections 2024-08-17T02:28:28.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:28.977+0000 7f08e5c00640 1 -- 172.21.15.45:0/483188444 wait complete. 2024-08-17T02:28:28.996 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-17T02:28:29.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.154+0000 7f63dce00640 1 Processor -- start 2024-08-17T02:28:29.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.154+0000 7f63dce00640 1 -- start start 2024-08-17T02:28:29.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.155+0000 7f63dce00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63d8156d40 0x7f63d806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.155+0000 7f63dce00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d806e420 0x7f63d80ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.155+0000 7f63dce00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63d806e880 con 0x7f63d8150130 2024-08-17T02:28:29.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.155+0000 7f63dce00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d81568b0 con 0x7f63d8156d40 2024-08-17T02:28:29.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.155+0000 7f63dce00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d8150500 con 0x7f63d806e420 2024-08-17T02:28:29.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.156+0000 7f63d5e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f63d8150130 0x7f63d80aa730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53400/0 (socket says 172.21.15.45:53400) 2024-08-17T02:28:29.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.156+0000 7f63d5e00640 1 -- 172.21.15.45:0/3589476280 learned_addr learned my addr 172.21.15.45:0/3589476280 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:29.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.156+0000 7f63d5400640 1 --2- 172.21.15.45:0/3589476280 >> v2:172.21.15.45:3300/0 conn(0x7f63d8156d40 0x7f63d806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.156+0000 7f63d6800640 1 --2- 172.21.15.45:0/3589476280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d806e420 0x7f63d80ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.156+0000 7f63d4a00640 1 -- 172.21.15.45:0/3589476280 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943975996 0 0) 0x7f63c8001110 con 0x7f63d8150130 2024-08-17T02:28:29.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.156+0000 7f63d4a00640 1 -- 172.21.15.45:0/3589476280 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63bc0034e0 con 0x7f63d8150130 2024-08-17T02:28:29.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.156+0000 7f63d5400640 1 -- 172.21.15.45:0/3589476280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d806e420 msgr2=0x7f63d80ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:29.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.156+0000 7f63d5400640 1 --2- 172.21.15.45:0/3589476280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d806e420 0x7f63d80ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.156+0000 7f63d5400640 1 -- 172.21.15.45:0/3589476280 >> v1:172.21.15.45:6789/0 conn(0x7f63d8150130 legacy=0x7f63d80aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.156+0000 7f63d5400640 1 -- 172.21.15.45:0/3589476280 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d8155fc0 con 0x7f63d8156d40 2024-08-17T02:28:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.157+0000 7f63d5400640 1 --2- 172.21.15.45:0/3589476280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8156d40 0x7f63d806dee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009850 tx=0x7f63c40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3894807c58e01ba server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.157+0000 7f63d4a00640 1 -- 172.21.15.45:0/3589476280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c402ad00 con 0x7f63d8156d40 2024-08-17T02:28:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.158+0000 7f63d4a00640 1 -- 172.21.15.45:0/3589476280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c402ae60 con 0x7f63d8156d40 2024-08-17T02:28:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.158+0000 7f63d4a00640 1 -- 172.21.15.45:0/3589476280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4032650 con 0x7f63d8156d40 2024-08-17T02:28:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.158+0000 7f63dce00640 1 -- 172.21.15.45:0/3589476280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8156d40 msgr2=0x7f63d806dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.158+0000 7f63dce00640 1 --2- 172.21.15.45:0/3589476280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8156d40 0x7f63d806dee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f63c4009850 tx=0x7f63c40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.158+0000 7f63dce00640 1 -- 172.21.15.45:0/3589476280 shutdown_connections 2024-08-17T02:28:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.158+0000 7f63dce00640 1 --2- 172.21.15.45:0/3589476280 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d806e420 0x7f63d80ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.158+0000 7f63dce00640 1 --2- 172.21.15.45:0/3589476280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8156d40 0x7f63d806dee0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.158+0000 7f63dce00640 1 -- 172.21.15.45:0/3589476280 >> 172.21.15.45:0/3589476280 conn(0x7f63d8067750 msgr2=0x7f63d806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.158+0000 7f63dce00640 1 -- 172.21.15.45:0/3589476280 shutdown_connections 2024-08-17T02:28:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.158+0000 7f63dce00640 1 -- 172.21.15.45:0/3589476280 wait complete. 2024-08-17T02:28:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.160+0000 7f63dce00640 1 Processor -- start 2024-08-17T02:28:29.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.160+0000 7f63dce00640 1 -- start start 2024-08-17T02:28:29.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63dce00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63d806e420 0x7f63d80a7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63dce00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d8150130 0x7f63d81421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63dce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8156d40 0x7f63d816a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63dce00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d81506a0 con 0x7f63d8156d40 2024-08-17T02:28:29.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63dce00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d8150980 con 0x7f63d806e420 2024-08-17T02:28:29.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63dce00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d80a8740 con 0x7f63d8150130 2024-08-17T02:28:29.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63d6800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8156d40 0x7f63d816a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63d6800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8156d40 0x7f63d816a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53960/0 (socket says 172.21.15.45:53960) 2024-08-17T02:28:29.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63d6800640 1 -- 172.21.15.45:0/3231482029 learned_addr learned my addr 172.21.15.45:0/3231482029 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:29.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63d5e00640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63d806e420 0x7f63d80a7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63d5400640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d8150130 0x7f63d81421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63d6800640 1 -- 172.21.15.45:0/3231482029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d8150130 msgr2=0x7f63d81421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63d6800640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d8150130 0x7f63d81421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63d6800640 1 -- 172.21.15.45:0/3231482029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63d806e420 msgr2=0x7f63d80a7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63d6800640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63d806e420 0x7f63d80a7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.161+0000 7f63d6800640 1 -- 172.21.15.45:0/3231482029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c4009390 con 0x7f63d8156d40 2024-08-17T02:28:29.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.162+0000 7f63d6800640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8156d40 0x7f63d816a210 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009fd0 tx=0x7f63d0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.162+0000 7f63cd600640 1 -- 172.21.15.45:0/3231482029 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d000ee90 con 0x7f63d8156d40 2024-08-17T02:28:29.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.162+0000 7f63cd600640 1 -- 172.21.15.45:0/3231482029 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63d0014420 con 0x7f63d8156d40 2024-08-17T02:28:29.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.162+0000 7f63cd600640 1 -- 172.21.15.45:0/3231482029 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63d00147e0 con 0x7f63d8156d40 2024-08-17T02:28:29.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.162+0000 7f63dce00640 1 -- 172.21.15.45:0/3231482029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63d80a8a20 con 0x7f63d8156d40 2024-08-17T02:28:29.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.162+0000 7f63dce00640 1 -- 172.21.15.45:0/3231482029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d80a83e0 con 0x7f63d8156d40 2024-08-17T02:28:29.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.163+0000 7f63dce00640 1 -- 172.21.15.45:0/3231482029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d80710c0 con 0x7f63d8156d40 2024-08-17T02:28:29.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.164+0000 7f63cd600640 1 -- 172.21.15.45:0/3231482029 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f63d0014b50 con 0x7f63d8156d40 2024-08-17T02:28:29.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.165+0000 7f63cd600640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 0x7f63b8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:29.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.165+0000 7f63cd600640 1 -- 172.21.15.45:0/3231482029 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6251+0+0 (secure 0 0 0) 0x7f63d0082e60 con 0x7f63d8156d40 2024-08-17T02:28:29.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.165+0000 7f63d5e00640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 0x7f63b8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:29.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.165+0000 7f63d5e00640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 0x7f63b8067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f63c8001270 tx=0x7f63c8000bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:29.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.169+0000 7f63cd600640 1 -- 172.21.15.45:0/3231482029 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f63d0050c60 con 0x7f63d8156d40 2024-08-17T02:28:29.362 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.361+0000 7f63dce00640 1 -- 172.21.15.45:0/3231482029 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f63d8150ac0 con 0x7f63d8156d40 2024-08-17T02:28:29.987 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.986+0000 7f63cd600640 1 -- 172.21.15.45:0/3231482029 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f63d0054280 con 0x7f63d8156d40 2024-08-17T02:28:29.988 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2024-08-17T02:28:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.992+0000 7f63dce00640 1 -- 172.21.15.45:0/3231482029 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 msgr2=0x7f63b8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.992 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.992+0000 7f63dce00640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 0x7f63b8067600 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f63c8001270 tx=0x7f63c8000bc0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.992+0000 7f63dce00640 1 -- 172.21.15.45:0/3231482029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8156d40 msgr2=0x7f63d816a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.992+0000 7f63dce00640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8156d40 0x7f63d816a210 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f63d0009fd0 tx=0x7f63d0009900 comp rx=0 tx=0).stop 2024-08-17T02:28:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.993+0000 7f63dce00640 1 -- 172.21.15.45:0/3231482029 shutdown_connections 2024-08-17T02:28:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.993+0000 7f63dce00640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63d8156d40 0x7f63d816a210 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.993+0000 7f63dce00640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f63b8065150 0x7f63b8067600 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.993+0000 7f63dce00640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63d8150130 0x7f63d81421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.993+0000 7f63dce00640 1 --2- 172.21.15.45:0/3231482029 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f63d806e420 0x7f63d80a7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.993+0000 7f63dce00640 1 -- 172.21.15.45:0/3231482029 >> 172.21.15.45:0/3231482029 conn(0x7f63d8067750 msgr2=0x7f63d8069c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.993+0000 7f63dce00640 1 -- 172.21.15.45:0/3231482029 shutdown_connections 2024-08-17T02:28:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:29.993+0000 7f63dce00640 1 -- 172.21.15.45:0/3231482029 wait complete. 2024-08-17T02:28:30.015 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:30.172 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.172+0000 7f3965400640 1 Processor -- start 2024-08-17T02:28:30.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.172+0000 7f3965400640 1 -- start start 2024-08-17T02:28:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.173+0000 7f3965400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3960140580 0x7f39600c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.173+0000 7f3965400640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600caa80 con 0x7f39601401b0 2024-08-17T02:28:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.173+0000 7f3965400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39600c9e70 con 0x7f39600b1440 2024-08-17T02:28:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.173+0000 7f3965400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39600c9c90 con 0x7f3960140580 2024-08-17T02:28:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.173+0000 7f395e800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f39601401b0 0x7f39600b0d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53402/0 (socket says 172.21.15.45:53402) 2024-08-17T02:28:30.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.173+0000 7f395e800640 1 -- 172.21.15.45:0/1644516276 learned_addr learned my addr 172.21.15.45:0/1644516276 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.173+0000 7f395f200640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3960140580 0x7f39600c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2471835310 0 0) 0x7f39600caa80 con 0x7f39601401b0 2024-08-17T02:28:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39440034e0 con 0x7f39601401b0 2024-08-17T02:28:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3496642266 0 0) 0x7f39440034e0 con 0x7f39601401b0 2024-08-17T02:28:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3960140580 msgr2=0x7f39600c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3960140580 0x7f39600c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 >> v1:172.21.15.169:6789/0 conn(0x7f39600b1440 legacy=0x7f39600c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.176 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600ca150 con 0x7f39601401b0 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7f3950001470 con 0x7f39601401b0 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 >> v1:172.21.15.45:6789/0 conn(0x7f39601401b0 legacy=0x7f39600b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3944003a00 0x7f3944003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3944004780 0x7f3944004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3960140580 0x7f39440051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600c9c90 con 0x7f3944004780 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f394400bb60 con 0x7f3944003a00 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394400bcf0 con 0x7f3960140580 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f3957e00640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3944004780 0x7f3944004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.174+0000 7f395e800640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3944003a00 0x7f3944003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.175+0000 7f395f200640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3960140580 0x7f39440051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.175+0000 7f3957e00640 1 -- 172.21.15.45:0/1644516276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3960140580 msgr2=0x7f39440051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.175+0000 7f3957e00640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3960140580 0x7f39440051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.175+0000 7f3957e00640 1 -- 172.21.15.45:0/1644516276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3944003a00 msgr2=0x7f3944003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:30.177 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.175+0000 7f3957e00640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3944003a00 0x7f3944003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.178 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.175+0000 7f3957e00640 1 -- 172.21.15.45:0/1644516276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39440034e0 con 0x7f3944004780 2024-08-17T02:28:30.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.176+0000 7f3957e00640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3944004780 0x7f3944004bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3948001830 tx=0x7f3948007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45af0d17b84e1d5e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.176+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394802a920 con 0x7f3944004780 2024-08-17T02:28:30.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.176+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f394802aaa0 con 0x7f3944004780 2024-08-17T02:28:30.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.176+0000 7f395de00640 1 -- 172.21.15.45:0/1644516276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f394802ae60 con 0x7f3944004780 2024-08-17T02:28:30.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.177+0000 7f3965400640 1 -- 172.21.15.45:0/1644516276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3944004780 msgr2=0x7f3944004bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.177+0000 7f3965400640 1 --2- 172.21.15.45:0/1644516276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3944004780 0x7f3944004bf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f3948001830 tx=0x7f3948007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.177+0000 7f395f200640 1 -- 172.21.15.45:0/1644516276 reap_dead start 2024-08-17T02:28:30.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.177+0000 7f3965400640 1 -- 172.21.15.45:0/1644516276 shutdown_connections 2024-08-17T02:28:30.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.177+0000 7f3965400640 1 -- 172.21.15.45:0/1644516276 >> 172.21.15.45:0/1644516276 conn(0x7f39600cb9b0 msgr2=0x7f39600cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:30.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.177+0000 7f3965400640 1 -- 172.21.15.45:0/1644516276 shutdown_connections 2024-08-17T02:28:30.179 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.177+0000 7f3965400640 1 -- 172.21.15.45:0/1644516276 wait complete. 2024-08-17T02:28:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.178+0000 7f3965400640 1 Processor -- start 2024-08-17T02:28:30.180 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.178+0000 7f3965400640 1 -- start start 2024-08-17T02:28:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.179+0000 7f3965400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3944004780 0x7f39600acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.179+0000 7f3965400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39600c6e80 0x7f39600c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.181 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.179+0000 7f3965400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39600a8640 0x7f39600a8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.179+0000 7f3965400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600a9020 con 0x7f39600a8640 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.179+0000 7f3965400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39600a6b90 con 0x7f3944004780 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.179+0000 7f3965400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39600a5f80 con 0x7f39600c6e80 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.179+0000 7f395f200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39600a8640 0x7f39600a8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.179+0000 7f395f200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39600a8640 0x7f39600a8ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53982/0 (socket says 172.21.15.45:53982) 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.179+0000 7f395f200640 1 -- 172.21.15.45:0/2679794082 learned_addr learned my addr 172.21.15.45:0/2679794082 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.180+0000 7f3957e00640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39600c6e80 0x7f39600c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.180+0000 7f395e800640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3944004780 0x7f39600acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.180+0000 7f395f200640 1 -- 172.21.15.45:0/2679794082 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39600c6e80 msgr2=0x7f39600c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.180+0000 7f395f200640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39600c6e80 0x7f39600c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.180+0000 7f395f200640 1 -- 172.21.15.45:0/2679794082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3944004780 msgr2=0x7f39600acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.182 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.180+0000 7f395f200640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3944004780 0x7f39600acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.180+0000 7f395f200640 1 -- 172.21.15.45:0/2679794082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39600a6260 con 0x7f39600a8640 2024-08-17T02:28:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.180+0000 7f395f200640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39600a8640 0x7f39600a8ae0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f39600cc900 tx=0x7f395800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.180+0000 7f3956000640 1 -- 172.21.15.45:0/2679794082 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395800e040 con 0x7f39600a8640 2024-08-17T02:28:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.180+0000 7f3956000640 1 -- 172.21.15.45:0/2679794082 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395800f040 con 0x7f39600a8640 2024-08-17T02:28:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.180+0000 7f3956000640 1 -- 172.21.15.45:0/2679794082 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3958015920 con 0x7f39600a8640 2024-08-17T02:28:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.181+0000 7f3965400640 1 -- 172.21.15.45:0/2679794082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39600a6540 con 0x7f39600a8640 2024-08-17T02:28:30.183 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.181+0000 7f3965400640 1 -- 172.21.15.45:0/2679794082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39600a5c50 con 0x7f39600a8640 2024-08-17T02:28:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.182+0000 7f3965400640 1 -- 172.21.15.45:0/2679794082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39600a6d00 con 0x7f39600a8640 2024-08-17T02:28:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.183+0000 7f3956000640 1 -- 172.21.15.45:0/2679794082 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3958015cd0 con 0x7f39600a8640 2024-08-17T02:28:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.183+0000 7f3956000640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f393c065150 0x7f393c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.183+0000 7f3956000640 1 -- 172.21.15.45:0/2679794082 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f3958082620 con 0x7f39600a8640 2024-08-17T02:28:30.184 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.184+0000 7f395e800640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f393c065150 0x7f393c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.185 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.184+0000 7f395e800640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f393c065150 0x7f393c067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3950001050 tx=0x7f3950001d80 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.188 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.187+0000 7f3956000640 1 -- 172.21.15.45:0/2679794082 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f3958054100 con 0x7f39600a8640 2024-08-17T02:28:30.369 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.369+0000 7f3965400640 1 -- 172.21.15.45:0/2679794082 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3960064db0 con 0x7f39600a8640 2024-08-17T02:28:30.371 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.370+0000 7f3956000640 1 -- 172.21.15.45:0/2679794082 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15510 (secure 0 0 0) 0x7f3958053c90 con 0x7f39600a8640 2024-08-17T02:28:30.371 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:30.371 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":40,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:28:29.979473+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000631254.meta","create_time":"2024-08-17T02:26:17.444576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000631254"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000631254.data","create_time":"2024-08-17T02:26:18.306012+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000631254"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6836/618002034":"2024-08-18T02:28:26.954889+0000","172.21.15.45:6834/618002034":"2024-08-18T02:28:26.954889+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 -- 172.21.15.45:0/2679794082 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f393c065150 msgr2=0x7f393c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f393c065150 0x7f393c067600 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3950001050 tx=0x7f3950001d80 comp rx=0 tx=0).stop 2024-08-17T02:28:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 -- 172.21.15.45:0/2679794082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39600a8640 msgr2=0x7f39600a8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39600a8640 0x7f39600a8ae0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f39600cc900 tx=0x7f395800b040 comp rx=0 tx=0).stop 2024-08-17T02:28:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 -- 172.21.15.45:0/2679794082 shutdown_connections 2024-08-17T02:28:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39600a8640 0x7f39600a8ae0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f393c065150 0x7f393c067600 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f39600c6e80 0x7f39600c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 --2- 172.21.15.45:0/2679794082 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3944004780 0x7f39600acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.373 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 -- 172.21.15.45:0/2679794082 >> 172.21.15.45:0/2679794082 conn(0x7f39600cb9b0 msgr2=0x7f3960069640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:30.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 -- 172.21.15.45:0/2679794082 shutdown_connections 2024-08-17T02:28:30.374 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.372+0000 7f3965400640 1 -- 172.21.15.45:0/2679794082 wait complete. 2024-08-17T02:28:30.389 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-17T02:25:03.710952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 6, 'pool_name': 'cephfs.volume_0000000000631254.meta', 'create_time': '2024-08-17T02:26:17.444576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '36', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000631254'}}}, {'pool': 7, 'pool_name': 'cephfs.volume_0000000000631254.data', 'create_time': '2024-08-17T02:26:18.306012+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000631254'}}}] 2024-08-17T02:28:30.389 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-17T02:28:30.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.542+0000 7f960b000640 1 Processor -- start 2024-08-17T02:28:30.543 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.543+0000 7f960b000640 1 -- start start 2024-08-17T02:28:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.544+0000 7f960b000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9604158c20 0x7f96040ac040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.544+0000 7f960b000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96040ac580 0x7f9604068fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.544+0000 7f960b000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96040aeca0 con 0x7f9604069510 2024-08-17T02:28:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.544+0000 7f960b000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96040ac9d0 con 0x7f96040ac580 2024-08-17T02:28:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.544+0000 7f960b000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96040ae3e0 con 0x7f9604158c20 2024-08-17T02:28:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.544+0000 7f9609200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96040ac580 0x7f9604068fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.544+0000 7f960a600640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9604069510 0x7f96040aa7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53418/0 (socket says 172.21.15.45:53418) 2024-08-17T02:28:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.544+0000 7f960a600640 1 -- 172.21.15.45:0/3086115014 learned_addr learned my addr 172.21.15.45:0/3086115014 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:30.545 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.544+0000 7f9609c00640 1 --2- 172.21.15.45:0/3086115014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9604158c20 0x7f96040ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.545+0000 7f9609200640 1 -- 172.21.15.45:0/3086115014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9604158c20 msgr2=0x7f96040ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.545+0000 7f9609200640 1 --2- 172.21.15.45:0/3086115014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9604158c20 0x7f96040ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.545+0000 7f9609200640 1 -- 172.21.15.45:0/3086115014 >> v1:172.21.15.45:6789/0 conn(0x7f9604069510 legacy=0x7f96040aa7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.545+0000 7f9603e00640 1 -- 172.21.15.45:0/3086115014 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121554668 0 0) 0x7f96040aeca0 con 0x7f9604069510 2024-08-17T02:28:30.546 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.545+0000 7f9609200640 1 -- 172.21.15.45:0/3086115014 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040ae650 con 0x7f96040ac580 2024-08-17T02:28:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.546+0000 7f9609200640 1 --2- 172.21.15.45:0/3086115014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96040ac580 0x7f9604068fd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009850 tx=0x7f95f00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4dbf6e9574c6b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.546+0000 7f9603e00640 1 -- 172.21.15.45:0/3086115014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f002ad00 con 0x7f96040ac580 2024-08-17T02:28:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.546+0000 7f9603e00640 1 -- 172.21.15.45:0/3086115014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f002ae60 con 0x7f96040ac580 2024-08-17T02:28:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.546+0000 7f9603e00640 1 -- 172.21.15.45:0/3086115014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0032670 con 0x7f96040ac580 2024-08-17T02:28:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.546+0000 7f960b000640 1 -- 172.21.15.45:0/3086115014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96040ac580 msgr2=0x7f9604068fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.546+0000 7f960b000640 1 --2- 172.21.15.45:0/3086115014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96040ac580 0x7f9604068fd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009850 tx=0x7f95f00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.547+0000 7f960b000640 1 -- 172.21.15.45:0/3086115014 shutdown_connections 2024-08-17T02:28:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.547+0000 7f960b000640 1 --2- 172.21.15.45:0/3086115014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96040ac580 0x7f9604068fd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.547+0000 7f960b000640 1 --2- 172.21.15.45:0/3086115014 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9604158c20 0x7f96040ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.547+0000 7f960b000640 1 -- 172.21.15.45:0/3086115014 >> 172.21.15.45:0/3086115014 conn(0x7f9604096a70 msgr2=0x7f9604096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.547+0000 7f960b000640 1 -- 172.21.15.45:0/3086115014 shutdown_connections 2024-08-17T02:28:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.547+0000 7f960b000640 1 -- 172.21.15.45:0/3086115014 wait complete. 2024-08-17T02:28:30.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.548+0000 7f960b000640 1 Processor -- start 2024-08-17T02:28:30.549 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.548+0000 7f960b000640 1 -- start start 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.549+0000 7f960b000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9604069510 0x7f960414da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.549+0000 7f960b000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96040ac580 0x7f96041551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.549+0000 7f960b000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9604158c20 0x7f9604157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.549+0000 7f960b000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9604169d50 con 0x7f96040ac580 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.549+0000 7f960b000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9604169140 con 0x7f9604158c20 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.549+0000 7f960b000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9604169420 con 0x7f9604069510 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.549+0000 7f9609200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96040ac580 0x7f96041551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.549+0000 7f9609200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96040ac580 0x7f96041551f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53988/0 (socket says 172.21.15.45:53988) 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.549+0000 7f9609200640 1 -- 172.21.15.45:0/992090610 learned_addr learned my addr 172.21.15.45:0/992090610 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.550+0000 7f9609c00640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9604069510 0x7f960414da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.550+0000 7f960a600640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9604158c20 0x7f9604157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.551 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.550+0000 7f9609200640 1 -- 172.21.15.45:0/992090610 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9604069510 msgr2=0x7f960414da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.550+0000 7f9609200640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9604069510 0x7f960414da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.550+0000 7f9609200640 1 -- 172.21.15.45:0/992090610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9604158c20 msgr2=0x7f9604157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.550+0000 7f9609200640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9604158c20 0x7f9604157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.550+0000 7f9609200640 1 -- 172.21.15.45:0/992090610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0009390 con 0x7f96040ac580 2024-08-17T02:28:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.550+0000 7f960a600640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9604158c20 0x7f9604157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:30.552 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.550+0000 7f9609200640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96040ac580 0x7f96041551f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009850 tx=0x7f95f0032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.550+0000 7f9600c00640 1 -- 172.21.15.45:0/992090610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f003c750 con 0x7f96040ac580 2024-08-17T02:28:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.550+0000 7f9600c00640 1 -- 172.21.15.45:0/992090610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f003c8d0 con 0x7f96040ac580 2024-08-17T02:28:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.551+0000 7f960b000640 1 -- 172.21.15.45:0/992090610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9604169700 con 0x7f96040ac580 2024-08-17T02:28:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.551+0000 7f9600c00640 1 -- 172.21.15.45:0/992090610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f003ccd0 con 0x7f96040ac580 2024-08-17T02:28:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.551+0000 7f960b000640 1 -- 172.21.15.45:0/992090610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960414dfa0 con 0x7f96040ac580 2024-08-17T02:28:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.552+0000 7f960b000640 1 -- 172.21.15.45:0/992090610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960414f110 con 0x7f96040ac580 2024-08-17T02:28:30.553 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.552+0000 7f9600c00640 1 -- 172.21.15.45:0/992090610 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f95f0044030 con 0x7f96040ac580 2024-08-17T02:28:30.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.553+0000 7f9600c00640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f95e4065150 0x7f95e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.553+0000 7f9600c00640 1 -- 172.21.15.45:0/992090610 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f95f0042070 con 0x7f96040ac580 2024-08-17T02:28:30.554 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.554+0000 7f9609c00640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f95e4065150 0x7f95e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.555 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.554+0000 7f9609c00640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f95e4065150 0x7f95e4067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009c80 tx=0x7f95f80090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.558 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.557+0000 7f9600c00640 1 -- 172.21.15.45:0/992090610 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f960414f110 con 0x7f96040ac580 2024-08-17T02:28:30.740 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.739+0000 7f960b000640 1 -- 172.21.15.45:0/992090610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f960414f110 con 0x7f96040ac580 2024-08-17T02:28:30.741 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.740+0000 7f9600c00640 1 -- 172.21.15.45:0/992090610 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f960414f110 con 0x7f96040ac580 2024-08-17T02:28:30.741 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2024-08-17T02:28:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 -- 172.21.15.45:0/992090610 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f95e4065150 msgr2=0x7f95e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f95e4065150 0x7f95e4067600 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f95f8009c80 tx=0x7f95f80090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 -- 172.21.15.45:0/992090610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96040ac580 msgr2=0x7f96041551f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96040ac580 0x7f96041551f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f95f0009850 tx=0x7f95f0032000 comp rx=0 tx=0).stop 2024-08-17T02:28:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 -- 172.21.15.45:0/992090610 shutdown_connections 2024-08-17T02:28:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9604158c20 0x7f9604157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.743 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96040ac580 0x7f96041551f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f95e4065150 0x7f95e4067600 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 --2- 172.21.15.45:0/992090610 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9604069510 0x7f960414da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 -- 172.21.15.45:0/992090610 >> 172.21.15.45:0/992090610 conn(0x7f9604096a70 msgr2=0x7f9604156c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 -- 172.21.15.45:0/992090610 shutdown_connections 2024-08-17T02:28:30.744 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.742+0000 7f960b000640 1 -- 172.21.15.45:0/992090610 wait complete. 2024-08-17T02:28:30.757 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000631254.meta pg_num 2024-08-17T02:28:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.911+0000 7efc27000640 1 Processor -- start 2024-08-17T02:28:30.912 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.911+0000 7efc27000640 1 -- start start 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.912+0000 7efc27000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc20156c50 0x7efc200c7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.912+0000 7efc27000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc200ab130 con 0x7efc200adcf0 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.912+0000 7efc27000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc200ae5a0 con 0x7efc200c8bd0 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.912+0000 7efc27000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc200ae2c0 con 0x7efc20156c50 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.912+0000 7efc1fe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc20156c50 0x7efc200c7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.913 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.912+0000 7efc17e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efc200adcf0 0x7efc200ab5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53420/0 (socket says 172.21.15.45:53420) 2024-08-17T02:28:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.912+0000 7efc1fe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc20156c50 0x7efc200c7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53992/0 (socket says 172.21.15.45:53992) 2024-08-17T02:28:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.912+0000 7efc17e00640 1 -- 172.21.15.45:0/2657166080 learned_addr learned my addr 172.21.15.45:0/2657166080 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.913+0000 7efc1fe00640 1 -- 172.21.15.45:0/2657166080 >> v1:172.21.15.169:6789/0 conn(0x7efc200c8bd0 legacy=0x7efc200c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.914 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.913+0000 7efc1fe00640 1 -- 172.21.15.45:0/2657166080 >> v1:172.21.15.45:6789/0 conn(0x7efc200adcf0 legacy=0x7efc200ab5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.913+0000 7efc1fe00640 1 -- 172.21.15.45:0/2657166080 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc200aaae0 con 0x7efc20156c50 2024-08-17T02:28:30.915 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.914+0000 7efc1fe00640 1 --2- 172.21.15.45:0/2657166080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc20156c50 0x7efc200c7cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efc10009850 tx=0x7efc100090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55de5d9c1c2f41c5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.914+0000 7efc1f400640 1 -- 172.21.15.45:0/2657166080 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc1002ad00 con 0x7efc20156c50 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.914+0000 7efc1f400640 1 -- 172.21.15.45:0/2657166080 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc1002ae60 con 0x7efc20156c50 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.914+0000 7efc1f400640 1 -- 172.21.15.45:0/2657166080 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc10032670 con 0x7efc20156c50 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.915+0000 7efc27000640 1 -- 172.21.15.45:0/2657166080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc20156c50 msgr2=0x7efc200c7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.915+0000 7efc27000640 1 --2- 172.21.15.45:0/2657166080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc20156c50 0x7efc200c7cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efc10009850 tx=0x7efc100090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.915+0000 7efc27000640 1 -- 172.21.15.45:0/2657166080 shutdown_connections 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.915+0000 7efc27000640 1 --2- 172.21.15.45:0/2657166080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc20156c50 0x7efc200c7cf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.915+0000 7efc27000640 1 -- 172.21.15.45:0/2657166080 >> 172.21.15.45:0/2657166080 conn(0x7efc20067750 msgr2=0x7efc200c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.915+0000 7efc27000640 1 -- 172.21.15.45:0/2657166080 shutdown_connections 2024-08-17T02:28:30.916 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.915+0000 7efc27000640 1 -- 172.21.15.45:0/2657166080 wait complete. 2024-08-17T02:28:30.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.916+0000 7efc27000640 1 Processor -- start 2024-08-17T02:28:30.917 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.916+0000 7efc27000640 1 -- start start 2024-08-17T02:28:30.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.917+0000 7efc27000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc200adcf0 0x7efc201551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.917+0000 7efc27000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc200c8bd0 0x7efc20151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.918 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.917+0000 7efc27000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc20156c50 0x7efc2014c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.917+0000 7efc27000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2015a8a0 con 0x7efc200c8bd0 2024-08-17T02:28:30.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.917+0000 7efc27000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc2015ab30 con 0x7efc200adcf0 2024-08-17T02:28:30.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.917+0000 7efc27000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc2015ae10 con 0x7efc20156c50 2024-08-17T02:28:30.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.918+0000 7efc17e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc200c8bd0 0x7efc20151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.918+0000 7efc17e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc200c8bd0 0x7efc20151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54008/0 (socket says 172.21.15.45:54008) 2024-08-17T02:28:30.919 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.918+0000 7efc17e00640 1 -- 172.21.15.45:0/3133716936 learned_addr learned my addr 172.21.15.45:0/3133716936 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.918+0000 7efc17e00640 1 -- 172.21.15.45:0/3133716936 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc20156c50 msgr2=0x7efc2014c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.918+0000 7efc17e00640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc20156c50 0x7efc2014c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.918+0000 7efc17e00640 1 -- 172.21.15.45:0/3133716936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc200adcf0 msgr2=0x7efc201551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:30.920 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.918+0000 7efc1fe00640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc200adcf0 0x7efc201551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.918+0000 7efc17e00640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc200adcf0 0x7efc201551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.918+0000 7efc17e00640 1 -- 172.21.15.45:0/3133716936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc10009390 con 0x7efc200c8bd0 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.918+0000 7efc1fe00640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc200adcf0 0x7efc201551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.918+0000 7efc17e00640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc200c8bd0 0x7efc20151400 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efc0800c590 tx=0x7efc08007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.919+0000 7efc17400640 1 -- 172.21.15.45:0/3133716936 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08005aa0 con 0x7efc200c8bd0 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.919+0000 7efc17400640 1 -- 172.21.15.45:0/3133716936 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc08005c20 con 0x7efc200c8bd0 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.919+0000 7efc17400640 1 -- 172.21.15.45:0/3133716936 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc080070f0 con 0x7efc200c8bd0 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.919+0000 7efc27000640 1 -- 172.21.15.45:0/3133716936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2015b0f0 con 0x7efc200c8bd0 2024-08-17T02:28:30.921 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.919+0000 7efc27000640 1 -- 172.21.15.45:0/3133716936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc20154c60 con 0x7efc200c8bd0 2024-08-17T02:28:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.920+0000 7efc27000640 1 -- 172.21.15.45:0/3133716936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc20071050 con 0x7efc200c8bd0 2024-08-17T02:28:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.921+0000 7efc17400640 1 -- 172.21.15.45:0/3133716936 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7efc08007540 con 0x7efc200c8bd0 2024-08-17T02:28:30.922 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.922+0000 7efc17400640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efbfc065150 0x7efbfc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:30.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.922+0000 7efc17400640 1 -- 172.21.15.45:0/3133716936 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7efc08081610 con 0x7efc200c8bd0 2024-08-17T02:28:30.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.922+0000 7efc1fe00640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efbfc065150 0x7efbfc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:30.923 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.923+0000 7efc1fe00640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efbfc065150 0x7efbfc067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efc10034000 tx=0x7efc10032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:30.926 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:30.926+0000 7efc17400640 1 -- 172.21.15.45:0/3133716936 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7efc0804f630 con 0x7efc200c8bd0 2024-08-17T02:28:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.106+0000 7efc27000640 1 -- 172.21.15.45:0/3133716936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000631254.meta", "var": "pg_num"} v 0) v1 -- 0x7efc2015b280 con 0x7efc200c8bd0 2024-08-17T02:28:31.107 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.107+0000 7efc17400640 1 -- 172.21.15.45:0/3133716936 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000631254.meta", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7efc08052c50 con 0x7efc200c8bd0 2024-08-17T02:28:31.108 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:28:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 -- 172.21.15.45:0/3133716936 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efbfc065150 msgr2=0x7efbfc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efbfc065150 0x7efbfc067600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efc10034000 tx=0x7efc10032000 comp rx=0 tx=0).stop 2024-08-17T02:28:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 -- 172.21.15.45:0/3133716936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc200c8bd0 msgr2=0x7efc20151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc200c8bd0 0x7efc20151400 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efc0800c590 tx=0x7efc08007ee0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 -- 172.21.15.45:0/3133716936 shutdown_connections 2024-08-17T02:28:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7efbfc065150 0x7efbfc067600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7efc20156c50 0x7efc2014c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc200c8bd0 0x7efc20151400 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.110 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 --2- 172.21.15.45:0/3133716936 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7efc200adcf0 0x7efc201551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 -- 172.21.15.45:0/3133716936 >> 172.21.15.45:0/3133716936 conn(0x7efc20067750 msgr2=0x7efc20068d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 -- 172.21.15.45:0/3133716936 shutdown_connections 2024-08-17T02:28:31.111 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.109+0000 7efc27000640 1 -- 172.21.15.45:0/3133716936 wait complete. 2024-08-17T02:28:31.125 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000631254.data pg_num 2024-08-17T02:28:31.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.279+0000 7fdfbe000640 1 Processor -- start 2024-08-17T02:28:31.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.280+0000 7fdfbe000640 1 -- start start 2024-08-17T02:28:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.281+0000 7fdfbe000640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdfb8155660 0x7fdfb80c7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.281+0000 7fdfbe000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fdfb80adfb0 0x7fdfb80ae750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.281+0000 7fdfbe000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfb80afc40 con 0x7fdfb8155a30 2024-08-17T02:28:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.281+0000 7fdfbe000640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb80af030 con 0x7fdfb8155660 2024-08-17T02:28:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.281+0000 7fdfbe000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfb80af310 con 0x7fdfb80adfb0 2024-08-17T02:28:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.281+0000 7fdfbcc00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdfb8155660 0x7fdfb80c7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.281+0000 7fdfbd600640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdfb8155a30 0x7fdfb806dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53428/0 (socket says 172.21.15.45:53428) 2024-08-17T02:28:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.281+0000 7fdfbd600640 1 -- 172.21.15.45:0/1848545052 learned_addr learned my addr 172.21.15.45:0/1848545052 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.281+0000 7fdfb7e00640 1 --2- 172.21.15.45:0/1848545052 >> v2:172.21.15.169:3300/0 conn(0x7fdfb80adfb0 0x7fdfb80ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.282+0000 7fdfbcc00640 1 -- 172.21.15.45:0/1848545052 >> v2:172.21.15.169:3300/0 conn(0x7fdfb80adfb0 msgr2=0x7fdfb80ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.282+0000 7fdfbcc00640 1 --2- 172.21.15.45:0/1848545052 >> v2:172.21.15.169:3300/0 conn(0x7fdfb80adfb0 0x7fdfb80ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.282+0000 7fdfbcc00640 1 -- 172.21.15.45:0/1848545052 >> v1:172.21.15.45:6789/0 conn(0x7fdfb8155a30 legacy=0x7fdfb806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.282+0000 7fdfbcc00640 1 -- 172.21.15.45:0/1848545052 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb80af5f0 con 0x7fdfb8155660 2024-08-17T02:28:31.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.282+0000 7fdfb7400640 1 -- 172.21.15.45:0/1848545052 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232032425 0 0) 0x7fdfb80afc40 con 0x7fdfb8155a30 2024-08-17T02:28:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.283+0000 7fdfbcc00640 1 --2- 172.21.15.45:0/1848545052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8155660 0x7fdfb80c7fe0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80cb2e0 tx=0x7fdfac0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a587b27b49913f89 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.283+0000 7fdfb7400640 1 -- 172.21.15.45:0/1848545052 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac02adb0 con 0x7fdfb8155660 2024-08-17T02:28:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.283+0000 7fdfb7400640 1 -- 172.21.15.45:0/1848545052 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfac032440 con 0x7fdfb8155660 2024-08-17T02:28:31.286 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.283+0000 7fdfb7400640 1 -- 172.21.15.45:0/1848545052 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0327e0 con 0x7fdfb8155660 2024-08-17T02:28:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.284+0000 7fdfbe000640 1 -- 172.21.15.45:0/1848545052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8155660 msgr2=0x7fdfb80c7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.284+0000 7fdfbe000640 1 --2- 172.21.15.45:0/1848545052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8155660 0x7fdfb80c7fe0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdfb80cb2e0 tx=0x7fdfac0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.284+0000 7fdfbe000640 1 -- 172.21.15.45:0/1848545052 shutdown_connections 2024-08-17T02:28:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.284+0000 7fdfbe000640 1 --2- 172.21.15.45:0/1848545052 >> v2:172.21.15.169:3300/0 conn(0x7fdfb80adfb0 0x7fdfb80ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.284+0000 7fdfbe000640 1 --2- 172.21.15.45:0/1848545052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8155660 0x7fdfb80c7fe0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.284+0000 7fdfbe000640 1 -- 172.21.15.45:0/1848545052 >> 172.21.15.45:0/1848545052 conn(0x7fdfb8066cd0 msgr2=0x7fdfb80670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.284+0000 7fdfbe000640 1 -- 172.21.15.45:0/1848545052 shutdown_connections 2024-08-17T02:28:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.284+0000 7fdfbe000640 1 -- 172.21.15.45:0/1848545052 wait complete. 2024-08-17T02:28:31.287 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.285+0000 7fdfbe000640 1 Processor -- start 2024-08-17T02:28:31.288 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.285+0000 7fdfbe000640 1 -- start start 2024-08-17T02:28:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.286+0000 7fdfbe000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb80adfb0 0x7fdfb8154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.286+0000 7fdfbe000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfb8155660 0x7fdfb815cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.286+0000 7fdfbe000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8155a30 0x7fdfb815d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.286+0000 7fdfbe000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb815a800 con 0x7fdfb8155a30 2024-08-17T02:28:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.286+0000 7fdfbe000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb81589b0 con 0x7fdfb80adfb0 2024-08-17T02:28:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.286+0000 7fdfbe000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb8158c90 con 0x7fdfb8155660 2024-08-17T02:28:31.290 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.286+0000 7fdfbd600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8155a30 0x7fdfb815d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfbd600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8155a30 0x7fdfb815d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54030/0 (socket says 172.21.15.45:54030) 2024-08-17T02:28:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfbd600640 1 -- 172.21.15.45:0/2211950981 learned_addr learned my addr 172.21.15.45:0/2211950981 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfb7e00640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfb8155660 0x7fdfb815cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfbcc00640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb80adfb0 0x7fdfb8154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfbd600640 1 -- 172.21.15.45:0/2211950981 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfb8155660 msgr2=0x7fdfb815cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfbd600640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfb8155660 0x7fdfb815cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfbd600640 1 -- 172.21.15.45:0/2211950981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb80adfb0 msgr2=0x7fdfb8154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfbd600640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb80adfb0 0x7fdfb8154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfbd600640 1 -- 172.21.15.45:0/2211950981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac009390 con 0x7fdfb8155a30 2024-08-17T02:28:31.291 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfbd600640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8155a30 0x7fdfb815d470 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000cc10 tx=0x7fdfb0001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfabe00640 1 -- 172.21.15.45:0/2211950981 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000ce30 con 0x7fdfb8155a30 2024-08-17T02:28:31.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfabe00640 1 -- 172.21.15.45:0/2211950981 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb000a7f0 con 0x7fdfb8155a30 2024-08-17T02:28:31.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.287+0000 7fdfbe000640 1 -- 172.21.15.45:0/2211950981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb815aa50 con 0x7fdfb8155a30 2024-08-17T02:28:31.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.288+0000 7fdfabe00640 1 -- 172.21.15.45:0/2211950981 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb000abf0 con 0x7fdfb8155a30 2024-08-17T02:28:31.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.288+0000 7fdfbe000640 1 -- 172.21.15.45:0/2211950981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb8154dc0 con 0x7fdfb8155a30 2024-08-17T02:28:31.292 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.289+0000 7fdfbe000640 1 -- 172.21.15.45:0/2211950981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfb8071050 con 0x7fdfb8155a30 2024-08-17T02:28:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.290+0000 7fdfabe00640 1 -- 172.21.15.45:0/2211950981 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fdfb000ad50 con 0x7fdfb8155a30 2024-08-17T02:28:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.291+0000 7fdfabe00640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf98065150 0x7fdf98067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.291+0000 7fdfabe00640 1 -- 172.21.15.45:0/2211950981 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fdfb0082600 con 0x7fdfb8155a30 2024-08-17T02:28:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.291+0000 7fdfbcc00640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf98065150 0x7fdf98067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.293 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.292+0000 7fdfbcc00640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf98065150 0x7fdf98067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdfac034000 tx=0x7fdfac032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.295 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.295+0000 7fdfabe00640 1 -- 172.21.15.45:0/2211950981 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fdfb00506e0 con 0x7fdfb8155a30 2024-08-17T02:28:31.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.476+0000 7fdfbe000640 1 -- 172.21.15.45:0/2211950981 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000631254.data", "var": "pg_num"} v 0) v1 -- 0x7fdfb8069870 con 0x7fdfb8155a30 2024-08-17T02:28:31.477 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.477+0000 7fdfabe00640 1 -- 172.21.15.45:0/2211950981 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000631254.data", "var": "pg_num"}]=0 v40) v1 ==== 124+0+11 (secure 0 0 0) 0x7fdfb0053d00 con 0x7fdfb8155a30 2024-08-17T02:28:31.478 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2024-08-17T02:28:31.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 -- 172.21.15.45:0/2211950981 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf98065150 msgr2=0x7fdf98067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf98065150 0x7fdf98067600 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdfac034000 tx=0x7fdfac032000 comp rx=0 tx=0).stop 2024-08-17T02:28:31.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 -- 172.21.15.45:0/2211950981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8155a30 msgr2=0x7fdfb815d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8155a30 0x7fdfb815d470 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdfb000cc10 tx=0x7fdfb0001970 comp rx=0 tx=0).stop 2024-08-17T02:28:31.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 -- 172.21.15.45:0/2211950981 shutdown_connections 2024-08-17T02:28:31.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfb8155a30 0x7fdfb815d470 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fdf98065150 0x7fdf98067600 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fdfb8155660 0x7fdfb815cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 --2- 172.21.15.45:0/2211950981 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fdfb80adfb0 0x7fdfb8154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.480 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 -- 172.21.15.45:0/2211950981 >> 172.21.15.45:0/2211950981 conn(0x7fdfb8066cd0 msgr2=0x7fdfb80b00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:31.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 -- 172.21.15.45:0/2211950981 shutdown_connections 2024-08-17T02:28:31.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.479+0000 7fdfbe000640 1 -- 172.21.15.45:0/2211950981 wait complete. 2024-08-17T02:28:31.496 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:31.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.646+0000 7fbd08200640 1 Processor -- start 2024-08-17T02:28:31.647 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.646+0000 7fbd08200640 1 -- start start 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.647+0000 7fbd08200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbd001401b0 0x7fbd000caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd08200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd000b1440 0x7fbd000c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd08200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd000caa80 con 0x7fbd00140580 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd08200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd000cb450 con 0x7fbd000b1440 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd08200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd000c9e70 con 0x7fbd001401b0 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd06200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd000b1440 0x7fbd000c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd06200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd000b1440 0x7fbd000c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54044/0 (socket says 172.21.15.45:54044) 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd06200640 1 -- 172.21.15.45:0/3920561593 learned_addr learned my addr 172.21.15.45:0/3920561593 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:31.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd05800640 1 --2- 172.21.15.45:0/3920561593 >> v2:172.21.15.169:3300/0 conn(0x7fbd001401b0 0x7fbd000caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd06200640 1 -- 172.21.15.45:0/3920561593 >> v2:172.21.15.169:3300/0 conn(0x7fbd001401b0 msgr2=0x7fbd000caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd06200640 1 --2- 172.21.15.45:0/3920561593 >> v2:172.21.15.169:3300/0 conn(0x7fbd001401b0 0x7fbd000caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd06200640 1 -- 172.21.15.45:0/3920561593 >> v1:172.21.15.169:6789/0 conn(0x7fbd00140580 legacy=0x7fbd000b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.648+0000 7fbd06200640 1 -- 172.21.15.45:0/3920561593 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd000ca150 con 0x7fbd000b1440 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.649+0000 7fbd06200640 1 --2- 172.21.15.45:0/3920561593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd000b1440 0x7fbd000c9040 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbd00068650 tx=0x7fbcf8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b9e8abe1cf759 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.650+0000 7fbcffe00640 1 -- 172.21.15.45:0/3920561593 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8007400 con 0x7fbd000b1440 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.650+0000 7fbcffe00640 1 -- 172.21.15.45:0/3920561593 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8007560 con 0x7fbd000b1440 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.650+0000 7fbcffe00640 1 -- 172.21.15.45:0/3920561593 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8007940 con 0x7fbd000b1440 2024-08-17T02:28:31.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.650+0000 7fbd08200640 1 -- 172.21.15.45:0/3920561593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd000b1440 msgr2=0x7fbd000c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.650+0000 7fbd08200640 1 --2- 172.21.15.45:0/3920561593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd000b1440 0x7fbd000c9040 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbd00068650 tx=0x7fbcf8009840 comp rx=0 tx=0).stop 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.650+0000 7fbd08200640 1 -- 172.21.15.45:0/3920561593 shutdown_connections 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.650+0000 7fbd08200640 1 --2- 172.21.15.45:0/3920561593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd000b1440 0x7fbd000c9040 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.650+0000 7fbd08200640 1 --2- 172.21.15.45:0/3920561593 >> v2:172.21.15.169:3300/0 conn(0x7fbd001401b0 0x7fbd000caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.650+0000 7fbd08200640 1 -- 172.21.15.45:0/3920561593 >> 172.21.15.45:0/3920561593 conn(0x7fbd000cb9b0 msgr2=0x7fbd000cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.650+0000 7fbd08200640 1 -- 172.21.15.45:0/3920561593 shutdown_connections 2024-08-17T02:28:31.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.650+0000 7fbd08200640 1 -- 172.21.15.45:0/3920561593 wait complete. 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.652+0000 7fbd08200640 1 Processor -- start 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.652+0000 7fbd08200640 1 -- start start 2024-08-17T02:28:31.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd08200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd000b1440 0x7fbd0015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd08200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd001401b0 0x7fbd000c2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd08200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd00140580 0x7fbd0015a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd08200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd000c3050 con 0x7fbd00140580 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd08200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0015a800 con 0x7fbd001401b0 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd08200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0015b650 con 0x7fbd000b1440 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd06200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd00140580 0x7fbd0015a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd05800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd000b1440 0x7fbd0015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd06200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd00140580 0x7fbd0015a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54060/0 (socket says 172.21.15.45:54060) 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd06200640 1 -- 172.21.15.45:0/3024863109 learned_addr learned my addr 172.21.15.45:0/3024863109 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd05800640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd000b1440 0x7fbd0015bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:34966/0 (socket says 172.21.15.45:34966) 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.653+0000 7fbd04e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd001401b0 0x7fbd000c2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.654+0000 7fbd06200640 1 -- 172.21.15.45:0/3024863109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd000b1440 msgr2=0x7fbd0015bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.656 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.654+0000 7fbd06200640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd000b1440 0x7fbd0015bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.654+0000 7fbd06200640 1 -- 172.21.15.45:0/3024863109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd001401b0 msgr2=0x7fbd000c2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.654+0000 7fbd06200640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd001401b0 0x7fbd000c2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.654+0000 7fbd06200640 1 -- 172.21.15.45:0/3024863109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf8009ae0 con 0x7fbd00140580 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.654+0000 7fbd06200640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd00140580 0x7fbd0015a2c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009f50 tx=0x7fbcf8034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.654+0000 7fbcfcc00640 1 -- 172.21.15.45:0/3024863109 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8007400 con 0x7fbd00140580 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.654+0000 7fbcfcc00640 1 -- 172.21.15.45:0/3024863109 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcf8032e30 con 0x7fbd00140580 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.654+0000 7fbcfcc00640 1 -- 172.21.15.45:0/3024863109 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcf803d660 con 0x7fbd00140580 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.654+0000 7fbd08200640 1 -- 172.21.15.45:0/3024863109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd0015aa40 con 0x7fbd00140580 2024-08-17T02:28:31.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.654+0000 7fbd08200640 1 -- 172.21.15.45:0/3024863109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0015b000 con 0x7fbd00140580 2024-08-17T02:28:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.656+0000 7fbd08200640 1 -- 172.21.15.45:0/3024863109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd00064db0 con 0x7fbd00140580 2024-08-17T02:28:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.656+0000 7fbcfcc00640 1 -- 172.21.15.45:0/3024863109 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbcf8003020 con 0x7fbd00140580 2024-08-17T02:28:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.657+0000 7fbcfcc00640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbce0065180 0x7fbce0067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.657+0000 7fbcfcc00640 1 -- 172.21.15.45:0/3024863109 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fbcf80a3a50 con 0x7fbd00140580 2024-08-17T02:28:31.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.657+0000 7fbd05800640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbce0065180 0x7fbce0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:31.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.658+0000 7fbd05800640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbce0065180 0x7fbce0067630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009d20 tx=0x7fbcf40090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:31.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.661+0000 7fbcfcc00640 1 -- 172.21.15.45:0/3024863109 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbcf8071aa0 con 0x7fbd00140580 2024-08-17T02:28:31.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.889+0000 7fbd08200640 1 -- 172.21.15.45:0/3024863109 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd0015b790 con 0x7fbd00140580 2024-08-17T02:28:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.890+0000 7fbcfcc00640 1 -- 172.21.15.45:0/3024863109 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4618 (secure 0 0 0) 0x7fbcf80750c0 con 0x7fbd00140580 2024-08-17T02:28:31.891 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:31.891 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2570743735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2570743735},{"type":"v1","addr":"172.21.15.169:6834","nonce":2570743735}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1704272549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1704272549},{"type":"v1","addr":"172.21.15.169:6835","nonce":1704272549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2899133229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2899133229},{"type":"v1","addr":"172.21.15.45:6836","nonce":2899133229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:19.270401+0000","modified":"2024-08-17T02:26:20.776150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6837/569206503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":569206503},{"type":"v1","addr":"172.21.15.45:6837","nonce":569206503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000631254","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:31.891 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2024-08-17T02:28:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 -- 172.21.15.45:0/3024863109 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbce0065180 msgr2=0x7fbce0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbce0065180 0x7fbce0067630 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009d20 tx=0x7fbcf40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 -- 172.21.15.45:0/3024863109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd00140580 msgr2=0x7fbd0015a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd00140580 0x7fbd0015a2c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8009f50 tx=0x7fbcf8034000 comp rx=0 tx=0).stop 2024-08-17T02:28:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 -- 172.21.15.45:0/3024863109 shutdown_connections 2024-08-17T02:28:31.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd00140580 0x7fbd0015a2c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbd001401b0 0x7fbd000c2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbce0065180 0x7fbce0067630 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 --2- 172.21.15.45:0/3024863109 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbd000b1440 0x7fbd0015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 -- 172.21.15.45:0/3024863109 >> 172.21.15.45:0/3024863109 conn(0x7fbd000cb9b0 msgr2=0x7fbd0013c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 -- 172.21.15.45:0/3024863109 shutdown_connections 2024-08-17T02:28:31.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:31.892+0000 7fbd08200640 1 -- 172.21.15.45:0/3024863109 wait complete. 2024-08-17T02:28:31.909 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:32.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.060+0000 7f10b1000640 1 Processor -- start 2024-08-17T02:28:32.061 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.061+0000 7f10b1000640 1 -- start start 2024-08-17T02:28:32.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.062+0000 7f10b1000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10ac0afdd0 0x7f10ac1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.062 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.062+0000 7f10b1000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac157690 con 0x7f10ac155900 2024-08-17T02:28:32.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.062+0000 7f10b1000640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ac156a80 con 0x7f10ac0b0270 2024-08-17T02:28:32.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.062+0000 7f10b1000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac156d60 con 0x7f10ac0afdd0 2024-08-17T02:28:32.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.062+0000 7f10ab400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f10ac155900 0x7f10ac155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34008/0 (socket says 172.21.15.45:34008) 2024-08-17T02:28:32.063 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.062+0000 7f10ab400640 1 -- 172.21.15.45:0/1585769814 learned_addr learned my addr 172.21.15.45:0/1585769814 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.062+0000 7f10abe00640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10ac0afdd0 0x7f10ac1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.062+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401968170 0 0) 0x7f10ac157690 con 0x7f10ac155900 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.062+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10900034e0 con 0x7f10ac155900 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2011606422 0 0) 0x7f10900034e0 con 0x7f10ac155900 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10ac0afdd0 msgr2=0x7f10ac1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10ac0afdd0 0x7f10ac1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 >> v1:172.21.15.169:6789/0 conn(0x7f10ac0b0270 legacy=0x7f10ac0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac157040 con 0x7f10ac155900 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7f109c001470 con 0x7f10ac155900 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 >> v1:172.21.15.45:6789/0 conn(0x7f10ac155900 legacy=0x7f10ac155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1090003a00 0x7f1090003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1090004780 0x7f1090004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1090005130 0x7f109000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.065 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac156d60 con 0x7f1090003a00 2024-08-17T02:28:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f109000c0a0 con 0x7f1090005130 2024-08-17T02:28:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f109000c210 con 0x7f1090004780 2024-08-17T02:28:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10abe00640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10ac0afdd0 0x7f10ac1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10ab400640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1090003a00 0x7f1090003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10a3e00640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1090004780 0x7f1090004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.063+0000 7f10abe00640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1090005130 0x7f109000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.064+0000 7f10ab400640 1 -- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1090004780 msgr2=0x7f1090004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.064+0000 7f10ab400640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1090004780 0x7f1090004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.064+0000 7f10ab400640 1 -- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1090005130 msgr2=0x7f109000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.064+0000 7f10ab400640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1090005130 0x7f109000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.066 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.064+0000 7f10ab400640 1 -- 172.21.15.45:0/1585769814 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10900034e0 con 0x7f1090003a00 2024-08-17T02:28:32.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.065+0000 7f10ab400640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1090003a00 0x7f1090003e10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f109c007f90 tx=0x7f10ac157600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8c5ede69221876 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.065+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c005890 con 0x7f1090003a00 2024-08-17T02:28:32.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.065+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109c005a10 con 0x7f1090003a00 2024-08-17T02:28:32.067 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.065+0000 7f10aaa00640 1 -- 172.21.15.45:0/1585769814 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109c005dd0 con 0x7f1090003a00 2024-08-17T02:28:32.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.065+0000 7f10b1000640 1 -- 172.21.15.45:0/1585769814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1090003a00 msgr2=0x7f1090003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.065+0000 7f10b1000640 1 --2- 172.21.15.45:0/1585769814 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1090003a00 0x7f1090003e10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f109c007f90 tx=0x7f10ac157600 comp rx=0 tx=0).stop 2024-08-17T02:28:32.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.066+0000 7f10abe00640 1 -- 172.21.15.45:0/1585769814 reap_dead start 2024-08-17T02:28:32.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.066+0000 7f10b1000640 1 -- 172.21.15.45:0/1585769814 shutdown_connections 2024-08-17T02:28:32.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.066+0000 7f10b1000640 1 -- 172.21.15.45:0/1585769814 >> 172.21.15.45:0/1585769814 conn(0x7f10ac067750 msgr2=0x7f10ac0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.066+0000 7f10b1000640 1 -- 172.21.15.45:0/1585769814 shutdown_connections 2024-08-17T02:28:32.068 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.066+0000 7f10b1000640 1 -- 172.21.15.45:0/1585769814 wait complete. 2024-08-17T02:28:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.067+0000 7f10b1000640 1 Processor -- start 2024-08-17T02:28:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.067+0000 7f10b1000640 1 -- start start 2024-08-17T02:28:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.068+0000 7f10b1000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1090003a00 0x7f10ac0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.068+0000 7f10b1000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10ac0aaff0 0x7f10ac169910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.068+0000 7f10b1000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10ac0cabc0 0x7f10ac0c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.070 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.068+0000 7f10b1000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac0aab60 con 0x7f10ac0aaff0 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.068+0000 7f10b1000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac169e50 con 0x7f1090003a00 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.068+0000 7f10b1000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ac0a9f50 con 0x7f10ac0cabc0 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.068+0000 7f10a3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10ac0aaff0 0x7f10ac169910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.068+0000 7f10a3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10ac0aaff0 0x7f10ac169910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51050/0 (socket says 172.21.15.45:51050) 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.068+0000 7f10a3e00640 1 -- 172.21.15.45:0/3604711702 learned_addr learned my addr 172.21.15.45:0/3604711702 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10abe00640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10ac0cabc0 0x7f10ac0c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10ab400640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1090003a00 0x7f10ac0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10a3e00640 1 -- 172.21.15.45:0/3604711702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10ac0cabc0 msgr2=0x7f10ac0c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10a3e00640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10ac0cabc0 0x7f10ac0c3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10a3e00640 1 -- 172.21.15.45:0/3604711702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1090003a00 msgr2=0x7f10ac0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10a3e00640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1090003a00 0x7f10ac0a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10a3e00640 1 -- 172.21.15.45:0/3604711702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac0aa230 con 0x7f10ac0aaff0 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10ab400640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1090003a00 0x7f10ac0a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10a3e00640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10ac0aaff0 0x7f10ac169910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1094002920 tx=0x7f1094007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.071 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10a2a00640 1 -- 172.21.15.45:0/3604711702 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109400f940 con 0x7f10ac0aaff0 2024-08-17T02:28:32.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10a2a00640 1 -- 172.21.15.45:0/3604711702 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109400faa0 con 0x7f10ac0aaff0 2024-08-17T02:28:32.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10a2a00640 1 -- 172.21.15.45:0/3604711702 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109400fe60 con 0x7f10ac0aaff0 2024-08-17T02:28:32.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.069+0000 7f10b1000640 1 -- 172.21.15.45:0/3604711702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ac0aa510 con 0x7f10ac0aaff0 2024-08-17T02:28:32.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.070+0000 7f10b1000640 1 -- 172.21.15.45:0/3604711702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ac0cb030 con 0x7f10ac0aaff0 2024-08-17T02:28:32.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.071+0000 7f10b1000640 1 -- 172.21.15.45:0/3604711702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ac0aad10 con 0x7f10ac0aaff0 2024-08-17T02:28:32.072 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.071+0000 7f10a2a00640 1 -- 172.21.15.45:0/3604711702 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1094007240 con 0x7f10ac0aaff0 2024-08-17T02:28:32.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.072+0000 7f10a2a00640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1088065150 0x7f1088067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.073+0000 7f10a2a00640 1 -- 172.21.15.45:0/3604711702 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f1094082640 con 0x7f10ac0aaff0 2024-08-17T02:28:32.073 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.073+0000 7f10ab400640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1088065150 0x7f1088067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.073+0000 7f10ab400640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1088065150 0x7f1088067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f109c035000 tx=0x7f109c036000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.076+0000 7f10a2a00640 1 -- 172.21.15.45:0/3604711702 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f10ac0aad10 con 0x7f10ac0aaff0 2024-08-17T02:28:32.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.261+0000 7f10b1000640 1 -- 172.21.15.45:0/3604711702 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10ac0aad10 con 0x7f10ac0aaff0 2024-08-17T02:28:32.263 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.262+0000 7f10a2a00640 1 -- 172.21.15.45:0/3604711702 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15510 (secure 0 0 0) 0x7f10ac0aad10 con 0x7f10ac0aaff0 2024-08-17T02:28:32.263 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:32.263 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":40,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:28:29.979473+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000631254.meta","create_time":"2024-08-17T02:26:17.444576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000631254"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000631254.data","create_time":"2024-08-17T02:26:18.306012+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000631254"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6836/618002034":"2024-08-18T02:28:26.954889+0000","172.21.15.45:6834/618002034":"2024-08-18T02:28:26.954889+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:32.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 -- 172.21.15.45:0/3604711702 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1088065150 msgr2=0x7f1088067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1088065150 0x7f1088067600 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f109c035000 tx=0x7f109c036000 comp rx=0 tx=0).stop 2024-08-17T02:28:32.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 -- 172.21.15.45:0/3604711702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10ac0aaff0 msgr2=0x7f10ac169910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10ac0aaff0 0x7f10ac169910 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1094002920 tx=0x7f1094007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 -- 172.21.15.45:0/3604711702 shutdown_connections 2024-08-17T02:28:32.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1088065150 0x7f1088067600 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f10ac0cabc0 0x7f10ac0c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f10ac0aaff0 0x7f10ac169910 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 --2- 172.21.15.45:0/3604711702 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1090003a00 0x7f10ac0a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 -- 172.21.15.45:0/3604711702 >> 172.21.15.45:0/3604711702 conn(0x7f10ac067750 msgr2=0x7f10ac069800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 -- 172.21.15.45:0/3604711702 shutdown_connections 2024-08-17T02:28:32.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.264+0000 7f10b1000640 1 -- 172.21.15.45:0/3604711702 wait complete. 2024-08-17T02:28:32.280 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000631254 and related pools 2024-08-17T02:28:32.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.431+0000 7f5ba8e00640 1 Processor -- start 2024-08-17T02:28:32.432 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.431+0000 7f5ba8e00640 1 -- start start 2024-08-17T02:28:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.432+0000 7f5ba8e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ba40af6d0 0x7f5ba40aa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.432+0000 7f5ba8e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba40abc80 con 0x7f5ba40ac820 2024-08-17T02:28:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.432+0000 7f5ba8e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba40afb20 con 0x7f5ba4158cb0 2024-08-17T02:28:32.433 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.432+0000 7f5ba8e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40aae50 con 0x7f5ba40af6d0 2024-08-17T02:28:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.432+0000 7f5ba2800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5ba40ac820 0x7f5ba4159080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34022/0 (socket says 172.21.15.45:34022) 2024-08-17T02:28:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.432+0000 7f5ba2800640 1 -- 172.21.15.45:0/3342170594 learned_addr learned my addr 172.21.15.45:0/3342170594 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.433+0000 7f5ba1400640 1 --2- 172.21.15.45:0/3342170594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ba40af6d0 0x7f5ba40aa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.433+0000 7f5ba0a00640 1 -- 172.21.15.45:0/3342170594 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284061834 0 0) 0x7f5ba40abc80 con 0x7f5ba40ac820 2024-08-17T02:28:32.434 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.433+0000 7f5ba0a00640 1 -- 172.21.15.45:0/3342170594 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b880034e0 con 0x7f5ba40ac820 2024-08-17T02:28:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.433+0000 7f5ba0a00640 1 -- 172.21.15.45:0/3342170594 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3331702573 0 0) 0x7f5ba40afb20 con 0x7f5ba4158cb0 2024-08-17T02:28:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.433+0000 7f5ba0a00640 1 -- 172.21.15.45:0/3342170594 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ba40abc80 con 0x7f5ba4158cb0 2024-08-17T02:28:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.433+0000 7f5ba1400640 1 -- 172.21.15.45:0/3342170594 >> v1:172.21.15.169:6789/0 conn(0x7f5ba4158cb0 legacy=0x7f5ba40ac110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.433+0000 7f5ba1400640 1 -- 172.21.15.45:0/3342170594 >> v1:172.21.15.45:6789/0 conn(0x7f5ba40ac820 legacy=0x7f5ba4159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.433+0000 7f5ba1400640 1 -- 172.21.15.45:0/3342170594 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba40ab070 con 0x7f5ba40af6d0 2024-08-17T02:28:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.434+0000 7f5ba1400640 1 --2- 172.21.15.45:0/3342170594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ba40af6d0 0x7f5ba40aa910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009880 tx=0x7f5b900090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49b4b98cc9329f5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.435 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.435+0000 7f5ba0a00640 1 -- 172.21.15.45:0/3342170594 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9002ae20 con 0x7f5ba40af6d0 2024-08-17T02:28:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.435+0000 7f5ba0a00640 1 -- 172.21.15.45:0/3342170594 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b90032440 con 0x7f5ba40af6d0 2024-08-17T02:28:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.435+0000 7f5ba0a00640 1 -- 172.21.15.45:0/3342170594 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b900327e0 con 0x7f5ba40af6d0 2024-08-17T02:28:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.435+0000 7f5ba8e00640 1 -- 172.21.15.45:0/3342170594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ba40af6d0 msgr2=0x7f5ba40aa910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.435+0000 7f5ba8e00640 1 --2- 172.21.15.45:0/3342170594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ba40af6d0 0x7f5ba40aa910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009880 tx=0x7f5b900090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.436 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.436+0000 7f5ba8e00640 1 -- 172.21.15.45:0/3342170594 shutdown_connections 2024-08-17T02:28:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.436+0000 7f5ba8e00640 1 --2- 172.21.15.45:0/3342170594 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ba40af6d0 0x7f5ba40aa910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.436+0000 7f5ba8e00640 1 -- 172.21.15.45:0/3342170594 >> 172.21.15.45:0/3342170594 conn(0x7f5ba4096a70 msgr2=0x7f5ba4096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.436+0000 7f5ba8e00640 1 -- 172.21.15.45:0/3342170594 shutdown_connections 2024-08-17T02:28:32.437 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.436+0000 7f5ba8e00640 1 -- 172.21.15.45:0/3342170594 wait complete. 2024-08-17T02:28:32.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.437+0000 7f5ba8e00640 1 Processor -- start 2024-08-17T02:28:32.438 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.437+0000 7f5ba8e00640 1 -- start start 2024-08-17T02:28:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.438+0000 7f5ba8e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ba40ac820 0x7f5ba409a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.438+0000 7f5ba8e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40af6d0 0x7f5ba40c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.438+0000 7f5ba8e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ba4158cb0 0x7f5ba4098b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.438+0000 7f5ba8e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40c8ef0 con 0x7f5ba40af6d0 2024-08-17T02:28:32.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.438+0000 7f5ba8e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40c7c10 con 0x7f5ba4158cb0 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.438+0000 7f5ba8e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba40c8a60 con 0x7f5ba40ac820 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.438+0000 7f5ba1400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40af6d0 0x7f5ba40c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.438+0000 7f5ba1400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40af6d0 0x7f5ba40c76d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51056/0 (socket says 172.21.15.45:51056) 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.438+0000 7f5ba1400640 1 -- 172.21.15.45:0/1047358489 learned_addr learned my addr 172.21.15.45:0/1047358489 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.438+0000 7f5ba1e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ba40ac820 0x7f5ba409a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.439+0000 7f5ba2800640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ba4158cb0 0x7f5ba4098b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.439+0000 7f5ba1400640 1 -- 172.21.15.45:0/1047358489 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ba40ac820 msgr2=0x7f5ba409a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.439+0000 7f5ba1400640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ba40ac820 0x7f5ba409a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.439+0000 7f5ba1400640 1 -- 172.21.15.45:0/1047358489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ba4158cb0 msgr2=0x7f5ba4098b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.439+0000 7f5ba1400640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ba4158cb0 0x7f5ba4098b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.439+0000 7f5ba1400640 1 -- 172.21.15.45:0/1047358489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b90009390 con 0x7f5ba40af6d0 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.439+0000 7f5ba2800640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ba4158cb0 0x7f5ba4098b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.439+0000 7f5ba1400640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40af6d0 0x7f5ba40c76d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009880 tx=0x7f5b90032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.439+0000 7f5b99600640 1 -- 172.21.15.45:0/1047358489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90000c40 con 0x7f5ba40af6d0 2024-08-17T02:28:32.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.439+0000 7f5b99600640 1 -- 172.21.15.45:0/1047358489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b90031a60 con 0x7f5ba40af6d0 2024-08-17T02:28:32.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.440+0000 7f5ba8e00640 1 -- 172.21.15.45:0/1047358489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba4155c80 con 0x7f5ba40af6d0 2024-08-17T02:28:32.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.440+0000 7f5b99600640 1 -- 172.21.15.45:0/1047358489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90031e20 con 0x7f5ba40af6d0 2024-08-17T02:28:32.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.440+0000 7f5ba8e00640 1 -- 172.21.15.45:0/1047358489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba40c8130 con 0x7f5ba40af6d0 2024-08-17T02:28:32.442 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.441+0000 7f5ba8e00640 1 -- 172.21.15.45:0/1047358489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba40c8bd0 con 0x7f5ba40af6d0 2024-08-17T02:28:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.442+0000 7f5b99600640 1 -- 172.21.15.45:0/1047358489 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5b90039040 con 0x7f5ba40af6d0 2024-08-17T02:28:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.442+0000 7f5b99600640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b84065150 0x7f5b84067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.442+0000 7f5b99600640 1 -- 172.21.15.45:0/1047358489 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f5b900a22e0 con 0x7f5ba40af6d0 2024-08-17T02:28:32.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.443+0000 7f5ba1e00640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b84065150 0x7f5b84067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.443+0000 7f5ba1e00640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b84065150 0x7f5b84067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5b94003970 tx=0x7f5b94007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.447 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.447+0000 7f5b99600640 1 -- 172.21.15.45:0/1047358489 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f5b90070330 con 0x7f5ba40af6d0 2024-08-17T02:28:32.671 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.671+0000 7f5ba8e00640 1 -- 172.21.15.45:0/1047358489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ba4064db0 con 0x7f5ba40af6d0 2024-08-17T02:28:32.672 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.671+0000 7f5b99600640 1 -- 172.21.15.45:0/1047358489 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f5b90073950 con 0x7f5ba40af6d0 2024-08-17T02:28:32.672 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:32.672 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2570743735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2570743735},{"type":"v1","addr":"172.21.15.169:6834","nonce":2570743735}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1704272549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1704272549},{"type":"v1","addr":"172.21.15.169:6835","nonce":1704272549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2899133229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2899133229},{"type":"v1","addr":"172.21.15.45:6836","nonce":2899133229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:19.270401+0000","modified":"2024-08-17T02:26:20.776150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6837/569206503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":569206503},{"type":"v1","addr":"172.21.15.45:6837","nonce":569206503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000631254","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:32.673 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2024-08-17T02:28:32.674 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.673+0000 7f5ba8e00640 1 -- 172.21.15.45:0/1047358489 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b84065150 msgr2=0x7f5b84067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.673+0000 7f5ba8e00640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b84065150 0x7f5b84067600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5b94003970 tx=0x7f5b94007cc0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.673+0000 7f5ba8e00640 1 -- 172.21.15.45:0/1047358489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40af6d0 msgr2=0x7f5ba40c76d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.673+0000 7f5ba8e00640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40af6d0 0x7f5ba40c76d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5b90009880 tx=0x7f5b90032000 comp rx=0 tx=0).stop 2024-08-17T02:28:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.673+0000 7f5ba8e00640 1 -- 172.21.15.45:0/1047358489 shutdown_connections 2024-08-17T02:28:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.673+0000 7f5ba8e00640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5ba4158cb0 0x7f5ba4098b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.673+0000 7f5ba8e00640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40af6d0 0x7f5ba40c76d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.673+0000 7f5ba8e00640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5b84065150 0x7f5b84067600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.673+0000 7f5ba8e00640 1 --2- 172.21.15.45:0/1047358489 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5ba40ac820 0x7f5ba409a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.674+0000 7f5ba8e00640 1 -- 172.21.15.45:0/1047358489 >> 172.21.15.45:0/1047358489 conn(0x7f5ba4096a70 msgr2=0x7f5ba406bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.674+0000 7f5ba8e00640 1 -- 172.21.15.45:0/1047358489 shutdown_connections 2024-08-17T02:28:32.675 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.674+0000 7f5ba8e00640 1 -- 172.21.15.45:0/1047358489 wait complete. 2024-08-17T02:28:32.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:28:32.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.841+0000 7f22f3800640 1 Processor -- start 2024-08-17T02:28:32.842 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.841+0000 7f22f3800640 1 -- start start 2024-08-17T02:28:32.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.842+0000 7f22f3800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22ec155a20 0x7f22ec0adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.842+0000 7f22f3800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22ec155df0 0x7f22ec0ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.842+0000 7f22f3800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f22ec06d7f0 0x7f22ec06dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.842+0000 7f22f3800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec0b0350 con 0x7f22ec155a20 2024-08-17T02:28:32.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.842+0000 7f22f3800640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ec06e1d0 con 0x7f22ec06d7f0 2024-08-17T02:28:32.843 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.842+0000 7f22f3800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec156670 con 0x7f22ec155df0 2024-08-17T02:28:32.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.843+0000 7f22f0e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22ec155a20 0x7f22ec0adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.843+0000 7f22f0e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f22ec155a20 0x7f22ec0adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51062/0 (socket says 172.21.15.45:51062) 2024-08-17T02:28:32.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.843+0000 7f22f0e00640 1 -- 172.21.15.45:0/4024180354 learned_addr learned my addr 172.21.15.45:0/4024180354 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:32.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.843+0000 7f22f1800640 1 --2- 172.21.15.45:0/4024180354 >> v2:172.21.15.169:3300/0 conn(0x7f22ec06d7f0 0x7f22ec06dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.843+0000 7f22ebe00640 1 --2- 172.21.15.45:0/4024180354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22ec155df0 0x7f22ec0ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.843+0000 7f22f0e00640 1 -- 172.21.15.45:0/4024180354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22ec155df0 msgr2=0x7f22ec0ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:32.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.843+0000 7f22f0e00640 1 --2- 172.21.15.45:0/4024180354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22ec155df0 0x7f22ec0ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.843+0000 7f22f0e00640 1 -- 172.21.15.45:0/4024180354 >> v2:172.21.15.169:3300/0 conn(0x7f22ec06d7f0 msgr2=0x7f22ec06dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:32.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.843+0000 7f22f0e00640 1 --2- 172.21.15.45:0/4024180354 >> v2:172.21.15.169:3300/0 conn(0x7f22ec06d7f0 0x7f22ec06dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.843+0000 7f22f0e00640 1 -- 172.21.15.45:0/4024180354 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec06e5e0 con 0x7f22ec155a20 2024-08-17T02:28:32.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.843+0000 7f22f1800640 1 --2- 172.21.15.45:0/4024180354 >> v2:172.21.15.169:3300/0 conn(0x7f22ec06d7f0 0x7f22ec06dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:32.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.844+0000 7f22f0e00640 1 --2- 172.21.15.45:0/4024180354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ec155a20 0x7f22ec0adf10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f22ec1565e0 tx=0x7f22e00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2588e90de9133a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.844+0000 7f22eb400640 1 -- 172.21.15.45:0/4024180354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e002add0 con 0x7f22ec155a20 2024-08-17T02:28:32.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.844+0000 7f22eb400640 1 -- 172.21.15.45:0/4024180354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22e0032440 con 0x7f22ec155a20 2024-08-17T02:28:32.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.844+0000 7f22eb400640 1 -- 172.21.15.45:0/4024180354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22e0032820 con 0x7f22ec155a20 2024-08-17T02:28:32.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.845+0000 7f22f3800640 1 -- 172.21.15.45:0/4024180354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ec155a20 msgr2=0x7f22ec0adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.845+0000 7f22f3800640 1 --2- 172.21.15.45:0/4024180354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ec155a20 0x7f22ec0adf10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f22ec1565e0 tx=0x7f22e00091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.845+0000 7f22f3800640 1 -- 172.21.15.45:0/4024180354 shutdown_connections 2024-08-17T02:28:32.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.845+0000 7f22f3800640 1 --2- 172.21.15.45:0/4024180354 >> v2:172.21.15.169:3300/0 conn(0x7f22ec06d7f0 0x7f22ec06dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.845+0000 7f22f3800640 1 --2- 172.21.15.45:0/4024180354 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22ec155df0 0x7f22ec0ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.845+0000 7f22f3800640 1 --2- 172.21.15.45:0/4024180354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ec155a20 0x7f22ec0adf10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.845+0000 7f22f3800640 1 -- 172.21.15.45:0/4024180354 >> 172.21.15.45:0/4024180354 conn(0x7f22ec0cb9b0 msgr2=0x7f22ec0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:32.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.845+0000 7f22f3800640 1 -- 172.21.15.45:0/4024180354 shutdown_connections 2024-08-17T02:28:32.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.845+0000 7f22f3800640 1 -- 172.21.15.45:0/4024180354 wait complete. 2024-08-17T02:28:32.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.847+0000 7f22f3800640 1 Processor -- start 2024-08-17T02:28:32.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.847+0000 7f22f3800640 1 -- start start 2024-08-17T02:28:32.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22f3800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22ec06d7f0 0x7f22ec143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.850 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22f3800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ec155a20 0x7f22ec06a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22f3800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22ec155df0 0x7f22ec14c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22f3800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec150020 con 0x7f22ec155a20 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22f3800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec14dfe0 con 0x7f22ec155df0 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22f3800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ec1507f0 con 0x7f22ec06d7f0 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22ebe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ec155a20 0x7f22ec06a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22ebe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ec155a20 0x7f22ec06a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51076/0 (socket says 172.21.15.45:51076) 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22ebe00640 1 -- 172.21.15.45:0/4102231278 learned_addr learned my addr 172.21.15.45:0/4102231278 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22f0e00640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22ec06d7f0 0x7f22ec143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22ebe00640 1 -- 172.21.15.45:0/4102231278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22ec06d7f0 msgr2=0x7f22ec143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22f1800640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22ec155df0 0x7f22ec14c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22ebe00640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22ec06d7f0 0x7f22ec143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22ebe00640 1 -- 172.21.15.45:0/4102231278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22ec155df0 msgr2=0x7f22ec14c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:32.851 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22ebe00640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22ec155df0 0x7f22ec14c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:32.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22ebe00640 1 -- 172.21.15.45:0/4102231278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e0009450 con 0x7f22ec155a20 2024-08-17T02:28:32.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22f0e00640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22ec06d7f0 0x7f22ec143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:32.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.848+0000 7f22f1800640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22ec155df0 0x7f22ec14c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:32.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.849+0000 7f22ebe00640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ec155a20 0x7f22ec06a040 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f22d800d890 tx=0x7f22d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.849+0000 7f22dfe00640 1 -- 172.21.15.45:0/4102231278 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d800de20 con 0x7f22ec155a20 2024-08-17T02:28:32.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.849+0000 7f22dfe00640 1 -- 172.21.15.45:0/4102231278 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d80098b0 con 0x7f22ec155a20 2024-08-17T02:28:32.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.849+0000 7f22dfe00640 1 -- 172.21.15.45:0/4102231278 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d8009c50 con 0x7f22ec155a20 2024-08-17T02:28:32.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.849+0000 7f22f3800640 1 -- 172.21.15.45:0/4102231278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22ec150230 con 0x7f22ec155a20 2024-08-17T02:28:32.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.849+0000 7f22f3800640 1 -- 172.21.15.45:0/4102231278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ec143850 con 0x7f22ec155a20 2024-08-17T02:28:32.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.850+0000 7f22f3800640 1 -- 172.21.15.45:0/4102231278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ec14e190 con 0x7f22ec155a20 2024-08-17T02:28:32.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.851+0000 7f22dfe00640 1 -- 172.21.15.45:0/4102231278 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f22d8014620 con 0x7f22ec155a20 2024-08-17T02:28:32.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.852+0000 7f22dfe00640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22cc065150 0x7f22cc067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:32.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.852+0000 7f22dfe00640 1 -- 172.21.15.45:0/4102231278 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7f22d8082d70 con 0x7f22ec155a20 2024-08-17T02:28:32.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.852+0000 7f22f0e00640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22cc065150 0x7f22cc067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:32.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.853+0000 7f22f0e00640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22cc065150 0x7f22cc067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f22e0034000 tx=0x7f22e0032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:32.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:32.856+0000 7f22dfe00640 1 -- 172.21.15.45:0/4102231278 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f22ec14e190 con 0x7f22ec155a20 2024-08-17T02:28:33.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.076+0000 7f22f3800640 1 -- 172.21.15.45:0/4102231278 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f22ec14e150 con 0x7f22ec155a20 2024-08-17T02:28:33.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.076+0000 7f22dfe00640 1 -- 172.21.15.45:0/4102231278 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4618 (secure 0 0 0) 0x7f22d8050dc0 con 0x7f22ec155a20 2024-08-17T02:28:33.077 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:33.077 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2570743735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2570743735},{"type":"v1","addr":"172.21.15.169:6834","nonce":2570743735}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1704272549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1704272549},{"type":"v1","addr":"172.21.15.169:6835","nonce":1704272549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2899133229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2899133229},{"type":"v1","addr":"172.21.15.45:6836","nonce":2899133229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-17T02:26:19.270401+0000","modified":"2024-08-17T02:26:20.776150+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4912},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4912":{"gid":4912,"name":"a","rank":0,"incarnation":19,"state":"up:active","state_seq":7,"addr":"172.21.15.45:6837/569206503","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":569206503},{"type":"v1","addr":"172.21.15.45:6837","nonce":569206503}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000631254","balancer":"","standby_count_wanted":1},"id":3}]} 2024-08-17T02:28:33.077 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2024-08-17T02:28:33.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 -- 172.21.15.45:0/4102231278 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22cc065150 msgr2=0x7f22cc067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22cc065150 0x7f22cc067600 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f22e0034000 tx=0x7f22e0032000 comp rx=0 tx=0).stop 2024-08-17T02:28:33.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 -- 172.21.15.45:0/4102231278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ec155a20 msgr2=0x7f22ec06a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ec155a20 0x7f22ec06a040 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f22d800d890 tx=0x7f22d8008040 comp rx=0 tx=0).stop 2024-08-17T02:28:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 -- 172.21.15.45:0/4102231278 shutdown_connections 2024-08-17T02:28:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f22ec155df0 0x7f22ec14c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ec155a20 0x7f22ec06a040 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f22cc065150 0x7f22cc067600 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 --2- 172.21.15.45:0/4102231278 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f22ec06d7f0 0x7f22ec143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 -- 172.21.15.45:0/4102231278 >> 172.21.15.45:0/4102231278 conn(0x7f22ec0cb9b0 msgr2=0x7f22ec06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 -- 172.21.15.45:0/4102231278 shutdown_connections 2024-08-17T02:28:33.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.078+0000 7f22f3800640 1 -- 172.21.15.45:0/4102231278 wait complete. 2024-08-17T02:28:33.094 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.244+0000 7fe966e00640 1 Processor -- start 2024-08-17T02:28:33.245 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.244+0000 7fe966e00640 1 -- start start 2024-08-17T02:28:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.245+0000 7fe966e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe96013f4a0 0x7fe9600ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.245+0000 7fe966e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fe96006bf30 0x7fe9600ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.245+0000 7fe966e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96006baa0 con 0x7fe96006a8d0 2024-08-17T02:28:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.245+0000 7fe966e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96006ae90 con 0x7fe96013f4a0 2024-08-17T02:28:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.245+0000 7fe966e00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe96006b170 con 0x7fe96006bf30 2024-08-17T02:28:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.246+0000 7fe95fe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe96013f4a0 0x7fe9600ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.247 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.246+0000 7fe964e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe96006a8d0 0x7fe9600ca210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34038/0 (socket says 172.21.15.45:34038) 2024-08-17T02:28:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.246+0000 7fe964e00640 1 -- 172.21.15.45:0/4002938310 learned_addr learned my addr 172.21.15.45:0/4002938310 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.246+0000 7fe95f400640 1 --2- 172.21.15.45:0/4002938310 >> v2:172.21.15.169:3300/0 conn(0x7fe96006bf30 0x7fe9600ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.246+0000 7fe95fe00640 1 -- 172.21.15.45:0/4002938310 >> v2:172.21.15.169:3300/0 conn(0x7fe96006bf30 msgr2=0x7fe9600ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.246+0000 7fe95fe00640 1 --2- 172.21.15.45:0/4002938310 >> v2:172.21.15.169:3300/0 conn(0x7fe96006bf30 0x7fe9600ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.246+0000 7fe95fe00640 1 -- 172.21.15.45:0/4002938310 >> v1:172.21.15.45:6789/0 conn(0x7fe96006a8d0 legacy=0x7fe9600ca210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.246+0000 7fe95fe00640 1 -- 172.21.15.45:0/4002938310 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96006b450 con 0x7fe96013f4a0 2024-08-17T02:28:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.246+0000 7fe95f400640 1 --2- 172.21.15.45:0/4002938310 >> v2:172.21.15.169:3300/0 conn(0x7fe96006bf30 0x7fe9600ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:33.248 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.246+0000 7fe95ea00640 1 -- 172.21.15.45:0/4002938310 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644128541 0 0) 0x7fe96006baa0 con 0x7fe96006a8d0 2024-08-17T02:28:33.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.247+0000 7fe95fe00640 1 --2- 172.21.15.45:0/4002938310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe96013f4a0 0x7fe9600ad2b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe96006d6a0 tx=0x7fe9500090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d4972820cd64e1b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.249 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.247+0000 7fe95ea00640 1 -- 172.21.15.45:0/4002938310 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95002ad20 con 0x7fe96013f4a0 2024-08-17T02:28:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.247+0000 7fe95ea00640 1 -- 172.21.15.45:0/4002938310 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95002ae80 con 0x7fe96013f4a0 2024-08-17T02:28:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.247+0000 7fe95ea00640 1 -- 172.21.15.45:0/4002938310 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe950032670 con 0x7fe96013f4a0 2024-08-17T02:28:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.248+0000 7fe966e00640 1 -- 172.21.15.45:0/4002938310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe96013f4a0 msgr2=0x7fe9600ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.248+0000 7fe966e00640 1 --2- 172.21.15.45:0/4002938310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe96013f4a0 0x7fe9600ad2b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe96006d6a0 tx=0x7fe9500090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.248+0000 7fe966e00640 1 -- 172.21.15.45:0/4002938310 shutdown_connections 2024-08-17T02:28:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.248+0000 7fe966e00640 1 --2- 172.21.15.45:0/4002938310 >> v2:172.21.15.169:3300/0 conn(0x7fe96006bf30 0x7fe9600ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.248+0000 7fe966e00640 1 --2- 172.21.15.45:0/4002938310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe96013f4a0 0x7fe9600ad2b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.248+0000 7fe966e00640 1 -- 172.21.15.45:0/4002938310 >> 172.21.15.45:0/4002938310 conn(0x7fe96006d8f0 msgr2=0x7fe96006dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.248+0000 7fe966e00640 1 -- 172.21.15.45:0/4002938310 shutdown_connections 2024-08-17T02:28:33.250 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.248+0000 7fe966e00640 1 -- 172.21.15.45:0/4002938310 wait complete. 2024-08-17T02:28:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.249+0000 7fe966e00640 1 Processor -- start 2024-08-17T02:28:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.250+0000 7fe966e00640 1 -- start start 2024-08-17T02:28:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.250+0000 7fe966e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe96006a8d0 0x7fe96015d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.250+0000 7fe966e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe96006bf30 0x7fe96015d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.250+0000 7fe966e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe96013f4a0 0x7fe960169080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.253 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.250+0000 7fe966e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9600c5510 con 0x7fe96013f4a0 2024-08-17T02:28:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.250+0000 7fe966e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96015dec0 con 0x7fe96006a8d0 2024-08-17T02:28:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.250+0000 7fe966e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96015e1a0 con 0x7fe96006bf30 2024-08-17T02:28:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe964e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe96013f4a0 0x7fe960169080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe964e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe96013f4a0 0x7fe960169080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51086/0 (socket says 172.21.15.45:51086) 2024-08-17T02:28:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe964e00640 1 -- 172.21.15.45:0/4124800405 learned_addr learned my addr 172.21.15.45:0/4124800405 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe95f400640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe96006bf30 0x7fe96015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe95fe00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe96006a8d0 0x7fe96015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe964e00640 1 -- 172.21.15.45:0/4124800405 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe96006bf30 msgr2=0x7fe96015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.254 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe964e00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe96006bf30 0x7fe96015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe964e00640 1 -- 172.21.15.45:0/4124800405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe96006a8d0 msgr2=0x7fe96015d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe964e00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe96006a8d0 0x7fe96015d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe964e00640 1 -- 172.21.15.45:0/4124800405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe950009390 con 0x7fe96013f4a0 2024-08-17T02:28:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe95fe00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe96006a8d0 0x7fe96015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe95f400640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe96006bf30 0x7fe96015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.251+0000 7fe964e00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe96013f4a0 0x7fe960169080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe95800cc90 tx=0x7fe958001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.252+0000 7fe957400640 1 -- 172.21.15.45:0/4124800405 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95800a850 con 0x7fe96013f4a0 2024-08-17T02:28:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.252+0000 7fe957400640 1 -- 172.21.15.45:0/4124800405 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95800a9b0 con 0x7fe96013f4a0 2024-08-17T02:28:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.252+0000 7fe957400640 1 -- 172.21.15.45:0/4124800405 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95800ad70 con 0x7fe96013f4a0 2024-08-17T02:28:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.252+0000 7fe966e00640 1 -- 172.21.15.45:0/4124800405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96015e480 con 0x7fe96013f4a0 2024-08-17T02:28:33.255 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.252+0000 7fe966e00640 1 -- 172.21.15.45:0/4124800405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96015dba0 con 0x7fe96013f4a0 2024-08-17T02:28:33.256 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.253+0000 7fe966e00640 1 -- 172.21.15.45:0/4124800405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe960064db0 con 0x7fe96013f4a0 2024-08-17T02:28:33.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.254+0000 7fe957400640 1 -- 172.21.15.45:0/4124800405 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fe958007300 con 0x7fe96013f4a0 2024-08-17T02:28:33.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.255+0000 7fe957400640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe940065150 0x7fe940067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.255+0000 7fe957400640 1 -- 172.21.15.45:0/4124800405 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fe958082720 con 0x7fe96013f4a0 2024-08-17T02:28:33.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.255+0000 7fe95fe00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe940065150 0x7fe940067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.257 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.256+0000 7fe95fe00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe940065150 0x7fe940067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe950034000 tx=0x7fe950032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.258+0000 7fe957400640 1 -- 172.21.15.45:0/4124800405 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fe958050740 con 0x7fe96013f4a0 2024-08-17T02:28:33.440 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.439+0000 7fe966e00640 1 -- 172.21.15.45:0/4124800405 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9600afe60 con 0x7fe96013f4a0 2024-08-17T02:28:33.441 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.440+0000 7fe957400640 1 -- 172.21.15.45:0/4124800405 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+15510 (secure 0 0 0) 0x7fe958053d60 con 0x7fe96013f4a0 2024-08-17T02:28:33.441 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:33.441 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":40,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:28:29.979473+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":6,"pool_name":"cephfs.volume_0000000000631254.meta","create_time":"2024-08-17T02:26:17.444576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000631254"}}},{"pool":7,"pool_name":"cephfs.volume_0000000000631254.data","create_time":"2024-08-17T02:26:18.306012+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000631254"}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6836/618002034":"2024-08-18T02:28:26.954889+0000","172.21.15.45:6834/618002034":"2024-08-18T02:28:26.954889+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:33.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 -- 172.21.15.45:0/4124800405 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe940065150 msgr2=0x7fe940067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe940065150 0x7fe940067600 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe950034000 tx=0x7fe950032000 comp rx=0 tx=0).stop 2024-08-17T02:28:33.443 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 -- 172.21.15.45:0/4124800405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe96013f4a0 msgr2=0x7fe960169080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe96013f4a0 0x7fe960169080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe95800cc90 tx=0x7fe958001a80 comp rx=0 tx=0).stop 2024-08-17T02:28:33.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 -- 172.21.15.45:0/4124800405 shutdown_connections 2024-08-17T02:28:33.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe96013f4a0 0x7fe960169080 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fe940065150 0x7fe940067600 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fe96006bf30 0x7fe96015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 --2- 172.21.15.45:0/4124800405 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fe96006a8d0 0x7fe96015d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 -- 172.21.15.45:0/4124800405 >> 172.21.15.45:0/4124800405 conn(0x7fe96006d8f0 msgr2=0x7fe9600adbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 -- 172.21.15.45:0/4124800405 shutdown_connections 2024-08-17T02:28:33.444 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.442+0000 7fe966e00640 1 -- 172.21.15.45:0/4124800405 wait complete. 2024-08-17T02:28:33.458 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000631254 2024-08-17T02:28:33.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.611+0000 7fbb9ee00640 1 Processor -- start 2024-08-17T02:28:33.612 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.611+0000 7fbb9ee00640 1 -- start start 2024-08-17T02:28:33.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.612+0000 7fbb9ee00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb980c7420 0x7fbb98096a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.612+0000 7fbb9ee00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980b18d0 con 0x7fbb98158d60 2024-08-17T02:28:33.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.612+0000 7fbb9ee00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb980b0d00 con 0x7fbb9815cb30 2024-08-17T02:28:33.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.612+0000 7fbb9ee00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980b0fa0 con 0x7fbb980c7420 2024-08-17T02:28:33.613 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.612+0000 7fbb97e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbb98158d60 0x7fbb980b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34040/0 (socket says 172.21.15.45:34040) 2024-08-17T02:28:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.612+0000 7fbb97e00640 1 -- 172.21.15.45:0/2187189036 learned_addr learned my addr 172.21.15.45:0/2187189036 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:33.614 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb9ce00640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb980c7420 0x7fbb98096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750371111 0 0) 0x7fbb980b18d0 con 0x7fbb98158d60 2024-08-17T02:28:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c0034e0 con 0x7fbb98158d60 2024-08-17T02:28:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205907391 0 0) 0x7fbb980b0d00 con 0x7fbb9815cb30 2024-08-17T02:28:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb980b18d0 con 0x7fbb9815cb30 2024-08-17T02:28:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3075470892 0 0) 0x7fbb7c0034e0 con 0x7fbb98158d60 2024-08-17T02:28:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb980c7420 msgr2=0x7fbb98096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb980c7420 0x7fbb98096a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 >> v1:172.21.15.169:6789/0 conn(0x7fbb9815cb30 legacy=0x7fbb980c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.616 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb980b1280 con 0x7fbb98158d60 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7fbb88001470 con 0x7fbb98158d60 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 >> v1:172.21.15.45:6789/0 conn(0x7fbb98158d60 legacy=0x7fbb980b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb980c7420 0x7fbb7c003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb7c0040f0 0x7fbb7c004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.613+0000 7fbb97400640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb7c004cc0 0x7fbb7c005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb980b0fa0 con 0x7fbb7c0040f0 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c00bb10 con 0x7fbb7c004cc0 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c00bcd0 con 0x7fbb980c7420 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb8fe00640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb7c0040f0 0x7fbb7c004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb97e00640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb980c7420 0x7fbb7c003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb9ce00640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb7c004cc0 0x7fbb7c005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.617 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb8fe00640 1 -- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb980c7420 msgr2=0x7fbb7c003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb8fe00640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb980c7420 0x7fbb7c003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb8fe00640 1 -- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb7c004cc0 msgr2=0x7fbb7c005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb8fe00640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb7c004cc0 0x7fbb7c005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb8fe00640 1 -- 172.21.15.45:0/2187189036 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb7c0034e0 con 0x7fbb7c0040f0 2024-08-17T02:28:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb97e00640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb980c7420 0x7fbb7c003b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.614+0000 7fbb9ce00640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb7c004cc0 0x7fbb7c005130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.615+0000 7fbb8fe00640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb7c0040f0 0x7fbb7c004780 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbb80001960 tx=0x7fbb80007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca5a2c98a2e89c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.615+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8002aa70 con 0x7fbb7c0040f0 2024-08-17T02:28:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.615+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8002abd0 con 0x7fbb7c0040f0 2024-08-17T02:28:33.618 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.615+0000 7fbb97400640 1 -- 172.21.15.45:0/2187189036 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb800323f0 con 0x7fbb7c0040f0 2024-08-17T02:28:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.616+0000 7fbb9ee00640 1 -- 172.21.15.45:0/2187189036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb7c0040f0 msgr2=0x7fbb7c004780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.616+0000 7fbb9ee00640 1 --2- 172.21.15.45:0/2187189036 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb7c0040f0 0x7fbb7c004780 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fbb80001960 tx=0x7fbb80007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.616+0000 7fbb9ce00640 1 -- 172.21.15.45:0/2187189036 reap_dead start 2024-08-17T02:28:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.616+0000 7fbb9ee00640 1 -- 172.21.15.45:0/2187189036 shutdown_connections 2024-08-17T02:28:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.616+0000 7fbb9ee00640 1 -- 172.21.15.45:0/2187189036 >> 172.21.15.45:0/2187189036 conn(0x7fbb980b3040 msgr2=0x7fbb980b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.616+0000 7fbb9ee00640 1 -- 172.21.15.45:0/2187189036 shutdown_connections 2024-08-17T02:28:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.616+0000 7fbb9ee00640 1 -- 172.21.15.45:0/2187189036 wait complete. 2024-08-17T02:28:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.617+0000 7fbb9ee00640 1 Processor -- start 2024-08-17T02:28:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.617+0000 7fbb9ee00640 1 -- start start 2024-08-17T02:28:33.621 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.618+0000 7fbb9ee00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb7c0040f0 0x7fbb9814d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.618+0000 7fbb9ee00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb9816a1c0 0x7fbb98096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.618+0000 7fbb9ee00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9816a630 0x7fbb98096fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.618+0000 7fbb9ee00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98159bb0 con 0x7fbb9816a630 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.618+0000 7fbb9ee00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98159280 con 0x7fbb7c0040f0 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.618+0000 7fbb9ee00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb98159560 con 0x7fbb9816a1c0 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb9ce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9816a630 0x7fbb98096fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb9ce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9816a630 0x7fbb98096fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51112/0 (socket says 172.21.15.45:51112) 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb9ce00640 1 -- 172.21.15.45:0/1534575063 learned_addr learned my addr 172.21.15.45:0/1534575063 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb97e00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb7c0040f0 0x7fbb9814d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb8fe00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb9816a1c0 0x7fbb98096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb9ce00640 1 -- 172.21.15.45:0/1534575063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb9816a1c0 msgr2=0x7fbb98096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.622 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb9ce00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb9816a1c0 0x7fbb98096a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb9ce00640 1 -- 172.21.15.45:0/1534575063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb7c0040f0 msgr2=0x7fbb9814d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb9ce00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb7c0040f0 0x7fbb9814d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb9ce00640 1 -- 172.21.15.45:0/1534575063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb98159840 con 0x7fbb9816a630 2024-08-17T02:28:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb9ce00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9816a630 0x7fbb98096fb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbb9806ee10 tx=0x7fbb9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.619+0000 7fbb8f400640 1 -- 172.21.15.45:0/1534575063 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9001b070 con 0x7fbb9816a630 2024-08-17T02:28:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.620+0000 7fbb8f400640 1 -- 172.21.15.45:0/1534575063 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb9000f040 con 0x7fbb9816a630 2024-08-17T02:28:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.620+0000 7fbb9ee00640 1 -- 172.21.15.45:0/1534575063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb9815c570 con 0x7fbb9816a630 2024-08-17T02:28:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.620+0000 7fbb8f400640 1 -- 172.21.15.45:0/1534575063 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb9000e050 con 0x7fbb9816a630 2024-08-17T02:28:33.623 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.620+0000 7fbb9ee00640 1 -- 172.21.15.45:0/1534575063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb9815a040 con 0x7fbb9816a630 2024-08-17T02:28:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.621+0000 7fbb9ee00640 1 -- 172.21.15.45:0/1534575063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb98159d20 con 0x7fbb9816a630 2024-08-17T02:28:33.624 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.621+0000 7fbb8f400640 1 -- 172.21.15.45:0/1534575063 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbb90003020 con 0x7fbb9816a630 2024-08-17T02:28:33.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.622+0000 7fbb8f400640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbb74065150 0x7fbb74067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:33.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.622+0000 7fbb8f400640 1 -- 172.21.15.45:0/1534575063 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5837+0+0 (secure 0 0 0) 0x7fbb900823a0 con 0x7fbb9816a630 2024-08-17T02:28:33.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.622+0000 7fbb97e00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbb74065150 0x7fbb74067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:33.625 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.623+0000 7fbb97e00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbb74065150 0x7fbb74067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbb88000e10 tx=0x7fbb88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:33.627 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.627+0000 7fbb8f400640 1 -- 172.21.15.45:0/1534575063 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbb90050340 con 0x7fbb9816a630 2024-08-17T02:28:33.846 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.846+0000 7fbb9ee00640 1 -- 172.21.15.45:0/1534575063 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000631254"} v 0) v1 -- 0x7fbb98064db0 con 0x7fbb9816a630 2024-08-17T02:28:33.847 INFO:tasks.ceph.mon.a.smithi045.stderr:2024-08-17T02:28:33.846+0000 7f430de00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-17T02:28:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.851+0000 7fbb8f400640 1 -- 172.21.15.45:0/1534575063 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000631254"}]=0 volume_0000000000631254 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 195+0+0 (secure 0 0 0) 0x7fbb90053960 con 0x7fbb9816a630 2024-08-17T02:28:33.852 INFO:teuthology.orchestra.run.smithi045.stderr:volume_0000000000631254 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-17T02:28:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.853+0000 7fbb9ee00640 1 -- 172.21.15.45:0/1534575063 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbb74065150 msgr2=0x7fbb74067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.853+0000 7fbb9ee00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbb74065150 0x7fbb74067600 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fbb88000e10 tx=0x7fbb88009040 comp rx=0 tx=0).stop 2024-08-17T02:28:33.854 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.853+0000 7fbb9ee00640 1 -- 172.21.15.45:0/1534575063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9816a630 msgr2=0x7fbb98096fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.853+0000 7fbb9ee00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9816a630 0x7fbb98096fb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fbb9806ee10 tx=0x7fbb9000b040 comp rx=0 tx=0).stop 2024-08-17T02:28:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.853+0000 7fbb9ee00640 1 -- 172.21.15.45:0/1534575063 shutdown_connections 2024-08-17T02:28:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.853+0000 7fbb9ee00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb9816a630 0x7fbb98096fb0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.853+0000 7fbb9ee00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbb74065150 0x7fbb74067600 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.853+0000 7fbb9ee00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbb9816a1c0 0x7fbb98096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.853+0000 7fbb9ee00640 1 --2- 172.21.15.45:0/1534575063 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbb7c0040f0 0x7fbb9814d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.853+0000 7fbb9ee00640 1 -- 172.21.15.45:0/1534575063 >> 172.21.15.45:0/1534575063 conn(0x7fbb980b3040 msgr2=0x7fbb98156930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.854+0000 7fbb9ee00640 1 -- 172.21.15.45:0/1534575063 shutdown_connections 2024-08-17T02:28:33.855 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:33.854+0000 7fbb9ee00640 1 -- 172.21.15.45:0/1534575063 wait complete. 2024-08-17T02:28:33.859 INFO:tasks.ceph.mds.a.smithi045.stderr: -3218> 2024-08-17T02:26:21.091+0000 7f73b8c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-17T02:28:33.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000631254 --yes-i-really-mean-it 2024-08-17T02:28:33.901 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2024-08-17T02:28:34.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.026+0000 7f7d07200640 1 Processor -- start 2024-08-17T02:28:34.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.027+0000 7f7d07200640 1 -- start start 2024-08-17T02:28:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.028+0000 7f7d07200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d0015c310 0x7f7d0015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.028+0000 7f7d07200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7d000af7d0 0x7f7d00066cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.028+0000 7f7d07200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d000b0af0 con 0x7f7d0015bf40 2024-08-17T02:28:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.028+0000 7f7d07200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d0015d6e0 con 0x7f7d000af7d0 2024-08-17T02:28:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.028+0000 7f7d07200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000a9b80 con 0x7f7d0015c310 2024-08-17T02:28:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.028+0000 7f7d05e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7d0015bf40 0x7f7d00159190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34068/0 (socket says 172.21.15.45:34068) 2024-08-17T02:28:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.028+0000 7f7d05e00640 1 -- 172.21.15.45:0/2509864007 learned_addr learned my addr 172.21.15.45:0/2509864007 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.028+0000 7f7d05400640 1 --2- 172.21.15.45:0/2509864007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d0015c310 0x7f7d0015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.028+0000 7f7d06800640 1 --2- 172.21.15.45:0/2509864007 >> v2:172.21.15.169:3300/0 conn(0x7f7d000af7d0 0x7f7d00066cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.029+0000 7f7d04a00640 1 -- 172.21.15.45:0/2509864007 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3503289491 0 0) 0x7f7d000b0af0 con 0x7f7d0015bf40 2024-08-17T02:28:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.029+0000 7f7d04a00640 1 -- 172.21.15.45:0/2509864007 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce80034e0 con 0x7f7d0015bf40 2024-08-17T02:28:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.029+0000 7f7d05400640 1 -- 172.21.15.45:0/2509864007 >> v2:172.21.15.169:3300/0 conn(0x7f7d000af7d0 msgr2=0x7f7d00066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.029+0000 7f7d05400640 1 --2- 172.21.15.45:0/2509864007 >> v2:172.21.15.169:3300/0 conn(0x7f7d000af7d0 0x7f7d00066cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.029+0000 7f7d05400640 1 -- 172.21.15.45:0/2509864007 >> v1:172.21.15.45:6789/0 conn(0x7f7d0015bf40 legacy=0x7f7d00159190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.029+0000 7f7d05400640 1 -- 172.21.15.45:0/2509864007 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d000afcd0 con 0x7f7d0015c310 2024-08-17T02:28:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.030+0000 7f7d05400640 1 --2- 172.21.15.45:0/2509864007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d0015c310 0x7f7d0015d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009850 tx=0x7f7cf00090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83990ec25ccddc9b server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.030+0000 7f7d04a00640 1 -- 172.21.15.45:0/2509864007 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf002ad00 con 0x7f7d0015c310 2024-08-17T02:28:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.030+0000 7f7d04a00640 1 -- 172.21.15.45:0/2509864007 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf002ae60 con 0x7f7d0015c310 2024-08-17T02:28:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.030+0000 7f7d04a00640 1 -- 172.21.15.45:0/2509864007 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf0032670 con 0x7f7d0015c310 2024-08-17T02:28:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.031+0000 7f7d07200640 1 -- 172.21.15.45:0/2509864007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d0015c310 msgr2=0x7f7d0015d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.031+0000 7f7d07200640 1 --2- 172.21.15.45:0/2509864007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d0015c310 0x7f7d0015d1a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009850 tx=0x7f7cf00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.031+0000 7f7d07200640 1 -- 172.21.15.45:0/2509864007 shutdown_connections 2024-08-17T02:28:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.031+0000 7f7d07200640 1 --2- 172.21.15.45:0/2509864007 >> v2:172.21.15.169:3300/0 conn(0x7f7d000af7d0 0x7f7d00066cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.031+0000 7f7d07200640 1 --2- 172.21.15.45:0/2509864007 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d0015c310 0x7f7d0015d1a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.031+0000 7f7d07200640 1 -- 172.21.15.45:0/2509864007 >> 172.21.15.45:0/2509864007 conn(0x7f7d00067de0 msgr2=0x7f7d000681e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.031+0000 7f7d07200640 1 -- 172.21.15.45:0/2509864007 shutdown_connections 2024-08-17T02:28:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.031+0000 7f7d07200640 1 -- 172.21.15.45:0/2509864007 wait complete. 2024-08-17T02:28:34.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.032+0000 7f7d07200640 1 Processor -- start 2024-08-17T02:28:34.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.032+0000 7f7d07200640 1 -- start start 2024-08-17T02:28:34.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.033+0000 7f7d07200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d000af7d0 0x7f7d000c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.035 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.033+0000 7f7d07200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d0015bf40 0x7f7d0014a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.033+0000 7f7d07200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0015c310 0x7f7d000c4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.033+0000 7f7d07200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d000ac790 con 0x7f7d0015c310 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.033+0000 7f7d07200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d00155820 con 0x7f7d000af7d0 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.033+0000 7f7d07200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0016a3d0 con 0x7f7d0015bf40 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.033+0000 7f7d06800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0015c310 0x7f7d000c4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.033+0000 7f7d06800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0015c310 0x7f7d000c4c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51140/0 (socket says 172.21.15.45:51140) 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.033+0000 7f7d06800640 1 -- 172.21.15.45:0/780167039 learned_addr learned my addr 172.21.15.45:0/780167039 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7d05e00640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d000af7d0 0x7f7d000c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7d05400640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d0015bf40 0x7f7d0014a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7d06800640 1 -- 172.21.15.45:0/780167039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d0015bf40 msgr2=0x7f7d0014a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7d06800640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d0015bf40 0x7f7d0014a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7d06800640 1 -- 172.21.15.45:0/780167039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d000af7d0 msgr2=0x7f7d000c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7d06800640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d000af7d0 0x7f7d000c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7d06800640 1 -- 172.21.15.45:0/780167039 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf0009390 con 0x7f7d0015c310 2024-08-17T02:28:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7d05e00640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d000af7d0 0x7f7d000c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7d06800640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0015c310 0x7f7d000c4c50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009ef0 tx=0x7f7cfc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7cf9600640 1 -- 172.21.15.45:0/780167039 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc00ce10 con 0x7f7d0015c310 2024-08-17T02:28:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7cf9600640 1 -- 172.21.15.45:0/780167039 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cfc00f040 con 0x7f7d0015c310 2024-08-17T02:28:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7cf9600640 1 -- 172.21.15.45:0/780167039 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cfc0146d0 con 0x7f7d0015c310 2024-08-17T02:28:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.034+0000 7f7d07200640 1 -- 172.21.15.45:0/780167039 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d000c3e60 con 0x7f7d0015c310 2024-08-17T02:28:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.035+0000 7f7d07200640 1 -- 172.21.15.45:0/780167039 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d000c4420 con 0x7f7d0015c310 2024-08-17T02:28:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.035+0000 7f7d07200640 1 -- 172.21.15.45:0/780167039 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d000ac900 con 0x7f7d0015c310 2024-08-17T02:28:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.036+0000 7f7cf9600640 1 -- 172.21.15.45:0/780167039 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7cfc014a80 con 0x7f7d0015c310 2024-08-17T02:28:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.037+0000 7f7cf9600640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7ce4065150 0x7f7ce4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.037+0000 7f7cf9600640 1 -- 172.21.15.45:0/780167039 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f7cfc083480 con 0x7f7d0015c310 2024-08-17T02:28:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.037+0000 7f7d05e00640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7ce4065150 0x7f7ce4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.038+0000 7f7d05e00640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7ce4065150 0x7f7ce4067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4005840 tx=0x7f7cf4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:34.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.041+0000 7f7cf9600640 1 -- 172.21.15.45:0/780167039 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7cfc051480 con 0x7f7d0015c310 2024-08-17T02:28:34.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.266+0000 7f7d07200640 1 -- 172.21.15.45:0/780167039 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000631254", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7d00071050 con 0x7f7d0015c310 2024-08-17T02:28:34.853 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.852+0000 7f7cf9600640 1 -- 172.21.15.45:0/780167039 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000631254", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 121+0+0 (secure 0 0 0) 0x7f7cfc054aa0 con 0x7f7d0015c310 2024-08-17T02:28:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 -- 172.21.15.45:0/780167039 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7ce4065150 msgr2=0x7f7ce4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.856 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7ce4065150 0x7f7ce4067600 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4005840 tx=0x7f7cf4009040 comp rx=0 tx=0).stop 2024-08-17T02:28:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 -- 172.21.15.45:0/780167039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0015c310 msgr2=0x7f7d000c4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0015c310 0x7f7d000c4c50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc009ef0 tx=0x7f7cfc00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 -- 172.21.15.45:0/780167039 shutdown_connections 2024-08-17T02:28:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d0015c310 0x7f7d000c4c50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7ce4065150 0x7f7ce4067600 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7d0015bf40 0x7f7d0014a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 --2- 172.21.15.45:0/780167039 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7d000af7d0 0x7f7d000c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 -- 172.21.15.45:0/780167039 >> 172.21.15.45:0/780167039 conn(0x7f7d00067de0 msgr2=0x7f7d00156ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 -- 172.21.15.45:0/780167039 shutdown_connections 2024-08-17T02:28:34.857 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:34.855+0000 7f7d07200640 1 -- 172.21.15.45:0/780167039 wait complete. 2024-08-17T02:28:34.874 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000631254.meta cephfs.volume_0000000000631254.meta --yes-i-really-really-mean-it 2024-08-17T02:28:35.074 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.073+0000 7f65ede00640 1 Processor -- start 2024-08-17T02:28:35.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.073+0000 7f65ede00640 1 -- start start 2024-08-17T02:28:35.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.075+0000 7f65ede00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 0x7f65e80aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.075+0000 7f65ede00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f65e8156d40 0x7f65e806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.075 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.075+0000 7f65ede00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65e81568b0 con 0x7f65e806e420 2024-08-17T02:28:35.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.075+0000 7f65ede00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65e806e8a0 con 0x7f65e8156d40 2024-08-17T02:28:35.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.075+0000 7f65ede00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e8150500 con 0x7f65e8150130 2024-08-17T02:28:35.076 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.075+0000 7f65e6a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 0x7f65e80aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.075+0000 7f65e6a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 0x7f65e80aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:52590/0 (socket says 172.21.15.45:52590) 2024-08-17T02:28:35.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.075+0000 7f65dfe00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f65e8156d40 0x7f65e806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.075+0000 7f65e6a00640 1 -- 172.21.15.45:0/1326724071 learned_addr learned my addr 172.21.15.45:0/1326724071 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:35.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.075+0000 7f65e7400640 1 --1- 172.21.15.45:0/1326724071 >> v1:172.21.15.169:6789/0 conn(0x7f65e806e420 0x7f65e80afbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:49400/0 (socket says 172.21.15.45:49400) 2024-08-17T02:28:35.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.076+0000 7f65e6a00640 1 -- 172.21.15.45:0/1326724071 >> v2:172.21.15.169:3300/0 conn(0x7f65e8156d40 msgr2=0x7f65e806dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:35.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.076+0000 7f65e6a00640 1 --2- 172.21.15.45:0/1326724071 >> v2:172.21.15.169:3300/0 conn(0x7f65e8156d40 0x7f65e806dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.076+0000 7f65e6a00640 1 -- 172.21.15.45:0/1326724071 >> v1:172.21.15.169:6789/0 conn(0x7f65e806e420 legacy=0x7f65e80afbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.077 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.076+0000 7f65e6a00640 1 -- 172.21.15.45:0/1326724071 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e8155fc0 con 0x7f65e8150130 2024-08-17T02:28:35.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.077+0000 7f65e6a00640 1 --2- 172.21.15.45:0/1326724071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 0x7f65e80aa730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009910 tx=0x7f65d80091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=535d290cc4f0e0de server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:35.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.077+0000 7f65e6000640 1 -- 172.21.15.45:0/1326724071 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d802adb0 con 0x7f65e8150130 2024-08-17T02:28:35.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.077+0000 7f65e6000640 1 -- 172.21.15.45:0/1326724071 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65d8032440 con 0x7f65e8150130 2024-08-17T02:28:35.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.077+0000 7f65e6000640 1 -- 172.21.15.45:0/1326724071 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65d8032820 con 0x7f65e8150130 2024-08-17T02:28:35.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.078+0000 7f65ede00640 1 -- 172.21.15.45:0/1326724071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 msgr2=0x7f65e80aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.078+0000 7f65ede00640 1 --2- 172.21.15.45:0/1326724071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 0x7f65e80aa730 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f65d8009910 tx=0x7f65d80091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.078+0000 7f65ede00640 1 -- 172.21.15.45:0/1326724071 shutdown_connections 2024-08-17T02:28:35.079 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.078+0000 7f65ede00640 1 --2- 172.21.15.45:0/1326724071 >> v2:172.21.15.169:3300/0 conn(0x7f65e8156d40 0x7f65e806dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.078+0000 7f65ede00640 1 --2- 172.21.15.45:0/1326724071 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 0x7f65e80aa730 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.078+0000 7f65ede00640 1 -- 172.21.15.45:0/1326724071 >> 172.21.15.45:0/1326724071 conn(0x7f65e8067750 msgr2=0x7f65e806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:35.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.078+0000 7f65ede00640 1 -- 172.21.15.45:0/1326724071 shutdown_connections 2024-08-17T02:28:35.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.078+0000 7f65ede00640 1 -- 172.21.15.45:0/1326724071 wait complete. 2024-08-17T02:28:35.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.079+0000 7f65ede00640 1 Processor -- start 2024-08-17T02:28:35.080 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.079+0000 7f65ede00640 1 -- start start 2024-08-17T02:28:35.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.080+0000 7f65ede00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65e806e420 0x7f65e814c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.080+0000 7f65ede00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 0x7f65e8169ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.080+0000 7f65ede00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e8156d40 0x7f65e806c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.080+0000 7f65ede00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e816a000 con 0x7f65e8156d40 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.080+0000 7f65ede00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e816a380 con 0x7f65e806e420 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.080+0000 7f65ede00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65e816a660 con 0x7f65e8150130 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.080+0000 7f65e7400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e8156d40 0x7f65e806c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.081+0000 7f65e7400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e8156d40 0x7f65e806c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51152/0 (socket says 172.21.15.45:51152) 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.081+0000 7f65e7400640 1 -- 172.21.15.45:0/3860705971 learned_addr learned my addr 172.21.15.45:0/3860705971 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.081+0000 7f65dfe00640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 0x7f65e8169ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.081+0000 7f65e6a00640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65e806e420 0x7f65e814c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.081+0000 7f65e7400640 1 -- 172.21.15.45:0/3860705971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 msgr2=0x7f65e8169ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.081+0000 7f65e7400640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 0x7f65e8169ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.081+0000 7f65e7400640 1 -- 172.21.15.45:0/3860705971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65e806e420 msgr2=0x7f65e814c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.081+0000 7f65e7400640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65e806e420 0x7f65e814c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.081+0000 7f65e7400640 1 -- 172.21.15.45:0/3860705971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d8009450 con 0x7f65e8156d40 2024-08-17T02:28:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.081+0000 7f65e7400640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e8156d40 0x7f65e806c7a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c910 tx=0x7f65e0001690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.081+0000 7f65de000640 1 -- 172.21.15.45:0/3860705971 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000cea0 con 0x7f65e8156d40 2024-08-17T02:28:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.082+0000 7f65de000640 1 -- 172.21.15.45:0/3860705971 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e0005d60 con 0x7f65e8156d40 2024-08-17T02:28:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.082+0000 7f65de000640 1 -- 172.21.15.45:0/3860705971 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e000a870 con 0x7f65e8156d40 2024-08-17T02:28:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.082+0000 7f65ede00640 1 -- 172.21.15.45:0/3860705971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e816a940 con 0x7f65e8156d40 2024-08-17T02:28:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.082+0000 7f65ede00640 1 -- 172.21.15.45:0/3860705971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e816af00 con 0x7f65e8156d40 2024-08-17T02:28:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.083+0000 7f65ede00640 1 -- 172.21.15.45:0/3860705971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e816b120 con 0x7f65e8156d40 2024-08-17T02:28:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.083+0000 7f65de000640 1 -- 172.21.15.45:0/3860705971 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f65e000aca0 con 0x7f65e8156d40 2024-08-17T02:28:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.084+0000 7f65de000640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f65c4065150 0x7f65c4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.084+0000 7f65de000640 1 -- 172.21.15.45:0/3860705971 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5923+0+0 (secure 0 0 0) 0x7f65e00821d0 con 0x7f65e8156d40 2024-08-17T02:28:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.085+0000 7f65e6a00640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f65c4065150 0x7f65c4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:35.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.085+0000 7f65e6a00640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f65c4065150 0x7f65c4067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f65d8034000 tx=0x7f65d8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:35.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.088+0000 7f65de000640 1 -- 172.21.15.45:0/3860705971 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f65e0050230 con 0x7f65e8156d40 2024-08-17T02:28:35.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:35.267+0000 7f65ede00640 1 -- 172.21.15.45:0/3860705971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000631254.meta", "pool2": "cephfs.volume_0000000000631254.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f65e80710c0 con 0x7f65e8156d40 2024-08-17T02:28:36.007 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.006+0000 7f65de000640 1 -- 172.21.15.45:0/3860705971 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000631254.meta", "pool2": "cephfs.volume_0000000000631254.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000631254.meta' removed v42) v1 ==== 241+0+0 (secure 0 0 0) 0x7f65e0053850 con 0x7f65e8156d40 2024-08-17T02:28:36.007 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs.volume_0000000000631254.meta' removed 2024-08-17T02:28:36.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 -- 172.21.15.45:0/3860705971 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f65c4065150 msgr2=0x7f65c4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f65c4065150 0x7f65c4067600 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f65d8034000 tx=0x7f65d8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:36.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 -- 172.21.15.45:0/3860705971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e8156d40 msgr2=0x7f65e806c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.011 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e8156d40 0x7f65e806c7a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f65e000c910 tx=0x7f65e0001690 comp rx=0 tx=0).stop 2024-08-17T02:28:36.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 -- 172.21.15.45:0/3860705971 shutdown_connections 2024-08-17T02:28:36.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65e8156d40 0x7f65e806c7a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f65c4065150 0x7f65c4067600 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f65e8150130 0x7f65e8169ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 --2- 172.21.15.45:0/3860705971 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f65e806e420 0x7f65e814c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 -- 172.21.15.45:0/3860705971 >> 172.21.15.45:0/3860705971 conn(0x7f65e8067750 msgr2=0x7f65e814f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:36.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 -- 172.21.15.45:0/3860705971 shutdown_connections 2024-08-17T02:28:36.012 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.010+0000 7f65ede00640 1 -- 172.21.15.45:0/3860705971 wait complete. 2024-08-17T02:28:36.030 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000631254.data cephfs.volume_0000000000631254.data --yes-i-really-really-mean-it 2024-08-17T02:28:36.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.193+0000 7f7948e00640 1 Processor -- start 2024-08-17T02:28:36.194 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.193+0000 7f7948e00640 1 -- start start 2024-08-17T02:28:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.194+0000 7f7948e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f79440b2bb0 0x7f79440b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.194+0000 7f7948e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f794415c4b0 0x7f79440aac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.194+0000 7f7948e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79440d0a80 con 0x7f79440b5740 2024-08-17T02:28:36.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.194+0000 7f7948e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79440b2130 con 0x7f794415c4b0 2024-08-17T02:28:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.194+0000 7f7948e00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79440b23f0 con 0x7f79440b2bb0 2024-08-17T02:28:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.195+0000 7f7943e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f794415c4b0 0x7f79440aac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.195+0000 7f7943e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f794415c4b0 0x7f79440aac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51164/0 (socket says 172.21.15.45:51164) 2024-08-17T02:28:36.196 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.195+0000 7f7943e00640 1 -- 172.21.15.45:0/3538258241 learned_addr learned my addr 172.21.15.45:0/3538258241 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.195+0000 7f7943400640 1 --2- 172.21.15.45:0/3538258241 >> v2:172.21.15.169:3300/0 conn(0x7f79440b2bb0 0x7f79440b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.195+0000 7f7943e00640 1 -- 172.21.15.45:0/3538258241 >> v2:172.21.15.169:3300/0 conn(0x7f79440b2bb0 msgr2=0x7f79440b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.195+0000 7f7943e00640 1 --2- 172.21.15.45:0/3538258241 >> v2:172.21.15.169:3300/0 conn(0x7f79440b2bb0 0x7f79440b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.195+0000 7f7943e00640 1 -- 172.21.15.45:0/3538258241 >> v1:172.21.15.169:6789/0 conn(0x7f79440b5740 legacy=0x7f794415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.195+0000 7f7943e00640 1 -- 172.21.15.45:0/3538258241 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79440b37a0 con 0x7f794415c4b0 2024-08-17T02:28:36.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.196+0000 7f7943e00640 1 --2- 172.21.15.45:0/3538258241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f794415c4b0 0x7f79440aac20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7944070bc0 tx=0x7f793c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cdeccf0db6b5a1 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.197+0000 7f7942000640 1 -- 172.21.15.45:0/3538258241 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c032470 con 0x7f794415c4b0 2024-08-17T02:28:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.197+0000 7f7942000640 1 -- 172.21.15.45:0/3538258241 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c0325d0 con 0x7f794415c4b0 2024-08-17T02:28:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.197+0000 7f7942000640 1 -- 172.21.15.45:0/3538258241 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c0329b0 con 0x7f794415c4b0 2024-08-17T02:28:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.197+0000 7f7948e00640 1 -- 172.21.15.45:0/3538258241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f794415c4b0 msgr2=0x7f79440aac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.197+0000 7f7948e00640 1 --2- 172.21.15.45:0/3538258241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f794415c4b0 0x7f79440aac20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7944070bc0 tx=0x7f793c009840 comp rx=0 tx=0).stop 2024-08-17T02:28:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.197+0000 7f7948e00640 1 -- 172.21.15.45:0/3538258241 shutdown_connections 2024-08-17T02:28:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.197+0000 7f7948e00640 1 --2- 172.21.15.45:0/3538258241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f794415c4b0 0x7f79440aac20 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.197+0000 7f7948e00640 1 --2- 172.21.15.45:0/3538258241 >> v2:172.21.15.169:3300/0 conn(0x7f79440b2bb0 0x7f79440b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.197+0000 7f7948e00640 1 -- 172.21.15.45:0/3538258241 >> 172.21.15.45:0/3538258241 conn(0x7f79440cfbc0 msgr2=0x7f79440cffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.197+0000 7f7948e00640 1 -- 172.21.15.45:0/3538258241 shutdown_connections 2024-08-17T02:28:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.197+0000 7f7948e00640 1 -- 172.21.15.45:0/3538258241 wait complete. 2024-08-17T02:28:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.199+0000 7f7948e00640 1 Processor -- start 2024-08-17T02:28:36.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.199+0000 7f7948e00640 1 -- start start 2024-08-17T02:28:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7948e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79440b2bb0 0x7f7944157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7948e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440b5740 0x7f79440acb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7948e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f794415c4b0 0x7f79440ad060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7948e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794414a0e0 con 0x7f79440b5740 2024-08-17T02:28:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7948e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79441493e0 con 0x7f79440b2bb0 2024-08-17T02:28:36.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7948e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79441496c0 con 0x7f794415c4b0 2024-08-17T02:28:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7942a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440b5740 0x7f79440acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7942a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440b5740 0x7f79440acb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51174/0 (socket says 172.21.15.45:51174) 2024-08-17T02:28:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7942a00640 1 -- 172.21.15.45:0/1683918083 learned_addr learned my addr 172.21.15.45:0/1683918083 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7943400640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79440b2bb0 0x7f7944157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7943e00640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f794415c4b0 0x7f79440ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7942a00640 1 -- 172.21.15.45:0/1683918083 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f794415c4b0 msgr2=0x7f79440ad060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7942a00640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f794415c4b0 0x7f79440ad060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7942a00640 1 -- 172.21.15.45:0/1683918083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79440b2bb0 msgr2=0x7f7944157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7942a00640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79440b2bb0 0x7f7944157820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.200+0000 7f7942a00640 1 -- 172.21.15.45:0/1683918083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c009ae0 con 0x7f79440b5740 2024-08-17T02:28:36.202 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.201+0000 7f7942a00640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440b5740 0x7f79440acb20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f793000c560 tx=0x7f7930007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.201+0000 7f793aa00640 1 -- 172.21.15.45:0/1683918083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930011590 con 0x7f79440b5740 2024-08-17T02:28:36.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.201+0000 7f793aa00640 1 -- 172.21.15.45:0/1683918083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7930011710 con 0x7f79440b5740 2024-08-17T02:28:36.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.201+0000 7f793aa00640 1 -- 172.21.15.45:0/1683918083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930011ad0 con 0x7f79440b5740 2024-08-17T02:28:36.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.201+0000 7f7948e00640 1 -- 172.21.15.45:0/1683918083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79441499a0 con 0x7f79440b5740 2024-08-17T02:28:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.201+0000 7f7948e00640 1 -- 172.21.15.45:0/1683918083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7944157d60 con 0x7f79440b5740 2024-08-17T02:28:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.202+0000 7f7948e00640 1 -- 172.21.15.45:0/1683918083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79440650c0 con 0x7f79440b5740 2024-08-17T02:28:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.203+0000 7f793aa00640 1 -- 172.21.15.45:0/1683918083 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f793001b3b0 con 0x7f79440b5740 2024-08-17T02:28:36.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.204+0000 7f793aa00640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7924065180 0x7f7924067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.204+0000 7f793aa00640 1 -- 172.21.15.45:0/1683918083 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5448+0+0 (secure 0 0 0) 0x7f7930081880 con 0x7f79440b5740 2024-08-17T02:28:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.204+0000 7f7943400640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7924065180 0x7f7924067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:36.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.205+0000 7f7943400640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7924065180 0x7f7924067630 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7934007ba0 tx=0x7f7934008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:36.208 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.208+0000 7f793aa00640 1 -- 172.21.15.45:0/1683918083 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f79440650c0 con 0x7f79440b5740 2024-08-17T02:28:36.401 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:36.400+0000 7f7948e00640 1 -- 172.21.15.45:0/1683918083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000631254.data", "pool2": "cephfs.volume_0000000000631254.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f79440650c0 con 0x7f79440b5740 2024-08-17T02:28:37.010 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.009+0000 7f793aa00640 1 -- 172.21.15.45:0/1683918083 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000631254.data", "pool2": "cephfs.volume_0000000000631254.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000631254.data' removed v43) v1 ==== 241+0+0 (secure 0 0 0) 0x7f79440650c0 con 0x7f79440b5740 2024-08-17T02:28:37.010 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs.volume_0000000000631254.data' removed 2024-08-17T02:28:37.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.014+0000 7f7948e00640 1 -- 172.21.15.45:0/1683918083 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7924065180 msgr2=0x7f7924067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.014 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.014+0000 7f7948e00640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7924065180 0x7f7924067630 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7934007ba0 tx=0x7f7934008040 comp rx=0 tx=0).stop 2024-08-17T02:28:37.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.014+0000 7f7948e00640 1 -- 172.21.15.45:0/1683918083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440b5740 msgr2=0x7f79440acb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.014+0000 7f7948e00640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440b5740 0x7f79440acb20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f793000c560 tx=0x7f7930007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.014+0000 7f7948e00640 1 -- 172.21.15.45:0/1683918083 shutdown_connections 2024-08-17T02:28:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.014+0000 7f7948e00640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7924065180 0x7f7924067630 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.014+0000 7f7948e00640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f794415c4b0 0x7f79440ad060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.014+0000 7f7948e00640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79440b5740 0x7f79440acb20 secure :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f793000c560 tx=0x7f7930007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.014+0000 7f7948e00640 1 --2- 172.21.15.45:0/1683918083 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f79440b2bb0 0x7f7944157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.014+0000 7f7948e00640 1 -- 172.21.15.45:0/1683918083 >> 172.21.15.45:0/1683918083 conn(0x7f79440cfbc0 msgr2=0x7f79440aefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:37.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.015+0000 7f7948e00640 1 -- 172.21.15.45:0/1683918083 shutdown_connections 2024-08-17T02:28:37.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.015+0000 7f7948e00640 1 -- 172.21.15.45:0/1683918083 wait complete. 2024-08-17T02:28:37.039 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-08-17T02:28:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.194+0000 7f09b7e00640 1 Processor -- start 2024-08-17T02:28:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.195+0000 7f09b7e00640 1 -- start start 2024-08-17T02:28:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.196+0000 7f09b7e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09b8158dd0 0x7f09b80abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.196+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b80ac4f0 0x7f09b8069000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.196+0000 7f09b7e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b80ae330 con 0x7f09b8069540 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.196+0000 7f09b7e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b80699c0 con 0x7f09b8158dd0 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.196+0000 7f09b7e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80aca50 con 0x7f09b80ac4f0 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.196+0000 7f09b6a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09b8158dd0 0x7f09b80abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.196+0000 7f09b7400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f09b8069540 0x7f09b8067d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34074/0 (socket says 172.21.15.45:34074) 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.196+0000 7f09b7400640 1 -- 172.21.15.45:0/3996384414 learned_addr learned my addr 172.21.15.45:0/3996384414 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.197+0000 7f09b6a00640 1 -- 172.21.15.45:0/3996384414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b80ac4f0 msgr2=0x7f09b8069000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.197+0000 7f09afe00640 1 --2- 172.21.15.45:0/3996384414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b80ac4f0 0x7f09b8069000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.197+0000 7f09b6a00640 1 --2- 172.21.15.45:0/3996384414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b80ac4f0 0x7f09b8069000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.197+0000 7f09b6a00640 1 -- 172.21.15.45:0/3996384414 >> v1:172.21.15.45:6789/0 conn(0x7f09b8069540 legacy=0x7f09b8067d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.197+0000 7f09b6a00640 1 -- 172.21.15.45:0/3996384414 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b80acd30 con 0x7f09b8158dd0 2024-08-17T02:28:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.197+0000 7f09b6000640 1 -- 172.21.15.45:0/3996384414 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847992702 0 0) 0x7f09b80ae330 con 0x7f09b8069540 2024-08-17T02:28:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.197+0000 7f09afe00640 1 --2- 172.21.15.45:0/3996384414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b80ac4f0 0x7f09b8069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.198+0000 7f09b6a00640 1 --2- 172.21.15.45:0/3996384414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8158dd0 0x7f09b80abfb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009850 tx=0x7f09a80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47773fb32e1252a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.198+0000 7f09b6000640 1 -- 172.21.15.45:0/3996384414 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a802ad90 con 0x7f09b8158dd0 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.198+0000 7f09b6000640 1 -- 172.21.15.45:0/3996384414 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a8032440 con 0x7f09b8158dd0 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.198+0000 7f09b6000640 1 -- 172.21.15.45:0/3996384414 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a80327e0 con 0x7f09b8158dd0 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.198+0000 7f09b7e00640 1 -- 172.21.15.45:0/3996384414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8158dd0 msgr2=0x7f09b80abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.198+0000 7f09b7e00640 1 --2- 172.21.15.45:0/3996384414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8158dd0 0x7f09b80abfb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009850 tx=0x7f09a80090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.199+0000 7f09b7e00640 1 -- 172.21.15.45:0/3996384414 shutdown_connections 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.199+0000 7f09b7e00640 1 --2- 172.21.15.45:0/3996384414 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b80ac4f0 0x7f09b8069000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.199+0000 7f09b7e00640 1 --2- 172.21.15.45:0/3996384414 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8158dd0 0x7f09b80abfb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.199+0000 7f09b7e00640 1 -- 172.21.15.45:0/3996384414 >> 172.21.15.45:0/3996384414 conn(0x7f09b8096a70 msgr2=0x7f09b80cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.199+0000 7f09b7e00640 1 -- 172.21.15.45:0/3996384414 shutdown_connections 2024-08-17T02:28:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.199+0000 7f09b7e00640 1 -- 172.21.15.45:0/3996384414 wait complete. 2024-08-17T02:28:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.200+0000 7f09b7e00640 1 Processor -- start 2024-08-17T02:28:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.200+0000 7f09b7e00640 1 -- start start 2024-08-17T02:28:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.201+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8069540 0x7f09b8099890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.201+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b80ac4f0 0x7f09b81527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.201+0000 7f09b7e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09b8158dd0 0x7f09b8097750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.201+0000 7f09b7e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b809acf0 con 0x7f09b8069540 2024-08-17T02:28:37.203 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.201+0000 7f09b7e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8099dd0 con 0x7f09b8158dd0 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.201+0000 7f09b7e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b809a070 con 0x7f09b80ac4f0 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.201+0000 7f09b6a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8069540 0x7f09b8099890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.201+0000 7f09b6a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8069540 0x7f09b8099890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51182/0 (socket says 172.21.15.45:51182) 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.201+0000 7f09b6a00640 1 -- 172.21.15.45:0/3625844026 learned_addr learned my addr 172.21.15.45:0/3625844026 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.201+0000 7f09afe00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b80ac4f0 0x7f09b81527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.201+0000 7f09b7400640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09b8158dd0 0x7f09b8097750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.202+0000 7f09b6a00640 1 -- 172.21.15.45:0/3625844026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b80ac4f0 msgr2=0x7f09b81527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.202+0000 7f09b6a00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b80ac4f0 0x7f09b81527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.202+0000 7f09b6a00640 1 -- 172.21.15.45:0/3625844026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09b8158dd0 msgr2=0x7f09b8097750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.202+0000 7f09b6a00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09b8158dd0 0x7f09b8097750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.202+0000 7f09b6a00640 1 -- 172.21.15.45:0/3625844026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a8009390 con 0x7f09b8069540 2024-08-17T02:28:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.202+0000 7f09b6a00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8069540 0x7f09b8099890 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009360 tx=0x7f09a8032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.202+0000 7f09ae000640 1 -- 172.21.15.45:0/3625844026 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a803d420 con 0x7f09b8069540 2024-08-17T02:28:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.202+0000 7f09ae000640 1 -- 172.21.15.45:0/3625844026 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a803d5a0 con 0x7f09b8069540 2024-08-17T02:28:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.202+0000 7f09ae000640 1 -- 172.21.15.45:0/3625844026 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a803d960 con 0x7f09b8069540 2024-08-17T02:28:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.202+0000 7f09b7e00640 1 -- 172.21.15.45:0/3625844026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b809a350 con 0x7f09b8069540 2024-08-17T02:28:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.202+0000 7f09b7e00640 1 -- 172.21.15.45:0/3625844026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b809a910 con 0x7f09b8069540 2024-08-17T02:28:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.203+0000 7f09b7e00640 1 -- 172.21.15.45:0/3625844026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b809ae30 con 0x7f09b8069540 2024-08-17T02:28:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.204+0000 7f09ae000640 1 -- 172.21.15.45:0/3625844026 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f09a8039040 con 0x7f09b8069540 2024-08-17T02:28:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.205+0000 7f09ae000640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0994065150 0x7f0994067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.205+0000 7f09ae000640 1 -- 172.21.15.45:0/3625844026 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f09a80a2550 con 0x7f09b8069540 2024-08-17T02:28:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.205+0000 7f09afe00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0994065150 0x7f0994067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.206+0000 7f09afe00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0994065150 0x7f0994067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09b80b0b10 tx=0x7f09a0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.209+0000 7f09ae000640 1 -- 172.21.15.45:0/3625844026 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f09a80708c0 con 0x7f09b8069540 2024-08-17T02:28:37.392 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.391+0000 7f09b7e00640 1 -- 172.21.15.45:0/3625844026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f09b8071050 con 0x7f09b8069540 2024-08-17T02:28:37.396 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.395+0000 7f09ae000640 1 -- 172.21.15.45:0/3625844026 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f09a8073ee0 con 0x7f09b8069540 2024-08-17T02:28:37.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.397+0000 7f09b7e00640 1 -- 172.21.15.45:0/3625844026 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0994065150 msgr2=0x7f0994067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.398 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.397+0000 7f09b7e00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0994065150 0x7f0994067600 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f09b80b0b10 tx=0x7f09a0008040 comp rx=0 tx=0).stop 2024-08-17T02:28:37.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.397+0000 7f09b7e00640 1 -- 172.21.15.45:0/3625844026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8069540 msgr2=0x7f09b8099890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.397+0000 7f09b7e00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8069540 0x7f09b8099890 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f09a8009360 tx=0x7f09a8032000 comp rx=0 tx=0).stop 2024-08-17T02:28:37.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.397+0000 7f09b7e00640 1 -- 172.21.15.45:0/3625844026 shutdown_connections 2024-08-17T02:28:37.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.397+0000 7f09b7e00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f09b8158dd0 0x7f09b8097750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.397+0000 7f09b7e00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0994065150 0x7f0994067600 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.397+0000 7f09b7e00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f09b80ac4f0 0x7f09b81527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.397+0000 7f09b7e00640 1 --2- 172.21.15.45:0/3625844026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09b8069540 0x7f09b8099890 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.397+0000 7f09b7e00640 1 -- 172.21.15.45:0/3625844026 >> 172.21.15.45:0/3625844026 conn(0x7f09b8096a70 msgr2=0x7f09b8157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:37.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.398+0000 7f09b7e00640 1 -- 172.21.15.45:0/3625844026 shutdown_connections 2024-08-17T02:28:37.399 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.398+0000 7f09b7e00640 1 -- 172.21.15.45:0/3625844026 wait complete. 2024-08-17T02:28:37.413 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2024-08-17T02:28:37.563 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.563+0000 7ff83b200640 1 Processor -- start 2024-08-17T02:28:37.564 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.563+0000 7ff83b200640 1 -- start start 2024-08-17T02:28:37.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.564+0000 7ff83b200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7ff83c155900 0x7ff83c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.564+0000 7ff83b200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c157690 con 0x7ff83c158b30 2024-08-17T02:28:37.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.564+0000 7ff83b200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83c156a80 con 0x7ff83c0b0270 2024-08-17T02:28:37.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.564+0000 7ff83b200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83c156d60 con 0x7ff83c155900 2024-08-17T02:28:37.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.564+0000 7ff83a800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff83c158b30 0x7ff83c0ae6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34076/0 (socket says 172.21.15.45:34076) 2024-08-17T02:28:37.565 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.564+0000 7ff83a800640 1 -- 172.21.15.45:0/1850573638 learned_addr learned my addr 172.21.15.45:0/1850573638 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:37.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453923215 0 0) 0x7ff83c157690 con 0x7ff83c158b30 2024-08-17T02:28:37.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8200034e0 con 0x7ff83c158b30 2024-08-17T02:28:37.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839e00640 1 --2- 172.21.15.45:0/1850573638 >> v2:172.21.15.169:3300/0 conn(0x7ff83c155900 0x7ff83c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4287808524 0 0) 0x7ff8200034e0 con 0x7ff83c158b30 2024-08-17T02:28:37.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 >> v2:172.21.15.169:3300/0 conn(0x7ff83c155900 msgr2=0x7ff83c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.567 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 --2- 172.21.15.45:0/1850573638 >> v2:172.21.15.169:3300/0 conn(0x7ff83c155900 0x7ff83c155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 >> v1:172.21.15.169:6789/0 conn(0x7ff83c0b0270 legacy=0x7ff83c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c157040 con 0x7ff83c158b30 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7ff8340017f0 con 0x7ff83c158b30 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 >> v1:172.21.15.45:6789/0 conn(0x7ff83c158b30 legacy=0x7ff83c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 --2- 172.21.15.45:0/1850573638 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff820003a20 0x7ff820003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 --2- 172.21.15.45:0/1850573638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff820004780 0x7ff820004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 --2- 172.21.15.45:0/1850573638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff820005250 0x7ff82000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c156d60 con 0x7ff820005250 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82000c150 con 0x7ff820004780 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff82000c310 con 0x7ff820003a20 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.565+0000 7ff83a800640 1 --2- 172.21.15.45:0/1850573638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff820005250 0x7ff82000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.566+0000 7ff831400640 1 --2- 172.21.15.45:0/1850573638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff820004780 0x7ff820004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.568 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.566+0000 7ff839e00640 1 --2- 172.21.15.45:0/1850573638 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff820003a20 0x7ff820003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.566+0000 7ff83a800640 1 -- 172.21.15.45:0/1850573638 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff820003a20 msgr2=0x7ff820003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.566+0000 7ff83a800640 1 --2- 172.21.15.45:0/1850573638 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff820003a20 0x7ff820003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.566+0000 7ff83a800640 1 -- 172.21.15.45:0/1850573638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff820004780 msgr2=0x7ff820004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.566+0000 7ff83a800640 1 --2- 172.21.15.45:0/1850573638 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff820004780 0x7ff820004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.569 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.566+0000 7ff83a800640 1 -- 172.21.15.45:0/1850573638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8200034e0 con 0x7ff820005250 2024-08-17T02:28:37.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.567+0000 7ff83a800640 1 -- 172.21.15.45:0/1850573638 reap_dead start 2024-08-17T02:28:37.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.567+0000 7ff83a800640 1 --2- 172.21.15.45:0/1850573638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff820005250 0x7ff82000b9d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff83400a860 tx=0x7ff834002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b89d6fa7ee90e2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.570 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.567+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8340070f0 con 0x7ff820005250 2024-08-17T02:28:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.567+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff834007290 con 0x7ff820005250 2024-08-17T02:28:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.567+0000 7ff839400640 1 -- 172.21.15.45:0/1850573638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834007650 con 0x7ff820005250 2024-08-17T02:28:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.568+0000 7ff83b200640 1 -- 172.21.15.45:0/1850573638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff820005250 msgr2=0x7ff82000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.568+0000 7ff83b200640 1 --2- 172.21.15.45:0/1850573638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff820005250 0x7ff82000b9d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff83400a860 tx=0x7ff834002100 comp rx=0 tx=0).stop 2024-08-17T02:28:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.568+0000 7ff83b200640 1 -- 172.21.15.45:0/1850573638 shutdown_connections 2024-08-17T02:28:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.568+0000 7ff83b200640 1 --2- 172.21.15.45:0/1850573638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff820005250 0x7ff82000b9d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.568+0000 7ff83b200640 1 -- 172.21.15.45:0/1850573638 >> 172.21.15.45:0/1850573638 conn(0x7ff83c067750 msgr2=0x7ff83c0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.568+0000 7ff83b200640 1 -- 172.21.15.45:0/1850573638 shutdown_connections 2024-08-17T02:28:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.568+0000 7ff83b200640 1 -- 172.21.15.45:0/1850573638 wait complete. 2024-08-17T02:28:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.569+0000 7ff83b200640 1 Processor -- start 2024-08-17T02:28:37.571 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.570+0000 7ff83b200640 1 -- start start 2024-08-17T02:28:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.570+0000 7ff83b200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff820005250 0x7ff83c168c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.570+0000 7ff83b200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff83c14a310 0x7ff83c0c1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.570+0000 7ff83b200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff83c14a780 0x7ff83c1578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.570+0000 7ff83b200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c0c1cb0 con 0x7ff83c14a780 2024-08-17T02:28:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.570+0000 7ff83b200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c1691d0 con 0x7ff820005250 2024-08-17T02:28:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.570+0000 7ff83b200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83c0c37d0 con 0x7ff83c14a310 2024-08-17T02:28:37.573 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.571+0000 7ff83a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff83c14a780 0x7ff83c1578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.571+0000 7ff83a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff83c14a780 0x7ff83c1578e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51190/0 (socket says 172.21.15.45:51190) 2024-08-17T02:28:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.571+0000 7ff83a800640 1 -- 172.21.15.45:0/1449478975 learned_addr learned my addr 172.21.15.45:0/1449478975 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.571+0000 7ff831400640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff83c14a310 0x7ff83c0c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.571+0000 7ff839e00640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff820005250 0x7ff83c168c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.571+0000 7ff83a800640 1 -- 172.21.15.45:0/1449478975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff83c14a310 msgr2=0x7ff83c0c1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.571+0000 7ff83a800640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff83c14a310 0x7ff83c0c1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.571+0000 7ff83a800640 1 -- 172.21.15.45:0/1449478975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff820005250 msgr2=0x7ff83c168c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.571+0000 7ff83a800640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff820005250 0x7ff83c168c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.571+0000 7ff83a800640 1 -- 172.21.15.45:0/1449478975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83c0c3a70 con 0x7ff83c14a780 2024-08-17T02:28:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.571+0000 7ff83a800640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff83c14a780 0x7ff83c1578e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff83402b0a0 tx=0x7ff834034000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.574 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.572+0000 7ff832000640 1 -- 172.21.15.45:0/1449478975 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834007070 con 0x7ff83c14a780 2024-08-17T02:28:37.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.572+0000 7ff832000640 1 -- 172.21.15.45:0/1449478975 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8340079c0 con 0x7ff83c14a780 2024-08-17T02:28:37.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.572+0000 7ff832000640 1 -- 172.21.15.45:0/1449478975 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff834007630 con 0x7ff83c14a780 2024-08-17T02:28:37.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.572+0000 7ff83b200640 1 -- 172.21.15.45:0/1449478975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83c0c3d50 con 0x7ff83c14a780 2024-08-17T02:28:37.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.572+0000 7ff83b200640 1 -- 172.21.15.45:0/1449478975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff83c0c4310 con 0x7ff83c14a780 2024-08-17T02:28:37.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.573+0000 7ff83b200640 1 -- 172.21.15.45:0/1449478975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83c0c1e60 con 0x7ff83c14a780 2024-08-17T02:28:37.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.574+0000 7ff832000640 1 -- 172.21.15.45:0/1449478975 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff834005030 con 0x7ff83c14a780 2024-08-17T02:28:37.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.574+0000 7ff832000640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff818065150 0x7ff818067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:37.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.574+0000 7ff832000640 1 -- 172.21.15.45:0/1449478975 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff8340a2e00 con 0x7ff83c14a780 2024-08-17T02:28:37.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.575+0000 7ff839e00640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff818065150 0x7ff818067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:37.576 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.575+0000 7ff839e00640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff818065150 0x7ff818067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00bd50 tx=0x7ff82c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:37.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.579+0000 7ff832000640 1 -- 172.21.15.45:0/1449478975 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7ff83c0c1e60 con 0x7ff83c14a780 2024-08-17T02:28:37.828 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:37.827+0000 7ff83b200640 1 -- 172.21.15.45:0/1449478975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7ff83c071050 con 0x7ff83c14a780 2024-08-17T02:28:38.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.018+0000 7ff832000640 1 -- 172.21.15.45:0/1449478975 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v163) v1 ==== 135+0+0 (secure 0 0 0) 0x7ff8340470c0 con 0x7ff83c14a780 2024-08-17T02:28:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.020+0000 7ff83b200640 1 -- 172.21.15.45:0/1449478975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff818065150 msgr2=0x7ff818067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.020+0000 7ff83b200640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff818065150 0x7ff818067600 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff82c00bd50 tx=0x7ff82c008040 comp rx=0 tx=0).stop 2024-08-17T02:28:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.021+0000 7ff83b200640 1 -- 172.21.15.45:0/1449478975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff83c14a780 msgr2=0x7ff83c1578e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.021+0000 7ff83b200640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff83c14a780 0x7ff83c1578e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff83402b0a0 tx=0x7ff834034000 comp rx=0 tx=0).stop 2024-08-17T02:28:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.021+0000 7ff83b200640 1 -- 172.21.15.45:0/1449478975 shutdown_connections 2024-08-17T02:28:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.021+0000 7ff83b200640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff83c14a780 0x7ff83c1578e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.021+0000 7ff83b200640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff818065150 0x7ff818067600 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.021+0000 7ff83b200640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff83c14a310 0x7ff83c0c1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.021+0000 7ff83b200640 1 --2- 172.21.15.45:0/1449478975 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff820005250 0x7ff83c168c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:38.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.021+0000 7ff83b200640 1 -- 172.21.15.45:0/1449478975 >> 172.21.15.45:0/1449478975 conn(0x7ff83c067750 msgr2=0x7ff83c152040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:38.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.021+0000 7ff83b200640 1 -- 172.21.15.45:0/1449478975 shutdown_connections 2024-08-17T02:28:38.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:38.021+0000 7ff83b200640 1 -- 172.21.15.45:0/1449478975 wait complete. 2024-08-17T02:28:38.040 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ERROR 2024-08-17T02:28:38.040 INFO:tasks.cephfs_test_runner: 2024-08-17T02:28:38.040 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:28:38.040 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:28:38.040 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:28:38.041 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:28:38.042 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:28:38.042 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:28:38.042 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:28:38.042 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:28:38.042 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000631254 --yes-i-really-mean-it' 2024-08-17T02:28:38.042 INFO:tasks.cephfs_test_runner: 2024-08-17T02:28:38.042 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:28:38.042 INFO:tasks.cephfs_test_runner:Ran 1 test in 169.389s 2024-08-17T02:28:38.042 INFO:tasks.cephfs_test_runner: 2024-08-17T02:28:38.042 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-08-17T02:28:38.042 INFO:tasks.cephfs_test_runner: 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner:====================================================================== 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner:ERROR: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 459, in test_volume_create 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", volname, "--yes-i-really-mean-it") 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/ceph_manager.py", line 1631, in run_cluster_cmd 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/remote.py", line 523, in run 2024-08-17T02:28:38.043 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-08-17T02:28:38.044 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 455, in run 2024-08-17T02:28:38.044 INFO:tasks.cephfs_test_runner: r.wait() 2024-08-17T02:28:38.044 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 161, in wait 2024-08-17T02:28:38.044 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-08-17T02:28:38.044 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-08-17T02:28:38.044 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-08-17T02:28:38.044 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000631254 --yes-i-really-mean-it' 2024-08-17T02:28:38.044 INFO:tasks.cephfs_test_runner: 2024-08-17T02:28:38.044 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:28:38.257 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8de90f8382064856b0cb6ff492b71d76 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_67db276914d29505c9707d04f3a3b8fb9d8aee4b/teuthology/run_tasks.py", line 112, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_2577e8139c6b8786f9d6d6ea21b8da9244b9260e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2024-08-17T02:28:38.258 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-08-17T02:28:38.266 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-17T02:28:38.278 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-17T02:28:38.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:38.279 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-08-17T02:28:38.317 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-17T02:28:38.318 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-08-17T02:28:38.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:38.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-17T02:28:38.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:38.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-08-17T02:28:38.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:38.671 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2024-08-17T02:28:38.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:38.955 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2024-08-17T02:28:38.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:38.991 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2024-08-17T02:28:39.091 INFO:teuthology.orchestra.run.smithi045.stderr:Cannot find device "ceph-brx" 2024-08-17T02:28:39.093 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:39.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:39.094 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-08-17T02:28:39.134 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-08-17T02:28:39.134 INFO:teuthology.orchestra.run.smithi169.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-08-17T02:28:39.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:39.135 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-08-17T02:28:39.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:39.237 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-08-17T02:28:39.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:39.520 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link delete ceph-brx 2024-08-17T02:28:39.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:39.847 DEBUG:teuthology.orchestra.run.smithi169:> ip netns list 2024-08-17T02:28:39.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-17T02:28:39.883 DEBUG:teuthology.orchestra.run.smithi169:> sudo ip link delete ceph-brx 2024-08-17T02:28:39.983 INFO:teuthology.orchestra.run.smithi169.stderr:Cannot find device "ceph-brx" 2024-08-17T02:28:39.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:28:39.985 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-08-17T02:28:39.994 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2024-08-17T02:28:39.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:40.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.151+0000 7fa98ca00640 1 Processor -- start 2024-08-17T02:28:40.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.152+0000 7fa98ca00640 1 -- start start 2024-08-17T02:28:40.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.153+0000 7fa98ca00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa988155900 0x7fa988155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.153+0000 7fa98ca00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa9880b0270 0x7fa988156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.153+0000 7fa98ca00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa988157690 con 0x7fa988157b20 2024-08-17T02:28:40.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.153+0000 7fa98ca00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa988156a80 con 0x7fa988155900 2024-08-17T02:28:40.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.153+0000 7fa98ca00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa988156d60 con 0x7fa9880b0270 2024-08-17T02:28:40.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.153+0000 7fa987400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa988155900 0x7fa988155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.153+0000 7fa987400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa988155900 0x7fa988155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51202/0 (socket says 172.21.15.45:51202) 2024-08-17T02:28:40.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.153+0000 7fa987400640 1 -- 172.21.15.45:0/559130392 learned_addr learned my addr 172.21.15.45:0/559130392 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:40.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.153+0000 7fa986a00640 1 --2- 172.21.15.45:0/559130392 >> v2:172.21.15.169:3300/0 conn(0x7fa9880b0270 0x7fa988156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.154+0000 7fa987400640 1 -- 172.21.15.45:0/559130392 >> v2:172.21.15.169:3300/0 conn(0x7fa9880b0270 msgr2=0x7fa988156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.154+0000 7fa987400640 1 --2- 172.21.15.45:0/559130392 >> v2:172.21.15.169:3300/0 conn(0x7fa9880b0270 0x7fa988156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.154+0000 7fa987400640 1 -- 172.21.15.45:0/559130392 >> v1:172.21.15.169:6789/0 conn(0x7fa988157b20 legacy=0x7fa988157f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.154+0000 7fa987400640 1 -- 172.21.15.45:0/559130392 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa988157040 con 0x7fa988155900 2024-08-17T02:28:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.155+0000 7fa987400640 1 --2- 172.21.15.45:0/559130392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa988155900 0x7fa988155cd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa98806f430 tx=0x7fa9780091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea940e7b9243ea3 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.155+0000 7fa986000640 1 -- 172.21.15.45:0/559130392 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97802add0 con 0x7fa988155900 2024-08-17T02:28:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.155+0000 7fa986000640 1 -- 172.21.15.45:0/559130392 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa978032440 con 0x7fa988155900 2024-08-17T02:28:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.155+0000 7fa986000640 1 -- 172.21.15.45:0/559130392 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978032820 con 0x7fa988155900 2024-08-17T02:28:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.156+0000 7fa98ca00640 1 -- 172.21.15.45:0/559130392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa988155900 msgr2=0x7fa988155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.156+0000 7fa98ca00640 1 --2- 172.21.15.45:0/559130392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa988155900 0x7fa988155cd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa98806f430 tx=0x7fa9780091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.156+0000 7fa98ca00640 1 -- 172.21.15.45:0/559130392 shutdown_connections 2024-08-17T02:28:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.156+0000 7fa98ca00640 1 --2- 172.21.15.45:0/559130392 >> v2:172.21.15.169:3300/0 conn(0x7fa9880b0270 0x7fa988156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.156+0000 7fa98ca00640 1 --2- 172.21.15.45:0/559130392 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa988155900 0x7fa988155cd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.156+0000 7fa98ca00640 1 -- 172.21.15.45:0/559130392 >> 172.21.15.45:0/559130392 conn(0x7fa988067750 msgr2=0x7fa9880cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.156+0000 7fa98ca00640 1 -- 172.21.15.45:0/559130392 shutdown_connections 2024-08-17T02:28:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.156+0000 7fa98ca00640 1 -- 172.21.15.45:0/559130392 wait complete. 2024-08-17T02:28:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.157+0000 7fa98ca00640 1 Processor -- start 2024-08-17T02:28:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.157+0000 7fa98ca00640 1 -- start start 2024-08-17T02:28:40.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.158+0000 7fa98ca00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9880b0270 0x7fa9880a7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.162 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.158+0000 7fa98ca00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa988155900 0x7fa9880cad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.158+0000 7fa98ca00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa988157b20 0x7fa9880ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.158+0000 7fa98ca00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880cb260 con 0x7fa9880b0270 2024-08-17T02:28:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.158+0000 7fa98ca00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880ab970 con 0x7fa988157b20 2024-08-17T02:28:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.158+0000 7fa98ca00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9880aa390 con 0x7fa988155900 2024-08-17T02:28:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa987400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9880b0270 0x7fa9880a7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa987400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9880b0270 0x7fa9880a7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51216/0 (socket says 172.21.15.45:51216) 2024-08-17T02:28:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa987400640 1 -- 172.21.15.45:0/372214846 learned_addr learned my addr 172.21.15.45:0/372214846 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:40.163 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa987e00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa988157b20 0x7fa9880ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa986a00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa988155900 0x7fa9880cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa987400640 1 -- 172.21.15.45:0/372214846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa988155900 msgr2=0x7fa9880cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa987400640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa988155900 0x7fa9880cad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa987400640 1 -- 172.21.15.45:0/372214846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa988157b20 msgr2=0x7fa9880ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa987400640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa988157b20 0x7fa9880ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa987400640 1 -- 172.21.15.45:0/372214846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa978009450 con 0x7fa9880b0270 2024-08-17T02:28:40.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa986a00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa988155900 0x7fa9880cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:40.164 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.159+0000 7fa987400640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9880b0270 0x7fa9880a7a80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa978009940 tx=0x7fa978032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.160+0000 7fa97ea00640 1 -- 172.21.15.45:0/372214846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978031c80 con 0x7fa9880b0270 2024-08-17T02:28:40.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.160+0000 7fa97ea00640 1 -- 172.21.15.45:0/372214846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa978031e00 con 0x7fa9880b0270 2024-08-17T02:28:40.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.160+0000 7fa97ea00640 1 -- 172.21.15.45:0/372214846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97803d670 con 0x7fa9880b0270 2024-08-17T02:28:40.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.160+0000 7fa98ca00640 1 -- 172.21.15.45:0/372214846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9880aa670 con 0x7fa9880b0270 2024-08-17T02:28:40.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.160+0000 7fa98ca00640 1 -- 172.21.15.45:0/372214846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9880aac30 con 0x7fa9880b0270 2024-08-17T02:28:40.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.161+0000 7fa98ca00640 1 -- 172.21.15.45:0/372214846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa988071050 con 0x7fa9880b0270 2024-08-17T02:28:40.165 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.162+0000 7fa97ea00640 1 -- 172.21.15.45:0/372214846 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa978039040 con 0x7fa9880b0270 2024-08-17T02:28:40.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.163+0000 7fa97ea00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa968065180 0x7fa968067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.163+0000 7fa97ea00640 1 -- 172.21.15.45:0/372214846 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa9780a23c0 con 0x7fa9880b0270 2024-08-17T02:28:40.166 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.163+0000 7fa986a00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa968065180 0x7fa968067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.167 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.164+0000 7fa986a00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa968065180 0x7fa968067630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa9880a8c20 tx=0x7fa974008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.167+0000 7fa97ea00640 1 -- 172.21.15.45:0/372214846 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa9780707f0 con 0x7fa9880b0270 2024-08-17T02:28:40.349 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.348+0000 7fa98ca00640 1 -- 172.21.15.45:0/372214846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa98806f480 con 0x7fa9880b0270 2024-08-17T02:28:40.350 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.349+0000 7fa97ea00640 1 -- 172.21.15.45:0/372214846 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12389 (secure 0 0 0) 0x7fa978073e10 con 0x7fa9880b0270 2024-08-17T02:28:40.350 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:40.351 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":43,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:28:37.006163+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/569206503":"2024-08-18T02:28:33.847736+0000","172.21.15.45:6835/569206503":"2024-08-18T02:28:33.847736+0000","172.21.15.45:6836/618002034":"2024-08-18T02:28:26.954889+0000","172.21.15.45:6834/618002034":"2024-08-18T02:28:26.954889+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:40.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.351+0000 7fa98ca00640 1 -- 172.21.15.45:0/372214846 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa968065180 msgr2=0x7fa968067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.352 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.351+0000 7fa98ca00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa968065180 0x7fa968067630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fa9880a8c20 tx=0x7fa974008040 comp rx=0 tx=0).stop 2024-08-17T02:28:40.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.351+0000 7fa98ca00640 1 -- 172.21.15.45:0/372214846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9880b0270 msgr2=0x7fa9880a7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.351+0000 7fa98ca00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9880b0270 0x7fa9880a7a80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa978009940 tx=0x7fa978032000 comp rx=0 tx=0).stop 2024-08-17T02:28:40.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.351+0000 7fa98ca00640 1 -- 172.21.15.45:0/372214846 shutdown_connections 2024-08-17T02:28:40.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.351+0000 7fa98ca00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa988157b20 0x7fa9880ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.351+0000 7fa98ca00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa968065180 0x7fa968067630 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.351+0000 7fa98ca00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa988155900 0x7fa9880cad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.353 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.351+0000 7fa98ca00640 1 --2- 172.21.15.45:0/372214846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9880b0270 0x7fa9880a7a80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.351+0000 7fa98ca00640 1 -- 172.21.15.45:0/372214846 >> 172.21.15.45:0/372214846 conn(0x7fa988067750 msgr2=0x7fa988153030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:40.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.352+0000 7fa98ca00640 1 -- 172.21.15.45:0/372214846 shutdown_connections 2024-08-17T02:28:40.354 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.352+0000 7fa98ca00640 1 -- 172.21.15.45:0/372214846 wait complete. 2024-08-17T02:28:40.368 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-08-17T02:28:40.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:40.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.519+0000 7fbe37200640 1 Processor -- start 2024-08-17T02:28:40.520 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.519+0000 7fbe37200640 1 -- start start 2024-08-17T02:28:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.520+0000 7fbe37200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe380b0270 0x7fbe381563e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.520+0000 7fbe37200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbe38158b30 0x7fbe380ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.520+0000 7fbe37200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe38157690 con 0x7fbe38155900 2024-08-17T02:28:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.520+0000 7fbe37200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe38156a80 con 0x7fbe38158b30 2024-08-17T02:28:40.521 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.520+0000 7fbe37200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38156d60 con 0x7fbe380b0270 2024-08-17T02:28:40.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.520+0000 7fbe35400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe380b0270 0x7fbe381563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.520+0000 7fbe36800640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fbe38158b30 0x7fbe380ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.520+0000 7fbe35e00640 1 --1- >> v1:172.21.15.169:6789/0 conn(0x7fbe38155900 0x7fbe38155cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:49452/0 (socket says 172.21.15.45:49452) 2024-08-17T02:28:40.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.520+0000 7fbe35e00640 1 -- 172.21.15.45:0/2770091980 learned_addr learned my addr 172.21.15.45:0/2770091980 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:40.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.521+0000 7fbe34a00640 1 -- 172.21.15.45:0/2770091980 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745444535 0 0) 0x7fbe38157690 con 0x7fbe38155900 2024-08-17T02:28:40.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.521+0000 7fbe35400640 1 -- 172.21.15.45:0/2770091980 >> v2:172.21.15.169:3300/0 conn(0x7fbe38158b30 msgr2=0x7fbe380ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:40.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.521+0000 7fbe35400640 1 --2- 172.21.15.45:0/2770091980 >> v2:172.21.15.169:3300/0 conn(0x7fbe38158b30 0x7fbe380ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.521+0000 7fbe35400640 1 -- 172.21.15.45:0/2770091980 >> v1:172.21.15.169:6789/0 conn(0x7fbe38155900 legacy=0x7fbe38155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.521+0000 7fbe35400640 1 -- 172.21.15.45:0/2770091980 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe38157040 con 0x7fbe380b0270 2024-08-17T02:28:40.523 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.521+0000 7fbe36800640 1 --2- 172.21.15.45:0/2770091980 >> v2:172.21.15.169:3300/0 conn(0x7fbe38158b30 0x7fbe380ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:40.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.522+0000 7fbe35400640 1 --2- 172.21.15.45:0/2770091980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe380b0270 0x7fbe381563e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009850 tx=0x7fbe240090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeed840a9b3d51c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.524 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.522+0000 7fbe34a00640 1 -- 172.21.15.45:0/2770091980 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2402ad00 con 0x7fbe380b0270 2024-08-17T02:28:40.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.522+0000 7fbe34a00640 1 -- 172.21.15.45:0/2770091980 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2402ae60 con 0x7fbe380b0270 2024-08-17T02:28:40.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.522+0000 7fbe34a00640 1 -- 172.21.15.45:0/2770091980 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24032670 con 0x7fbe380b0270 2024-08-17T02:28:40.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.523+0000 7fbe37200640 1 -- 172.21.15.45:0/2770091980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe380b0270 msgr2=0x7fbe381563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.523+0000 7fbe37200640 1 --2- 172.21.15.45:0/2770091980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe380b0270 0x7fbe381563e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009850 tx=0x7fbe240090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.523+0000 7fbe37200640 1 -- 172.21.15.45:0/2770091980 shutdown_connections 2024-08-17T02:28:40.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.523+0000 7fbe37200640 1 --2- 172.21.15.45:0/2770091980 >> v2:172.21.15.169:3300/0 conn(0x7fbe38158b30 0x7fbe380ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.523+0000 7fbe37200640 1 --2- 172.21.15.45:0/2770091980 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe380b0270 0x7fbe381563e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.523+0000 7fbe37200640 1 -- 172.21.15.45:0/2770091980 >> 172.21.15.45:0/2770091980 conn(0x7fbe38067750 msgr2=0x7fbe380cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:40.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.523+0000 7fbe37200640 1 -- 172.21.15.45:0/2770091980 shutdown_connections 2024-08-17T02:28:40.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.523+0000 7fbe37200640 1 -- 172.21.15.45:0/2770091980 wait complete. 2024-08-17T02:28:40.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.524+0000 7fbe37200640 1 Processor -- start 2024-08-17T02:28:40.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.525+0000 7fbe37200640 1 -- start start 2024-08-17T02:28:40.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.525+0000 7fbe37200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe380b0270 0x7fbe38140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.525+0000 7fbe37200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe38155900 0x7fbe38147510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe37200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe38158b30 0x7fbe38146280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe37200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381410a0 con 0x7fbe38155900 2024-08-17T02:28:40.528 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe37200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38147e90 con 0x7fbe38158b30 2024-08-17T02:28:40.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe37200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe381697f0 con 0x7fbe380b0270 2024-08-17T02:28:40.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe35400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe38155900 0x7fbe38147510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe35400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe38155900 0x7fbe38147510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51218/0 (socket says 172.21.15.45:51218) 2024-08-17T02:28:40.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe35400640 1 -- 172.21.15.45:0/1554128995 learned_addr learned my addr 172.21.15.45:0/1554128995 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:40.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe35e00640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe380b0270 0x7fbe38140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe36800640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe38158b30 0x7fbe38146280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe35400640 1 -- 172.21.15.45:0/1554128995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe380b0270 msgr2=0x7fbe38140b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.529 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe35400640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe380b0270 0x7fbe38140b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe35400640 1 -- 172.21.15.45:0/1554128995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe38158b30 msgr2=0x7fbe38146280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe35400640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe38158b30 0x7fbe38146280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.526+0000 7fbe35400640 1 -- 172.21.15.45:0/1554128995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30009a20 con 0x7fbe38155900 2024-08-17T02:28:40.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.527+0000 7fbe35400640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe38155900 0x7fbe38147510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009360 tx=0x7fbe24032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.527+0000 7fbe2d600640 1 -- 172.21.15.45:0/1554128995 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2403c750 con 0x7fbe38155900 2024-08-17T02:28:40.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.527+0000 7fbe2d600640 1 -- 172.21.15.45:0/1554128995 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2403c8b0 con 0x7fbe38155900 2024-08-17T02:28:40.530 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.527+0000 7fbe2d600640 1 -- 172.21.15.45:0/1554128995 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2403cc30 con 0x7fbe38155900 2024-08-17T02:28:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.527+0000 7fbe37200640 1 -- 172.21.15.45:0/1554128995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe24009390 con 0x7fbe38155900 2024-08-17T02:28:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.527+0000 7fbe37200640 1 -- 172.21.15.45:0/1554128995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe38145a80 con 0x7fbe38155900 2024-08-17T02:28:40.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.528+0000 7fbe37200640 1 -- 172.21.15.45:0/1554128995 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe38071050 con 0x7fbe38155900 2024-08-17T02:28:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.529+0000 7fbe2d600640 1 -- 172.21.15.45:0/1554128995 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fbe24039040 con 0x7fbe38155900 2024-08-17T02:28:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.530+0000 7fbe2d600640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbe18065150 0x7fbe18067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.530+0000 7fbe2d600640 1 -- 172.21.15.45:0/1554128995 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fbe24042030 con 0x7fbe38155900 2024-08-17T02:28:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.530+0000 7fbe35e00640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbe18065150 0x7fbe18067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.532 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.531+0000 7fbe35e00640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbe18065150 0x7fbe18067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbe38154d10 tx=0x7fbe28007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.534+0000 7fbe2d600640 1 -- 172.21.15.45:0/1554128995 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fbe24070d50 con 0x7fbe38155900 2024-08-17T02:28:40.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.716+0000 7fbe37200640 1 -- 172.21.15.45:0/1554128995 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbe38149370 con 0x7fbe18065150 2024-08-17T02:28:40.719 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.718+0000 7fbe2d600640 1 -- 172.21.15.45:0/1554128995 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50406 (secure 0 0 0) 0x7fbe38149370 con 0x7fbe18065150 2024-08-17T02:28:40.720 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:40.720 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:28:40.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 -- 172.21.15.45:0/1554128995 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbe18065150 msgr2=0x7fbe18067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbe18065150 0x7fbe18067600 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbe38154d10 tx=0x7fbe28007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 -- 172.21.15.45:0/1554128995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe38155900 msgr2=0x7fbe38147510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.722 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe38155900 0x7fbe38147510 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009360 tx=0x7fbe24032000 comp rx=0 tx=0).stop 2024-08-17T02:28:40.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 -- 172.21.15.45:0/1554128995 shutdown_connections 2024-08-17T02:28:40.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fbe38158b30 0x7fbe38146280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe38155900 0x7fbe38147510 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fbe18065150 0x7fbe18067600 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 --2- 172.21.15.45:0/1554128995 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fbe380b0270 0x7fbe38140b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 -- 172.21.15.45:0/1554128995 >> 172.21.15.45:0/1554128995 conn(0x7fbe38067750 msgr2=0x7fbe3806e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:40.723 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 -- 172.21.15.45:0/1554128995 shutdown_connections 2024-08-17T02:28:40.724 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.721+0000 7fbe37200640 1 -- 172.21.15.45:0/1554128995 wait complete. 2024-08-17T02:28:40.738 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-17T02:28:39.709445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400620,"kb_used_data":5112,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574100,"statfs":{"total":773094113280,"available":770635878400,"internally_reserved":0,"allocated":5234688,"data_stored":2879024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000908"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:28:36.238712+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:28:36.238712+0000","last_peered":"2024-08-17T02:28:36.238712+0000","last_clean":"2024-08-17T02:28:36.238712+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:28:36.238712+0000","last_undegraded":"2024-08-17T02:28:36.238712+0000","last_fullsized":"2024-08-17T02:28:36.238712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298420,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073420,"statfs":{"total":96636764160,"available":96331182080,"internally_reserved":0,"allocated":1089536,"data_stored":799124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.622,"15min":0.58699999999999997},"min":{"1min":0.497,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69899999999999995,"15min":0.68799999999999994},"min":{"1min":0.627,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92500000000000004,"5min":1.173,"15min":1.173},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.47799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65100000000000002,"15min":0.63500000000000001},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.042,"15min":1.042},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.629,"15min":0.61399999999999999},"min":{"1min":0.49199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83899999999999997,"5min":0.879,"15min":0.879},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69899999999999995,"15min":0.66900000000000004},"min":{"1min":0.54300000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.57999999999999996,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94699999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76500000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.874,"15min":0.874},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61499999999999999,"15min":0.627},"min":{"1min":0.437,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71799999999999997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.71199999999999997,"15min":0.745},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.875}]},{"osd":6,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93100000000000005,"5min":1.137,"15min":1.137},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66500000000000004,"15min":0.65300000000000002},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.76000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66200000000000003,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88200000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67300000000000004,"15min":0.65700000000000003},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89900000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.34699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.51400000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.97799999999999998,"5min":1.339,"15min":1.339},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.55700000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88800000000000001,"5min":1.196,"15min":1.196},"last":0.439}]},{"osd":2,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.58099999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.54000000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.86899999999999999,"15min":0.92300000000000004},"min":{"1min":0.58099999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":4.8449999999999998,"15min":4.8449999999999998},"last":0.66800000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.625,"15min":0.66900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.628,"15min":0.65900000000000003},"min":{"1min":0.44600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.84899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.47399999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95799999999999996,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92100000000000004,"5min":1.804,"15min":1.804},"last":0.55500000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71499999999999997,"15min":0.749},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94299999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.71099999999999997,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":1.002,"15min":1.002},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":495616,"data_stored":208756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.57799999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":0.85799999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.623}]},{"osd":1,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68300000000000005,"15min":0.63200000000000001},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68300000000000005,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65200000000000002,"15min":0.61899999999999999},"min":{"1min":0.56999999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65900000000000003,"15min":0.624},"min":{"1min":0.495,"5min":0.443,"15min":0.443},"max":{"1min":0.92400000000000004,"5min":1.425,"15min":1.425},"last":0.60399999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70799999999999996,"15min":0.68600000000000005},"min":{"1min":0.60699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84499999999999997,"5min":1.776,"15min":1.776},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69999999999999996,"15min":0.68100000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.90400000000000003,"5min":1.014,"15min":1.014},"last":0.69799999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60599999999999998,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81999999999999995,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.877,"5min":2.262,"15min":2.262},"last":0.755}]},{"osd":6,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":1.829,"15min":1.829},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.71299999999999997},"min":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.86299999999999999,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80900000000000005,"5min":2.351,"15min":2.351},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.86199999999999999,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.84999999999999998},"min":{"1min":0.48599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.94999999999999996,"5min":4.5339999999999998,"15min":4.5339999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.79300000000000004,"15min":0.83099999999999996},"min":{"1min":0.54200000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.80000000000000004,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.628}]},{"osd":1,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96499999999999997,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.745,"15min":0.75},"min":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.93400000000000005,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.77000000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70099999999999996,"15min":0.68700000000000006},"min":{"1min":0.57799999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.56100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83899999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.754,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80300000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86799999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.50700000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.75800000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.874}]},{"osd":7,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.502,"5min":0.437,"15min":0.437},"max":{"1min":0.79200000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0740000000000001,"5min":1.077,"15min":1.077},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.56699999999999995,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.47699999999999998,"15min":0.46500000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59799999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47099999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46600000000000003,"15min":0.45400000000000001},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.505,"5min":0.372,"15min":0.372},"max":{"1min":0.72899999999999998,"5min":1.349,"15min":1.349},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84099999999999997,"5min":0.871,"15min":0.871},"last":0.51600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.621,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.131,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78500000000000003,"15min":0.77500000000000002},"min":{"1min":0.66300000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.0109999999999999,"5min":1.252,"15min":1.252},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80400000000000005,"15min":0.79500000000000004},"min":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.075,"5min":1.216,"15min":1.216},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.113,"5min":1.446,"15min":1.446},"last":0.77400000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85699999999999998,"15min":0.86599999999999999},"min":{"1min":0.76500000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0589999999999999,"5min":1.522,"15min":1.522},"last":0.749},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82399999999999995},"min":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.996,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.63}]},{"osd":7,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.752,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.083,"5min":1.446,"15min":1.446},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81200000000000006,"15min":0.80800000000000005},"min":{"1min":0.65900000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.097,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":495616,"data_stored":208756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68200000000000005,"5min":1.931,"15min":1.931},"last":0.442},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68000000000000005,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.54300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.626,"5min":1.478,"15min":1.478},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59199999999999997,"15min":0.627},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.496}]},{"osd":3,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70199999999999996,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.53800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86399999999999999,"15min":0.88200000000000001},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.083,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.044,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.879}]},{"osd":5,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.65100000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98399999999999999,"5min":2.302,"15min":2.302},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.876,"15min":0.90400000000000003},"min":{"1min":0.66300000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96499999999999997,"5min":2.444,"15min":2.444},"last":0.93700000000000006}]},{"osd":6,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.68000000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.002,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.84999999999999998,"15min":0.86499999999999999},"min":{"1min":0.61499999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0589999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.85199999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.871,"15min":0.89300000000000002},"min":{"1min":0.68899999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.032,"5min":2.512,"15min":2.512},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.84299999999999997,"15min":0.84599999999999997},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0069999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.81100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40400000000000003},"min":{"1min":0.32500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.46600000000000003,"15min":0.45400000000000001},"min":{"1min":0.36699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66400000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.497},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":0.878,"15min":0.878},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.48199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.92900000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.505,"15min":0.47999999999999998},"min":{"1min":0.44900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.63800000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.04,"5min":1.137,"15min":1.137},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.018,"5min":1.867,"15min":1.867},"last":0.68600000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0269999999999999,"5min":1.464,"15min":1.464},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.079,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81799999999999995,"15min":0.82499999999999996},"min":{"1min":0.61899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.117,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.68700000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.0589999999999999,"5min":1.548,"15min":1.548},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0629999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.627,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.99399999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1105920,"data_stored":804772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.32000000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.752,"15min":0.752},"last":0.49399999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.623,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":1.3420000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.40200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.751},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58799999999999997,"15min":0.59699999999999998},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":1.2829999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.76200000000000001},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.99299999999999999,"5min":1.141,"15min":1.141},"last":0.94899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.77600000000000002},"min":{"1min":0.68999999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.99199999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.147},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.268,"15min":1.268},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.038,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.6890000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.62,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0609999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.2150000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96599999999999997,"5min":1.333,"15min":1.333},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83899999999999997,"15min":0.85099999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.179,"5min":1.204,"15min":1.204},"last":1.643}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:40.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.890+0000 7f7ab0e00640 1 Processor -- start 2024-08-17T02:28:40.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.891+0000 7f7ab0e00640 1 -- start start 2024-08-17T02:28:40.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.892+0000 7f7ab0e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f7aac06d7a0 0x7f7aac06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.892+0000 7f7ab0e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7aac0acf10 0x7f7aac06e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.892+0000 7f7ab0e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aac0ae250 con 0x7f7aac15ccc0 2024-08-17T02:28:40.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.892+0000 7f7ab0e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aac06e820 con 0x7f7aac0acf10 2024-08-17T02:28:40.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.892+0000 7f7ab0e00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aac0ad640 con 0x7f7aac06d7a0 2024-08-17T02:28:40.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.892+0000 7f7aa3e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7aac0acf10 0x7f7aac06e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.892+0000 7f7aa3e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7aac0acf10 0x7f7aac06e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51226/0 (socket says 172.21.15.45:51226) 2024-08-17T02:28:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.892+0000 7f7aa3e00640 1 -- 172.21.15.45:0/2960605003 learned_addr learned my addr 172.21.15.45:0/2960605003 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:40.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.892+0000 7f7aab400640 1 --2- 172.21.15.45:0/2960605003 >> v2:172.21.15.169:3300/0 conn(0x7f7aac06d7a0 0x7f7aac06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.893+0000 7f7aa3e00640 1 -- 172.21.15.45:0/2960605003 >> v2:172.21.15.169:3300/0 conn(0x7f7aac06d7a0 msgr2=0x7f7aac06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.893+0000 7f7aa3e00640 1 --2- 172.21.15.45:0/2960605003 >> v2:172.21.15.169:3300/0 conn(0x7f7aac06d7a0 0x7f7aac06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.893+0000 7f7aa3e00640 1 -- 172.21.15.45:0/2960605003 >> v1:172.21.15.169:6789/0 conn(0x7f7aac15ccc0 legacy=0x7f7aac15d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.893+0000 7f7aa3e00640 1 -- 172.21.15.45:0/2960605003 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac0ad920 con 0x7f7aac0acf10 2024-08-17T02:28:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.894+0000 7f7aa3e00640 1 --2- 172.21.15.45:0/2960605003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aac0acf10 0x7f7aac06e2e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0704a0 tx=0x7f7a940091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e777c8cab4636999 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.894+0000 7f7aaaa00640 1 -- 172.21.15.45:0/2960605003 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9402ae80 con 0x7f7aac0acf10 2024-08-17T02:28:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.894+0000 7f7aaaa00640 1 -- 172.21.15.45:0/2960605003 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a94032440 con 0x7f7aac0acf10 2024-08-17T02:28:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.894+0000 7f7aaaa00640 1 -- 172.21.15.45:0/2960605003 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94032800 con 0x7f7aac0acf10 2024-08-17T02:28:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.894+0000 7f7ab0e00640 1 -- 172.21.15.45:0/2960605003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aac0acf10 msgr2=0x7f7aac06e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.894+0000 7f7ab0e00640 1 --2- 172.21.15.45:0/2960605003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aac0acf10 0x7f7aac06e2e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0704a0 tx=0x7f7a940091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.895+0000 7f7ab0e00640 1 -- 172.21.15.45:0/2960605003 shutdown_connections 2024-08-17T02:28:40.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.895+0000 7f7ab0e00640 1 --2- 172.21.15.45:0/2960605003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aac0acf10 0x7f7aac06e2e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.895+0000 7f7ab0e00640 1 --2- 172.21.15.45:0/2960605003 >> v2:172.21.15.169:3300/0 conn(0x7f7aac06d7a0 0x7f7aac06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.895+0000 7f7ab0e00640 1 -- 172.21.15.45:0/2960605003 >> 172.21.15.45:0/2960605003 conn(0x7f7aac067750 msgr2=0x7f7aac0cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:40.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.895+0000 7f7ab0e00640 1 -- 172.21.15.45:0/2960605003 shutdown_connections 2024-08-17T02:28:40.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.895+0000 7f7ab0e00640 1 -- 172.21.15.45:0/2960605003 wait complete. 2024-08-17T02:28:40.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.896+0000 7f7ab0e00640 1 Processor -- start 2024-08-17T02:28:40.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.896+0000 7f7ab0e00640 1 -- start start 2024-08-17T02:28:40.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.897+0000 7f7ab0e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aac06d7a0 0x7f7aac15ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.897+0000 7f7ab0e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7aac0acf10 0x7f7aac0ca240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.897+0000 7f7ab0e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7aac15ccc0 0x7f7aac16e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.897+0000 7f7ab0e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac16dba0 con 0x7f7aac06d7a0 2024-08-17T02:28:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.897+0000 7f7ab0e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac157150 con 0x7f7aac0acf10 2024-08-17T02:28:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.897+0000 7f7ab0e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aac0ca920 con 0x7f7aac15ccc0 2024-08-17T02:28:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.897+0000 7f7aab400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aac06d7a0 0x7f7aac15ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.897+0000 7f7aab400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aac06d7a0 0x7f7aac15ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51230/0 (socket says 172.21.15.45:51230) 2024-08-17T02:28:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.897+0000 7f7aab400640 1 -- 172.21.15.45:0/1396745670 learned_addr learned my addr 172.21.15.45:0/1396745670 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7aa3e00640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7aac0acf10 0x7f7aac0ca240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7aabe00640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7aac15ccc0 0x7f7aac16e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7aab400640 1 -- 172.21.15.45:0/1396745670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7aac15ccc0 msgr2=0x7f7aac16e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7aab400640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7aac15ccc0 0x7f7aac16e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7aab400640 1 -- 172.21.15.45:0/1396745670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7aac0acf10 msgr2=0x7f7aac0ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7aab400640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7aac0acf10 0x7f7aac0ca240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:40.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7aab400640 1 -- 172.21.15.45:0/1396745670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a94009450 con 0x7f7aac06d7a0 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7aab400640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aac06d7a0 0x7f7aac15ba80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00ea20 tx=0x7f7a9c0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7aa2a00640 1 -- 172.21.15.45:0/1396745670 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c00ca10 con 0x7f7aac06d7a0 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7aa2a00640 1 -- 172.21.15.45:0/1396745670 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c00cb70 con 0x7f7aac06d7a0 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7aa2a00640 1 -- 172.21.15.45:0/1396745670 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c013470 con 0x7f7aac06d7a0 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.898+0000 7f7ab0e00640 1 -- 172.21.15.45:0/1396745670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aac0cac00 con 0x7f7aac06d7a0 2024-08-17T02:28:40.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.899+0000 7f7ab0e00640 1 -- 172.21.15.45:0/1396745670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aac16d830 con 0x7f7aac06d7a0 2024-08-17T02:28:40.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.900+0000 7f7ab0e00640 1 -- 172.21.15.45:0/1396745670 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aac071050 con 0x7f7aac06d7a0 2024-08-17T02:28:40.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.900+0000 7f7aa2a00640 1 -- 172.21.15.45:0/1396745670 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f7a9c013860 con 0x7f7aac06d7a0 2024-08-17T02:28:40.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.901+0000 7f7aa2a00640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a88065150 0x7f7a88067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:40.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.901+0000 7f7aa2a00640 1 -- 172.21.15.45:0/1396745670 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f7a9c0824b0 con 0x7f7aac06d7a0 2024-08-17T02:28:40.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.901+0000 7f7aa3e00640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a88065150 0x7f7a88067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:40.904 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.902+0000 7f7aa3e00640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a88065150 0x7f7a88067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7a94034000 tx=0x7f7a94032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:40.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:40.905+0000 7f7aa2a00640 1 -- 172.21.15.45:0/1396745670 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f7a9c0508a0 con 0x7f7aac06d7a0 2024-08-17T02:28:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.084+0000 7f7ab0e00640 1 -- 172.21.15.45:0/1396745670 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7aac16dce0 con 0x7f7a88065150 2024-08-17T02:28:41.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.086+0000 7f7aa2a00640 1 -- 172.21.15.45:0/1396745670 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50406 (secure 0 0 0) 0x7f7a94000ce0 con 0x7f7a88065150 2024-08-17T02:28:41.088 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:28:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 -- 172.21.15.45:0/1396745670 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a88065150 msgr2=0x7f7a88067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a88065150 0x7f7a88067600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7a94034000 tx=0x7f7a94032000 comp rx=0 tx=0).stop 2024-08-17T02:28:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 -- 172.21.15.45:0/1396745670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aac06d7a0 msgr2=0x7f7aac15ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aac06d7a0 0x7f7aac15ba80 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00ea20 tx=0x7f7a9c0090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 -- 172.21.15.45:0/1396745670 shutdown_connections 2024-08-17T02:28:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f7a88065150 0x7f7a88067600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f7aac15ccc0 0x7f7aac16e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f7aac0acf10 0x7f7aac0ca240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 --2- 172.21.15.45:0/1396745670 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7aac06d7a0 0x7f7aac15ba80 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 -- 172.21.15.45:0/1396745670 >> 172.21.15.45:0/1396745670 conn(0x7f7aac067750 msgr2=0x7f7aac0b0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 -- 172.21.15.45:0/1396745670 shutdown_connections 2024-08-17T02:28:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.089+0000 7f7ab0e00640 1 -- 172.21.15.45:0/1396745670 wait complete. 2024-08-17T02:28:41.106 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-17T02:28:39.709445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400620,"kb_used_data":5112,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574100,"statfs":{"total":773094113280,"available":770635878400,"internally_reserved":0,"allocated":5234688,"data_stored":2879024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000908"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:28:36.238712+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:28:36.238712+0000","last_peered":"2024-08-17T02:28:36.238712+0000","last_clean":"2024-08-17T02:28:36.238712+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:28:36.238712+0000","last_undegraded":"2024-08-17T02:28:36.238712+0000","last_fullsized":"2024-08-17T02:28:36.238712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298420,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073420,"statfs":{"total":96636764160,"available":96331182080,"internally_reserved":0,"allocated":1089536,"data_stored":799124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.622,"15min":0.58699999999999997},"min":{"1min":0.497,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69899999999999995,"15min":0.68799999999999994},"min":{"1min":0.627,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92500000000000004,"5min":1.173,"15min":1.173},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.47799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65100000000000002,"15min":0.63500000000000001},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.042,"15min":1.042},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.629,"15min":0.61399999999999999},"min":{"1min":0.49199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83899999999999997,"5min":0.879,"15min":0.879},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69899999999999995,"15min":0.66900000000000004},"min":{"1min":0.54300000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.57999999999999996,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94699999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76500000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.874,"15min":0.874},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61499999999999999,"15min":0.627},"min":{"1min":0.437,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71799999999999997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.71199999999999997,"15min":0.745},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.875}]},{"osd":6,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93100000000000005,"5min":1.137,"15min":1.137},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66500000000000004,"15min":0.65300000000000002},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.76000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66200000000000003,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88200000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67300000000000004,"15min":0.65700000000000003},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89900000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.34699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.51400000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.97799999999999998,"5min":1.339,"15min":1.339},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.55700000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88800000000000001,"5min":1.196,"15min":1.196},"last":0.439}]},{"osd":2,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.58099999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.54000000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.86899999999999999,"15min":0.92300000000000004},"min":{"1min":0.58099999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":4.8449999999999998,"15min":4.8449999999999998},"last":0.66800000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.625,"15min":0.66900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.628,"15min":0.65900000000000003},"min":{"1min":0.44600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.84899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.47399999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95799999999999996,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92100000000000004,"5min":1.804,"15min":1.804},"last":0.55500000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71499999999999997,"15min":0.749},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94299999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.71099999999999997,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":1.002,"15min":1.002},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":495616,"data_stored":208756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.57799999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":0.85799999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.623}]},{"osd":1,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68300000000000005,"15min":0.63200000000000001},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68300000000000005,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65200000000000002,"15min":0.61899999999999999},"min":{"1min":0.56999999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65900000000000003,"15min":0.624},"min":{"1min":0.495,"5min":0.443,"15min":0.443},"max":{"1min":0.92400000000000004,"5min":1.425,"15min":1.425},"last":0.60399999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70799999999999996,"15min":0.68600000000000005},"min":{"1min":0.60699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84499999999999997,"5min":1.776,"15min":1.776},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69999999999999996,"15min":0.68100000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.90400000000000003,"5min":1.014,"15min":1.014},"last":0.69799999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60599999999999998,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81999999999999995,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.877,"5min":2.262,"15min":2.262},"last":0.755}]},{"osd":6,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":1.829,"15min":1.829},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.71299999999999997},"min":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.86299999999999999,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80900000000000005,"5min":2.351,"15min":2.351},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.86199999999999999,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.84999999999999998},"min":{"1min":0.48599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.94999999999999996,"5min":4.5339999999999998,"15min":4.5339999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.79300000000000004,"15min":0.83099999999999996},"min":{"1min":0.54200000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.80000000000000004,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.628}]},{"osd":1,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96499999999999997,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.745,"15min":0.75},"min":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.93400000000000005,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.77000000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70099999999999996,"15min":0.68700000000000006},"min":{"1min":0.57799999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.56100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83899999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.754,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80300000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86799999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.50700000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.75800000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.874}]},{"osd":7,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.502,"5min":0.437,"15min":0.437},"max":{"1min":0.79200000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0740000000000001,"5min":1.077,"15min":1.077},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.56699999999999995,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.47699999999999998,"15min":0.46500000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59799999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47099999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46600000000000003,"15min":0.45400000000000001},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.505,"5min":0.372,"15min":0.372},"max":{"1min":0.72899999999999998,"5min":1.349,"15min":1.349},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84099999999999997,"5min":0.871,"15min":0.871},"last":0.51600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.621,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.131,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78500000000000003,"15min":0.77500000000000002},"min":{"1min":0.66300000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.0109999999999999,"5min":1.252,"15min":1.252},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80400000000000005,"15min":0.79500000000000004},"min":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.075,"5min":1.216,"15min":1.216},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.113,"5min":1.446,"15min":1.446},"last":0.77400000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85699999999999998,"15min":0.86599999999999999},"min":{"1min":0.76500000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0589999999999999,"5min":1.522,"15min":1.522},"last":0.749},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82399999999999995},"min":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.996,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.63}]},{"osd":7,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.752,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.083,"5min":1.446,"15min":1.446},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81200000000000006,"15min":0.80800000000000005},"min":{"1min":0.65900000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.097,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":495616,"data_stored":208756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68200000000000005,"5min":1.931,"15min":1.931},"last":0.442},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68000000000000005,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.54300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.626,"5min":1.478,"15min":1.478},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59199999999999997,"15min":0.627},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.496}]},{"osd":3,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70199999999999996,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.53800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86399999999999999,"15min":0.88200000000000001},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.083,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.044,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.879}]},{"osd":5,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.65100000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98399999999999999,"5min":2.302,"15min":2.302},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.876,"15min":0.90400000000000003},"min":{"1min":0.66300000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96499999999999997,"5min":2.444,"15min":2.444},"last":0.93700000000000006}]},{"osd":6,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.68000000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.002,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.84999999999999998,"15min":0.86499999999999999},"min":{"1min":0.61499999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0589999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.85199999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.871,"15min":0.89300000000000002},"min":{"1min":0.68899999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.032,"5min":2.512,"15min":2.512},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.84299999999999997,"15min":0.84599999999999997},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0069999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.81100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40400000000000003},"min":{"1min":0.32500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.46600000000000003,"15min":0.45400000000000001},"min":{"1min":0.36699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66400000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.497},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":0.878,"15min":0.878},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.48199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.92900000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.505,"15min":0.47999999999999998},"min":{"1min":0.44900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.63800000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.04,"5min":1.137,"15min":1.137},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.018,"5min":1.867,"15min":1.867},"last":0.68600000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0269999999999999,"5min":1.464,"15min":1.464},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.079,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81799999999999995,"15min":0.82499999999999996},"min":{"1min":0.61899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.117,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.68700000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.0589999999999999,"5min":1.548,"15min":1.548},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0629999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.627,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.99399999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1105920,"data_stored":804772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.32000000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.752,"15min":0.752},"last":0.49399999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.623,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":1.3420000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.40200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.751},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58799999999999997,"15min":0.59699999999999998},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":1.2829999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.76200000000000001},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.99299999999999999,"5min":1.141,"15min":1.141},"last":0.94899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.77600000000000002},"min":{"1min":0.68999999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.99199999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.147},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.268,"15min":1.268},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.038,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.6890000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.62,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0609999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.2150000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96599999999999997,"5min":1.333,"15min":1.333},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83899999999999997,"15min":0.85099999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.179,"5min":1.204,"15min":1.204},"last":1.643}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:41.107 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-08-17T02:28:41.108 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:41.259 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.259+0000 7feb93e00640 1 Processor -- start 2024-08-17T02:28:41.260 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.259+0000 7feb93e00640 1 -- start start 2024-08-17T02:28:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.260+0000 7feb93e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94158ad0 0x7feb940ac070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.260+0000 7feb93e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb94067d60 con 0x7feb940ac5b0 2024-08-17T02:28:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.260+0000 7feb93e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb94068600 con 0x7feb94158ea0 2024-08-17T02:28:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.260+0000 7feb93e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb940aca00 con 0x7feb94158ad0 2024-08-17T02:28:41.261 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.260+0000 7feb93400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feb940ac5b0 0x7feb94068a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34088/0 (socket says 172.21.15.45:34088) 2024-08-17T02:28:41.262 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.260+0000 7feb93400640 1 -- 172.21.15.45:0/313671118 learned_addr learned my addr 172.21.15.45:0/313671118 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb92a00640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94158ad0 0x7feb940ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021754793 0 0) 0x7feb94067d60 con 0x7feb940ac5b0 2024-08-17T02:28:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb780034e0 con 0x7feb940ac5b0 2024-08-17T02:28:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2086322806 0 0) 0x7feb94068600 con 0x7feb94158ea0 2024-08-17T02:28:41.264 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb94067d60 con 0x7feb94158ea0 2024-08-17T02:28:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2684143024 0 0) 0x7feb780034e0 con 0x7feb940ac5b0 2024-08-17T02:28:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94158ad0 msgr2=0x7feb940ac070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94158ad0 0x7feb940ac070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 >> v1:172.21.15.169:6789/0 conn(0x7feb94158ea0 legacy=0x7feb940af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940b01d0 con 0x7feb940ac5b0 2024-08-17T02:28:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7feb8c0017f0 con 0x7feb940ac5b0 2024-08-17T02:28:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 >> v1:172.21.15.45:6789/0 conn(0x7feb940ac5b0 legacy=0x7feb94068a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.265 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94158ad0 0x7feb78003b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb780040f0 0x7feb78004780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 0x7feb78005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb940aca00 con 0x7feb78004cc0 2024-08-17T02:28:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7800bbc0 con 0x7feb780040f0 2024-08-17T02:28:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.261+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7800bd80 con 0x7feb94158ad0 2024-08-17T02:28:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.262+0000 7feb93400640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 0x7feb78005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.266 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.262+0000 7feb92a00640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94158ad0 0x7feb78003b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.262+0000 7feb92000640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb780040f0 0x7feb78004780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.262+0000 7feb93400640 1 -- 172.21.15.45:0/313671118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94158ad0 msgr2=0x7feb78003b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:41.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.262+0000 7feb93400640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94158ad0 0x7feb78003b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.262+0000 7feb93400640 1 -- 172.21.15.45:0/313671118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb780040f0 msgr2=0x7feb78004780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:41.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.262+0000 7feb93400640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb780040f0 0x7feb78004780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.262+0000 7feb93400640 1 -- 172.21.15.45:0/313671118 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb780034e0 con 0x7feb78004cc0 2024-08-17T02:28:41.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.263+0000 7feb93400640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 0x7feb78005130 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00a8a0 tx=0x7feb8c002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18537def41945056 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.267 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.263+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0071c0 con 0x7feb78004cc0 2024-08-17T02:28:41.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.263+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c007320 con 0x7feb78004cc0 2024-08-17T02:28:41.268 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.263+0000 7feb91600640 1 -- 172.21.15.45:0/313671118 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c007760 con 0x7feb78004cc0 2024-08-17T02:28:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.264+0000 7feb93e00640 1 -- 172.21.15.45:0/313671118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 msgr2=0x7feb78005130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.264+0000 7feb93e00640 1 --2- 172.21.15.45:0/313671118 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 0x7feb78005130 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feb8c00a8a0 tx=0x7feb8c002190 comp rx=0 tx=0).stop 2024-08-17T02:28:41.270 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.264+0000 7feb93400640 1 -- 172.21.15.45:0/313671118 reap_dead start 2024-08-17T02:28:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.264+0000 7feb93e00640 1 -- 172.21.15.45:0/313671118 shutdown_connections 2024-08-17T02:28:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.264+0000 7feb93e00640 1 -- 172.21.15.45:0/313671118 >> 172.21.15.45:0/313671118 conn(0x7feb94096a70 msgr2=0x7feb94096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.264+0000 7feb93e00640 1 -- 172.21.15.45:0/313671118 shutdown_connections 2024-08-17T02:28:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.264+0000 7feb93e00640 1 -- 172.21.15.45:0/313671118 wait complete. 2024-08-17T02:28:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.265+0000 7feb93e00640 1 Processor -- start 2024-08-17T02:28:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.266+0000 7feb93e00640 1 -- start start 2024-08-17T02:28:41.271 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.266+0000 7feb93e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 0x7feb9414e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.266+0000 7feb93e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb940ae450 0x7feb940ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.266+0000 7feb93e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94152350 0x7feb941527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.266+0000 7feb93e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9414eb50 con 0x7feb78004cc0 2024-08-17T02:28:41.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.266+0000 7feb93e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb940aee00 con 0x7feb940ae450 2024-08-17T02:28:41.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.266+0000 7feb93e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb941550a0 con 0x7feb94152350 2024-08-17T02:28:41.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb92a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 0x7feb9414e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb92a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 0x7feb9414e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51250/0 (socket says 172.21.15.45:51250) 2024-08-17T02:28:41.272 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb92a00640 1 -- 172.21.15.45:0/2913699595 learned_addr learned my addr 172.21.15.45:0/2913699595 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb92000640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb940ae450 0x7feb940ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb93400640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94152350 0x7feb941527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb92a00640 1 -- 172.21.15.45:0/2913699595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94152350 msgr2=0x7feb941527c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb92a00640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94152350 0x7feb941527c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb92a00640 1 -- 172.21.15.45:0/2913699595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb940ae450 msgr2=0x7feb940ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb92a00640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb940ae450 0x7feb940ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb92a00640 1 -- 172.21.15.45:0/2913699595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb94153060 con 0x7feb78004cc0 2024-08-17T02:28:41.273 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb92000640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb940ae450 0x7feb940ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.267+0000 7feb92a00640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 0x7feb9414e610 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7feb84011b40 tx=0x7feb840090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.268+0000 7feb8a000640 1 -- 172.21.15.45:0/2913699595 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8400faa0 con 0x7feb78004cc0 2024-08-17T02:28:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.268+0000 7feb8a000640 1 -- 172.21.15.45:0/2913699595 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8400fc00 con 0x7feb78004cc0 2024-08-17T02:28:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.268+0000 7feb8a000640 1 -- 172.21.15.45:0/2913699595 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8401d480 con 0x7feb78004cc0 2024-08-17T02:28:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.268+0000 7feb93e00640 1 -- 172.21.15.45:0/2913699595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb941544d0 con 0x7feb78004cc0 2024-08-17T02:28:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.268+0000 7feb93e00640 1 -- 172.21.15.45:0/2913699595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb94154a50 con 0x7feb78004cc0 2024-08-17T02:28:41.274 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.269+0000 7feb93e00640 1 -- 172.21.15.45:0/2913699595 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb94071050 con 0x7feb78004cc0 2024-08-17T02:28:41.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.270+0000 7feb8a000640 1 -- 172.21.15.45:0/2913699595 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7feb8401d830 con 0x7feb78004cc0 2024-08-17T02:28:41.275 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.270+0000 7feb8a000640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb74065180 0x7feb74067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.270+0000 7feb8a000640 1 -- 172.21.15.45:0/2913699595 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7feb84018070 con 0x7feb78004cc0 2024-08-17T02:28:41.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.271+0000 7feb92000640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb74065180 0x7feb74067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.271+0000 7feb92000640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb74065180 0x7feb74067630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feb80000f60 tx=0x7feb80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.276 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.275+0000 7feb8a000640 1 -- 172.21.15.45:0/2913699595 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7feb84054d70 con 0x7feb78004cc0 2024-08-17T02:28:41.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.457+0000 7feb93e00640 1 -- 172.21.15.45:0/2913699595 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb941551e0 con 0x7feb74065180 2024-08-17T02:28:41.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.459+0000 7feb8a000640 1 -- 172.21.15.45:0/2913699595 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50406 (secure 0 0 0) 0x7feb80002e40 con 0x7feb74065180 2024-08-17T02:28:41.460 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:41.461 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:28:41.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 -- 172.21.15.45:0/2913699595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb74065180 msgr2=0x7feb74067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb74065180 0x7feb74067630 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7feb80000f60 tx=0x7feb80009040 comp rx=0 tx=0).stop 2024-08-17T02:28:41.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 -- 172.21.15.45:0/2913699595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 msgr2=0x7feb9414e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 0x7feb9414e610 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7feb84011b40 tx=0x7feb840090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 -- 172.21.15.45:0/2913699595 shutdown_connections 2024-08-17T02:28:41.462 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7feb74065180 0x7feb74067630 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7feb94152350 0x7feb941527c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7feb940ae450 0x7feb940ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 --2- 172.21.15.45:0/2913699595 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb78004cc0 0x7feb9414e610 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 -- 172.21.15.45:0/2913699595 >> 172.21.15.45:0/2913699595 conn(0x7feb94096a70 msgr2=0x7feb9406b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:41.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 -- 172.21.15.45:0/2913699595 shutdown_connections 2024-08-17T02:28:41.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.461+0000 7feb93e00640 1 -- 172.21.15.45:0/2913699595 wait complete. 2024-08-17T02:28:41.477 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-08-17T02:28:39.709445+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400620,"kb_used_data":5112,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574100,"statfs":{"total":773094113280,"available":770635878400,"internally_reserved":0,"allocated":5234688,"data_stored":2879024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-2338,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-45,"num_write_kb":-13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000908"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-08-17T02:28:36.238712+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:28:36.238712+0000","last_peered":"2024-08-17T02:28:36.238712+0000","last_clean":"2024-08-17T02:28:36.238712+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:28:36.238712+0000","last_undegraded":"2024-08-17T02:28:36.238712+0000","last_fullsized":"2024-08-17T02:28:36.238712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T03:56:16.176467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298420,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073420,"statfs":{"total":96636764160,"available":96331182080,"internally_reserved":0,"allocated":1089536,"data_stored":799124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.622,"15min":0.58699999999999997},"min":{"1min":0.497,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69899999999999995,"15min":0.68799999999999994},"min":{"1min":0.627,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92500000000000004,"5min":1.173,"15min":1.173},"last":0.58799999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.47799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65100000000000002,"15min":0.63500000000000001},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.042,"15min":1.042},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.629,"15min":0.61399999999999999},"min":{"1min":0.49199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83899999999999997,"5min":0.879,"15min":0.879},"last":0.62}]},{"osd":3,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69899999999999995,"15min":0.66900000000000004},"min":{"1min":0.54300000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.57999999999999996,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94699999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.79400000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76500000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.874,"15min":0.874},"last":0.72399999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61499999999999999,"15min":0.627},"min":{"1min":0.437,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71799999999999997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.71199999999999997,"15min":0.745},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.875}]},{"osd":6,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93100000000000005,"5min":1.137,"15min":1.137},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66500000000000004,"15min":0.65300000000000002},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.76000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66200000000000003,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88200000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67300000000000004,"15min":0.65700000000000003},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89900000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.34699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.51400000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.97799999999999998,"5min":1.339,"15min":1.339},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.55700000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88800000000000001,"5min":1.196,"15min":1.196},"last":0.439}]},{"osd":2,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.58099999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.54000000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.86899999999999999,"15min":0.92300000000000004},"min":{"1min":0.58099999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":4.8449999999999998,"15min":4.8449999999999998},"last":0.66800000000000004}]},{"osd":4,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.625,"15min":0.66900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.628,"15min":0.65900000000000003},"min":{"1min":0.44600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.84899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.47399999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95799999999999996,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92100000000000004,"5min":1.804,"15min":1.804},"last":0.55500000000000005}]},{"osd":7,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71499999999999997,"15min":0.749},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94299999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.71099999999999997,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":1.002,"15min":1.002},"last":0.754}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297844,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073996,"statfs":{"total":96636764160,"available":96331771904,"internally_reserved":0,"allocated":495616,"data_stored":208756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.57799999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":0.85799999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.623}]},{"osd":1,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68300000000000005,"15min":0.63200000000000001},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68300000000000005,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.68400000000000005}]},{"osd":2,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65200000000000002,"15min":0.61899999999999999},"min":{"1min":0.56999999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65900000000000003,"15min":0.624},"min":{"1min":0.495,"5min":0.443,"15min":0.443},"max":{"1min":0.92400000000000004,"5min":1.425,"15min":1.425},"last":0.60399999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70799999999999996,"15min":0.68600000000000005},"min":{"1min":0.60699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84499999999999997,"5min":1.776,"15min":1.776},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69999999999999996,"15min":0.68100000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.90400000000000003,"5min":1.014,"15min":1.014},"last":0.69799999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60599999999999998,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81999999999999995,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.877,"5min":2.262,"15min":2.262},"last":0.755}]},{"osd":6,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":1.829,"15min":1.829},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.71299999999999997},"min":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.86299999999999999,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":0.66900000000000004}]},{"osd":7,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80900000000000005,"5min":2.351,"15min":2.351},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.86199999999999999,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.73899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574893,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.84999999999999998},"min":{"1min":0.48599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.94999999999999996,"5min":4.5339999999999998,"15min":4.5339999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.79300000000000004,"15min":0.83099999999999996},"min":{"1min":0.54200000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.80000000000000004,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.628}]},{"osd":1,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96499999999999997,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.48499999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.745,"15min":0.75},"min":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.93400000000000005,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.77000000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70099999999999996,"15min":0.68700000000000006},"min":{"1min":0.57799999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.56100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.83899999999999997}]},{"osd":5,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.754,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80300000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54100000000000004}]},{"osd":6,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86799999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.50700000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.75800000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.874}]},{"osd":7,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.502,"5min":0.437,"15min":0.437},"max":{"1min":0.79200000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0740000000000001,"5min":1.077,"15min":1.077},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.56699999999999995,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.47699999999999998,"15min":0.46500000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59799999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.47099999999999997}]},{"osd":1,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46600000000000003,"15min":0.45400000000000001},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.505,"5min":0.372,"15min":0.372},"max":{"1min":0.72899999999999998,"5min":1.349,"15min":1.349},"last":0.57299999999999995}]},{"osd":2,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84099999999999997,"5min":0.871,"15min":0.871},"last":0.51600000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.621,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.131,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78500000000000003,"15min":0.77500000000000002},"min":{"1min":0.66300000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.0109999999999999,"5min":1.252,"15min":1.252},"last":0.76200000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80400000000000005,"15min":0.79500000000000004},"min":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.075,"5min":1.216,"15min":1.216},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.113,"5min":1.446,"15min":1.446},"last":0.77400000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85699999999999998,"15min":0.86599999999999999},"min":{"1min":0.76500000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0589999999999999,"5min":1.522,"15min":1.522},"last":0.749},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82399999999999995},"min":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.996,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.63}]},{"osd":7,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.752,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.083,"5min":1.446,"15min":1.446},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81200000000000006,"15min":0.80800000000000005},"min":{"1min":0.65900000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.097,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302004,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069836,"statfs":{"total":96636764160,"available":96327512064,"internally_reserved":0,"allocated":495616,"data_stored":208756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68200000000000005,"5min":1.931,"15min":1.931},"last":0.442},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68000000000000005,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.54300000000000004}]},{"osd":1,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.626,"5min":1.478,"15min":1.478},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59199999999999997,"15min":0.627},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.496}]},{"osd":3,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70199999999999996,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.53800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.57399999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86399999999999999,"15min":0.88200000000000001},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.083,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.044,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.879}]},{"osd":5,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.65100000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98399999999999999,"5min":2.302,"15min":2.302},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.876,"15min":0.90400000000000003},"min":{"1min":0.66300000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96499999999999997,"5min":2.444,"15min":2.444},"last":0.93700000000000006}]},{"osd":6,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.68000000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.002,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.84999999999999998,"15min":0.86499999999999999},"min":{"1min":0.61499999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0589999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.85199999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.871,"15min":0.89300000000000002},"min":{"1min":0.68899999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.032,"5min":2.512,"15min":2.512},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.84299999999999997,"15min":0.84599999999999997},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0069999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.81100000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40400000000000003},"min":{"1min":0.32500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.46600000000000003,"15min":0.45400000000000001},"min":{"1min":0.36699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66400000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.497},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":0.878,"15min":0.878},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.48199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.92900000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.505,"15min":0.47999999999999998},"min":{"1min":0.44900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.41899999999999998}]},{"osd":4,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.63800000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.04,"5min":1.137,"15min":1.137},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.018,"5min":1.867,"15min":1.867},"last":0.68600000000000005}]},{"osd":5,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0269999999999999,"5min":1.464,"15min":1.464},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.079,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81799999999999995,"15min":0.82499999999999996},"min":{"1min":0.61899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.117,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.68700000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.0589999999999999,"5min":1.548,"15min":1.548},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0629999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.627,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.99399999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.64400000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1105920,"data_stored":804772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.32000000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.752,"15min":0.752},"last":0.49399999999999999}]},{"osd":2,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.623,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":1.3420000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.40200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.751},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58799999999999997,"15min":0.59699999999999998},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":1.2829999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.76200000000000001},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.99299999999999999,"5min":1.141,"15min":1.141},"last":0.94899999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.77600000000000002},"min":{"1min":0.68999999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.99199999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.147},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.268,"15min":1.268},"last":0.72399999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.038,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.6890000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.62,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0609999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":1.2150000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96599999999999997,"5min":1.333,"15min":1.333},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83899999999999997,"15min":0.85099999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.179,"5min":1.204,"15min":1.204},"last":1.643}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:41.479 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-17T02:28:41.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.630+0000 7f6728800640 1 Processor -- start 2024-08-17T02:28:41.631 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.630+0000 7f6728800640 1 -- start start 2024-08-17T02:28:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.631+0000 7f6728800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f672015cb30 0x7f67200c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.632 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.631+0000 7f6728800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67200b18d0 con 0x7f6720158d60 2024-08-17T02:28:41.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.631+0000 7f6728800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67200b0d00 con 0x7f6720159130 2024-08-17T02:28:41.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.631+0000 7f6728800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67200b0fa0 con 0x7f672015cb30 2024-08-17T02:28:41.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.631+0000 7f6725e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6720158d60 0x7f67200b1d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34090/0 (socket says 172.21.15.45:34090) 2024-08-17T02:28:41.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.631+0000 7f6725e00640 1 -- 172.21.15.45:0/2145632366 learned_addr learned my addr 172.21.15.45:0/2145632366 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:41.633 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.632+0000 7f6725400640 1 --2- 172.21.15.45:0/2145632366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f672015cb30 0x7f67200c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.632+0000 7f6724a00640 1 -- 172.21.15.45:0/2145632366 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4190607325 0 0) 0x7f67200b18d0 con 0x7f6720158d60 2024-08-17T02:28:41.635 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.632+0000 7f6724a00640 1 -- 172.21.15.45:0/2145632366 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67080034e0 con 0x7f6720158d60 2024-08-17T02:28:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.632+0000 7f6724a00640 1 -- 172.21.15.45:0/2145632366 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222770338 0 0) 0x7f67200b0d00 con 0x7f6720159130 2024-08-17T02:28:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.632+0000 7f6724a00640 1 -- 172.21.15.45:0/2145632366 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67200b18d0 con 0x7f6720159130 2024-08-17T02:28:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.632+0000 7f6725400640 1 -- 172.21.15.45:0/2145632366 >> v1:172.21.15.169:6789/0 conn(0x7f6720159130 legacy=0x7f6720096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.632+0000 7f6725400640 1 -- 172.21.15.45:0/2145632366 >> v1:172.21.15.45:6789/0 conn(0x7f6720158d60 legacy=0x7f67200b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.632+0000 7f6724a00640 1 -- 172.21.15.45:0/2145632366 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2278857203 0 0) 0x7f67080034e0 con 0x7f6720158d60 2024-08-17T02:28:41.636 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.632+0000 7f6725400640 1 -- 172.21.15.45:0/2145632366 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67200b1280 con 0x7f672015cb30 2024-08-17T02:28:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.633+0000 7f6725400640 1 --2- 172.21.15.45:0/2145632366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f672015cb30 0x7f67200c6d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6710009880 tx=0x7f67100090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc3c87daa307c8b4 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.634+0000 7f6724a00640 1 -- 172.21.15.45:0/2145632366 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714001470 con 0x7f672015cb30 2024-08-17T02:28:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.634+0000 7f6724a00640 1 -- 172.21.15.45:0/2145632366 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f671002aac0 con 0x7f672015cb30 2024-08-17T02:28:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.634+0000 7f6724a00640 1 -- 172.21.15.45:0/2145632366 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f671002ae60 con 0x7f672015cb30 2024-08-17T02:28:41.637 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.634+0000 7f6728800640 1 -- 172.21.15.45:0/2145632366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f672015cb30 msgr2=0x7f67200c6d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.634+0000 7f6728800640 1 --2- 172.21.15.45:0/2145632366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f672015cb30 0x7f67200c6d10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6710009880 tx=0x7f67100090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.634+0000 7f6728800640 1 -- 172.21.15.45:0/2145632366 shutdown_connections 2024-08-17T02:28:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.634+0000 7f6728800640 1 --2- 172.21.15.45:0/2145632366 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f672015cb30 0x7f67200c6d10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.634+0000 7f6728800640 1 -- 172.21.15.45:0/2145632366 >> 172.21.15.45:0/2145632366 conn(0x7f67200b3040 msgr2=0x7f67200b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.634+0000 7f6728800640 1 -- 172.21.15.45:0/2145632366 shutdown_connections 2024-08-17T02:28:41.638 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.634+0000 7f6728800640 1 -- 172.21.15.45:0/2145632366 wait complete. 2024-08-17T02:28:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.636+0000 7f6728800640 1 Processor -- start 2024-08-17T02:28:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.636+0000 7f6728800640 1 -- start start 2024-08-17T02:28:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6728800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6720158d60 0x7f67200b0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6728800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6720159130 0x7f6720152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6728800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f672015cb30 0x7f6720169190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.641 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6728800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67201521b0 con 0x7f6720158d60 2024-08-17T02:28:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6728800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67200ab680 con 0x7f672015cb30 2024-08-17T02:28:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6728800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6720099dc0 con 0x7f6720159130 2024-08-17T02:28:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6725e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6720158d60 0x7f67200b0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6725e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6720158d60 0x7f67200b0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51264/0 (socket says 172.21.15.45:51264) 2024-08-17T02:28:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6725e00640 1 -- 172.21.15.45:0/1433377121 learned_addr learned my addr 172.21.15.45:0/1433377121 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6725400640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6720159130 0x7f6720152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.642 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6726800640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f672015cb30 0x7f6720169190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6725e00640 1 -- 172.21.15.45:0/1433377121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6720159130 msgr2=0x7f6720152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6725e00640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6720159130 0x7f6720152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6725e00640 1 -- 172.21.15.45:0/1433377121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f672015cb30 msgr2=0x7f6720169190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6725e00640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f672015cb30 0x7f6720169190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.637+0000 7f6725e00640 1 -- 172.21.15.45:0/1433377121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6710009390 con 0x7f6720158d60 2024-08-17T02:28:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.638+0000 7f6725e00640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6720158d60 0x7f67200b0150 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6714001380 tx=0x7f6714001bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.638+0000 7f6719600640 1 -- 172.21.15.45:0/1433377121 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714007360 con 0x7f6720158d60 2024-08-17T02:28:41.643 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.638+0000 7f6719600640 1 -- 172.21.15.45:0/1433377121 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67140074c0 con 0x7f6720158d60 2024-08-17T02:28:41.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.638+0000 7f6728800640 1 -- 172.21.15.45:0/1433377121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6720099500 con 0x7f6720158d60 2024-08-17T02:28:41.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.638+0000 7f6719600640 1 -- 172.21.15.45:0/1433377121 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714007670 con 0x7f6720158d60 2024-08-17T02:28:41.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.638+0000 7f6728800640 1 -- 172.21.15.45:0/1433377121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67200997f0 con 0x7f6720158d60 2024-08-17T02:28:41.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.639+0000 7f6728800640 1 -- 172.21.15.45:0/1433377121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6720064db0 con 0x7f6720158d60 2024-08-17T02:28:41.644 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.640+0000 7f6719600640 1 -- 172.21.15.45:0/1433377121 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6714004ca0 con 0x7f6720158d60 2024-08-17T02:28:41.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.641+0000 7f6719600640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6704065150 0x7f6704067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:41.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.641+0000 7f6719600640 1 -- 172.21.15.45:0/1433377121 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6714081b50 con 0x7f6720158d60 2024-08-17T02:28:41.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.641+0000 7f6725400640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6704065150 0x7f6704067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:41.645 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.642+0000 7f6725400640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6704065150 0x7f6704067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6710034000 tx=0x7f6710032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:41.646 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.644+0000 7f6719600640 1 -- 172.21.15.45:0/1433377121 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f671404ff40 con 0x7f6720158d60 2024-08-17T02:28:41.829 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.828+0000 7f6728800640 1 -- 172.21.15.45:0/1433377121 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6720099b10 con 0x7f6720158d60 2024-08-17T02:28:41.830 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.829+0000 7f6719600640 1 -- 172.21.15.45:0/1433377121 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12389 (secure 0 0 0) 0x7f6714018020 con 0x7f6720158d60 2024-08-17T02:28:41.830 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:41.830 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":43,"fsid":"2ec357bb-2069-43d1-ab40-d29098820580","created":"2024-08-17T02:24:50.983973+0000","modified":"2024-08-17T02:28:37.006163+0000","last_up_change":"2024-08-17T02:25:02.435921+0000","last_in_change":"2024-08-17T02:24:53.814425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-17T02:25:03.710952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"4aee70be-946b-43f2-be3e-022611970bc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":37438},{"type":"v1","addr":"172.21.15.45:6809","nonce":37438}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":37438},{"type":"v1","addr":"172.21.15.45:6811","nonce":37438}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":37438},{"type":"v1","addr":"172.21.15.45:6815","nonce":37438}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":37438},{"type":"v1","addr":"172.21.15.45:6813","nonce":37438}]},"public_addr":"172.21.15.45:6809/37438","cluster_addr":"172.21.15.45:6811/37438","heartbeat_back_addr":"172.21.15.45:6815/37438","heartbeat_front_addr":"172.21.15.45:6813/37438","state":["exists","up"]},{"osd":1,"uuid":"dd5d03c0-cf41-46b6-b8aa-6a5f3445c515","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":37437},{"type":"v1","addr":"172.21.15.45:6817","nonce":37437}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":37437},{"type":"v1","addr":"172.21.15.45:6819","nonce":37437}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":37437},{"type":"v1","addr":"172.21.15.45:6823","nonce":37437}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":37437},{"type":"v1","addr":"172.21.15.45:6821","nonce":37437}]},"public_addr":"172.21.15.45:6817/37437","cluster_addr":"172.21.15.45:6819/37437","heartbeat_back_addr":"172.21.15.45:6823/37437","heartbeat_front_addr":"172.21.15.45:6821/37437","state":["exists","up"]},{"osd":2,"uuid":"c07cc7a1-a863-4979-aa89-dee6b4b9b549","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":37436},{"type":"v1","addr":"172.21.15.45:6801","nonce":37436}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":37436},{"type":"v1","addr":"172.21.15.45:6803","nonce":37436}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":37436},{"type":"v1","addr":"172.21.15.45:6807","nonce":37436}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":37436},{"type":"v1","addr":"172.21.15.45:6805","nonce":37436}]},"public_addr":"172.21.15.45:6801/37436","cluster_addr":"172.21.15.45:6803/37436","heartbeat_back_addr":"172.21.15.45:6807/37436","heartbeat_front_addr":"172.21.15.45:6805/37436","state":["exists","up"]},{"osd":3,"uuid":"ea89b05e-87a2-4518-8dce-17e104366a9e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":37447},{"type":"v1","addr":"172.21.15.45:6825","nonce":37447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":37447},{"type":"v1","addr":"172.21.15.45:6827","nonce":37447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":37447},{"type":"v1","addr":"172.21.15.45:6831","nonce":37447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":37447},{"type":"v1","addr":"172.21.15.45:6829","nonce":37447}]},"public_addr":"172.21.15.45:6825/37447","cluster_addr":"172.21.15.45:6827/37447","heartbeat_back_addr":"172.21.15.45:6831/37447","heartbeat_front_addr":"172.21.15.45:6829/37447","state":["exists","up"]},{"osd":4,"uuid":"46abe268-7497-409e-9161-a5a6b4753045","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6824","nonce":37316},{"type":"v1","addr":"172.21.15.169:6825","nonce":37316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6826","nonce":37316},{"type":"v1","addr":"172.21.15.169:6827","nonce":37316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6830","nonce":37316},{"type":"v1","addr":"172.21.15.169:6831","nonce":37316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6828","nonce":37316},{"type":"v1","addr":"172.21.15.169:6829","nonce":37316}]},"public_addr":"172.21.15.169:6825/37316","cluster_addr":"172.21.15.169:6827/37316","heartbeat_back_addr":"172.21.15.169:6831/37316","heartbeat_front_addr":"172.21.15.169:6829/37316","state":["exists","up"]},{"osd":5,"uuid":"2d2374fd-7006-4541-92c3-df5add5ca647","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6808","nonce":37297},{"type":"v1","addr":"172.21.15.169:6809","nonce":37297}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6810","nonce":37297},{"type":"v1","addr":"172.21.15.169:6811","nonce":37297}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6814","nonce":37297},{"type":"v1","addr":"172.21.15.169:6815","nonce":37297}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6812","nonce":37297},{"type":"v1","addr":"172.21.15.169:6813","nonce":37297}]},"public_addr":"172.21.15.169:6809/37297","cluster_addr":"172.21.15.169:6811/37297","heartbeat_back_addr":"172.21.15.169:6815/37297","heartbeat_front_addr":"172.21.15.169:6813/37297","state":["exists","up"]},{"osd":6,"uuid":"89b89c80-b07a-480a-8622-d7011718076b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6800","nonce":37298},{"type":"v1","addr":"172.21.15.169:6801","nonce":37298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6802","nonce":37298},{"type":"v1","addr":"172.21.15.169:6803","nonce":37298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6806","nonce":37298},{"type":"v1","addr":"172.21.15.169:6807","nonce":37298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6804","nonce":37298},{"type":"v1","addr":"172.21.15.169:6805","nonce":37298}]},"public_addr":"172.21.15.169:6801/37298","cluster_addr":"172.21.15.169:6803/37298","heartbeat_back_addr":"172.21.15.169:6807/37298","heartbeat_front_addr":"172.21.15.169:6805/37298","state":["exists","up"]},{"osd":7,"uuid":"209e83ff-2e9c-45a4-9721-4ace887d2154","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6816","nonce":37299},{"type":"v1","addr":"172.21.15.169:6817","nonce":37299}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6818","nonce":37299},{"type":"v1","addr":"172.21.15.169:6819","nonce":37299}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6822","nonce":37299},{"type":"v1","addr":"172.21.15.169:6823","nonce":37299}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6820","nonce":37299},{"type":"v1","addr":"172.21.15.169:6821","nonce":37299}]},"public_addr":"172.21.15.169:6817/37299","cluster_addr":"172.21.15.169:6819/37299","heartbeat_back_addr":"172.21.15.169:6823/37299","heartbeat_front_addr":"172.21.15.169:6821/37299","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.219943+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.192662+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.007313+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.177771+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.209870+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.113295+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.057957+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-08-17T02:24:59.130027+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/569206503":"2024-08-18T02:28:33.847736+0000","172.21.15.45:6835/569206503":"2024-08-18T02:28:33.847736+0000","172.21.15.45:6836/618002034":"2024-08-18T02:28:26.954889+0000","172.21.15.45:6834/618002034":"2024-08-18T02:28:26.954889+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-17T02:28:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.831+0000 7f6728800640 1 -- 172.21.15.45:0/1433377121 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6704065150 msgr2=0x7f6704067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.831+0000 7f6728800640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6704065150 0x7f6704067600 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6710034000 tx=0x7f6710032000 comp rx=0 tx=0).stop 2024-08-17T02:28:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.831+0000 7f6728800640 1 -- 172.21.15.45:0/1433377121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6720158d60 msgr2=0x7f67200b0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.831+0000 7f6728800640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6720158d60 0x7f67200b0150 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6714001380 tx=0x7f6714001bf0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.831+0000 7f6728800640 1 -- 172.21.15.45:0/1433377121 shutdown_connections 2024-08-17T02:28:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.831+0000 7f6728800640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f672015cb30 0x7f6720169190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.831+0000 7f6728800640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6704065150 0x7f6704067600 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.831+0000 7f6728800640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6720159130 0x7f6720152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.831+0000 7f6728800640 1 --2- 172.21.15.45:0/1433377121 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6720158d60 0x7f67200b0150 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.831+0000 7f6728800640 1 -- 172.21.15.45:0/1433377121 >> 172.21.15.45:0/1433377121 conn(0x7f67200b3040 msgr2=0x7f672015a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.832+0000 7f6728800640 1 -- 172.21.15.45:0/1433377121 shutdown_connections 2024-08-17T02:28:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:41.832+0000 7f6728800640 1 -- 172.21.15.45:0/1433377121 wait complete. 2024-08-17T02:28:42.848 INFO:tasks.ceph:Scrubbing osd.0 2024-08-17T02:28:42.848 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:43.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.014+0000 7fcebf800640 1 Processor -- start 2024-08-17T02:28:43.015 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.014+0000 7fcebf800640 1 -- start start 2024-08-17T02:28:43.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.015+0000 7fcebf800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceb8069090 0x7fceb80ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.016+0000 7fcebf800640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb80ac4e0 con 0x7fceb80aa810 2024-08-17T02:28:43.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.016+0000 7fcebf800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceb80ac780 con 0x7fceb80ab2f0 2024-08-17T02:28:43.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.016+0000 7fcebf800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80aca60 con 0x7fceb8069090 2024-08-17T02:28:43.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.016+0000 7fcebce00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fceb80aa810 0x7fceb80aabe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52060/0 (socket says 172.21.15.45:52060) 2024-08-17T02:28:43.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.016+0000 7fcebce00640 1 -- 172.21.15.45:0/2992092271 learned_addr learned my addr 172.21.15.45:0/2992092271 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:43.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.016+0000 7fceb7e00640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceb8069090 0x7fceb80ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.016+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920635102 0 0) 0x7fceb80ac4e0 con 0x7fceb80aa810 2024-08-17T02:28:43.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.016+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcea00034e0 con 0x7fceb80aa810 2024-08-17T02:28:43.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2489844954 0 0) 0x7fcea00034e0 con 0x7fceb80aa810 2024-08-17T02:28:43.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceb8069090 msgr2=0x7fceb80ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceb8069090 0x7fceb80ae7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 >> v1:172.21.15.169:6789/0 conn(0x7fceb80ab2f0 legacy=0x7fceb80aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb80acd40 con 0x7fceb80aa810 2024-08-17T02:28:43.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7fceac001470 con 0x7fceb80aa810 2024-08-17T02:28:43.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 >> v1:172.21.15.45:6789/0 conn(0x7fceb80aa810 legacy=0x7fceb80aabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcea0003a00 0x7fcea0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcea0004780 0x7fcea0004bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceb8069090 0x7fcea0005130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb80aca60 con 0x7fcea0003a00 2024-08-17T02:28:43.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea000ba80 con 0x7fcea0004780 2024-08-17T02:28:43.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea000bc40 con 0x7fceb8069090 2024-08-17T02:28:43.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fcebce00640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcea0003a00 0x7fcea0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fceb7e00640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcea0004780 0x7fcea0004bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.017+0000 7fcebd800640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceb8069090 0x7fcea0005130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.018+0000 7fcebce00640 1 -- 172.21.15.45:0/2992092271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceb8069090 msgr2=0x7fcea0005130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.018+0000 7fcebce00640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fceb8069090 0x7fcea0005130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.018+0000 7fcebce00640 1 -- 172.21.15.45:0/2992092271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcea0004780 msgr2=0x7fcea0004bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.018+0000 7fcebce00640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fcea0004780 0x7fcea0004bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.018+0000 7fcebce00640 1 -- 172.21.15.45:0/2992092271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea00034e0 con 0x7fcea0003a00 2024-08-17T02:28:43.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.019+0000 7fcebce00640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcea0003a00 0x7fcea0003dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c2d0 tx=0x7fceac001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca752bc07b45874e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.019+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac005890 con 0x7fcea0003a00 2024-08-17T02:28:43.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.019+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceac005a10 con 0x7fcea0003a00 2024-08-17T02:28:43.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.019+0000 7fceb7400640 1 -- 172.21.15.45:0/2992092271 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceac005dd0 con 0x7fcea0003a00 2024-08-17T02:28:43.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.019+0000 7fcebf800640 1 -- 172.21.15.45:0/2992092271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcea0003a00 msgr2=0x7fcea0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.019+0000 7fcebf800640 1 --2- 172.21.15.45:0/2992092271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcea0003a00 0x7fcea0003dd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fceac00c2d0 tx=0x7fceac001e70 comp rx=0 tx=0).stop 2024-08-17T02:28:43.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.019+0000 7fcebd800640 1 -- 172.21.15.45:0/2992092271 reap_dead start 2024-08-17T02:28:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.020+0000 7fcebf800640 1 -- 172.21.15.45:0/2992092271 shutdown_connections 2024-08-17T02:28:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.020+0000 7fcebf800640 1 -- 172.21.15.45:0/2992092271 >> 172.21.15.45:0/2992092271 conn(0x7fceb8096a70 msgr2=0x7fceb8096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.020+0000 7fcebf800640 1 -- 172.21.15.45:0/2992092271 shutdown_connections 2024-08-17T02:28:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.020+0000 7fcebf800640 1 -- 172.21.15.45:0/2992092271 wait complete. 2024-08-17T02:28:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.021+0000 7fcebf800640 1 Processor -- start 2024-08-17T02:28:43.024 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.021+0000 7fcebf800640 1 -- start start 2024-08-17T02:28:43.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.022+0000 7fcebf800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcea0003a00 0x7fceb8168b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.022+0000 7fcebf800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceb81554b0 0x7fceb8159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.022+0000 7fcebf800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceb815a280 0x7fceb809ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.022+0000 7fcebf800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8097910 con 0x7fceb815a280 2024-08-17T02:28:43.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.022+0000 7fcebf800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceb8098490 con 0x7fceb81554b0 2024-08-17T02:28:43.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.022+0000 7fcebf800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceb815a6d0 con 0x7fcea0003a00 2024-08-17T02:28:43.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.022+0000 7fcebd800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceb815a280 0x7fceb809ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.022+0000 7fcebd800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceb815a280 0x7fceb809ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44394/0 (socket says 172.21.15.45:44394) 2024-08-17T02:28:43.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.022+0000 7fcebd800640 1 -- 172.21.15.45:0/2050874865 learned_addr learned my addr 172.21.15.45:0/2050874865 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:43.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fcebce00640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcea0003a00 0x7fceb8168b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fceb7e00640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceb81554b0 0x7fceb8159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fcebd800640 1 -- 172.21.15.45:0/2050874865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcea0003a00 msgr2=0x7fceb8168b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fcebd800640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fcea0003a00 0x7fceb8168b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fcebd800640 1 -- 172.21.15.45:0/2050874865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceb81554b0 msgr2=0x7fceb8159d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fcebd800640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fceb81554b0 0x7fceb8159d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fcebd800640 1 -- 172.21.15.45:0/2050874865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceb8169050 con 0x7fceb815a280 2024-08-17T02:28:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fcebd800640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceb815a280 0x7fceb809ad00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fceb8067d30 tx=0x7fceb0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fceabe00640 1 -- 172.21.15.45:0/2050874865 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb0014480 con 0x7fceb815a280 2024-08-17T02:28:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fceabe00640 1 -- 172.21.15.45:0/2050874865 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fceb0014600 con 0x7fceb815a280 2024-08-17T02:28:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fcebf800640 1 -- 172.21.15.45:0/2050874865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceb8097b60 con 0x7fceb815a280 2024-08-17T02:28:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.023+0000 7fceabe00640 1 -- 172.21.15.45:0/2050874865 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fceb00149c0 con 0x7fceb815a280 2024-08-17T02:28:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.024+0000 7fcebf800640 1 -- 172.21.15.45:0/2050874865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceb8098120 con 0x7fceb815a280 2024-08-17T02:28:43.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.024+0000 7fcebf800640 1 -- 172.21.15.45:0/2050874865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fceb80710c0 con 0x7fceb815a280 2024-08-17T02:28:43.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.025+0000 7fceabe00640 1 -- 172.21.15.45:0/2050874865 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fceb00133e0 con 0x7fceb815a280 2024-08-17T02:28:43.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.026+0000 7fceabe00640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fce98065180 0x7fce98067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.026+0000 7fceabe00640 1 -- 172.21.15.45:0/2050874865 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fceb0081880 con 0x7fceb815a280 2024-08-17T02:28:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.027+0000 7fceabe00640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] conn(0x7fce9806b070 0x7fce9806d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.027+0000 7fcebce00640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fce98065180 0x7fce98067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.027+0000 7fceabe00640 1 -- 172.21.15.45:0/2050874865 --> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce9806db30 con 0x7fce9806b070 2024-08-17T02:28:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.027+0000 7fceabe00640 1 -- 172.21.15.45:0/2050874865 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fceb0083de0 con 0x7fceb815a280 2024-08-17T02:28:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.027+0000 7fceb7e00640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] conn(0x7fce9806b070 0x7fce9806d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.027+0000 7fcebce00640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fce98065180 0x7fce98067630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fceac033000 tx=0x7fceac034000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.028+0000 7fceb7e00640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] conn(0x7fce9806b070 0x7fce9806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.028+0000 7fceabe00640 1 -- 172.21.15.45:0/2050874865 <== osd.0 v2:172.21.15.45:6808/37438 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fce9806db30 con 0x7fce9806b070 2024-08-17T02:28:43.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.041+0000 7fcebf800640 1 -- 172.21.15.45:0/2050874865 --> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fceb8155880 con 0x7fce9806b070 2024-08-17T02:28:43.042 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.042+0000 7fceabe00640 1 -- 172.21.15.45:0/2050874865 <== osd.0 v2:172.21.15.45:6808/37438 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fceb8155880 con 0x7fce9806b070 2024-08-17T02:28:43.043 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-08-17T02:28:43.043 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:43.043 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-08-17T02:28:43.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.042+0000 7fcebf800640 1 -- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] conn(0x7fce9806b070 msgr2=0x7fce9806d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.042+0000 7fcebf800640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:6808/37438,v1:172.21.15.45:6809/37438] conn(0x7fce9806b070 0x7fce9806d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.042+0000 7fcebf800640 1 -- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fce98065180 msgr2=0x7fce98067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.042+0000 7fcebf800640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fce98065180 0x7fce98067630 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fceac033000 tx=0x7fceac034000 comp rx=0 tx=0).stop 2024-08-17T02:28:43.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.042+0000 7fcebf800640 1 -- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceb815a280 msgr2=0x7fceb809ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.042+0000 7fcebf800640 1 --2- 172.21.15.45:0/2050874865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fceb815a280 0x7fceb809ad00 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fceb8067d30 tx=0x7fceb0001640 comp rx=0 tx=0).stop 2024-08-17T02:28:43.044 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.042+0000 7fcebd800640 1 -- 172.21.15.45:0/2050874865 reap_dead start 2024-08-17T02:28:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.042+0000 7fcebf800640 1 -- 172.21.15.45:0/2050874865 shutdown_connections 2024-08-17T02:28:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.042+0000 7fcebf800640 1 -- 172.21.15.45:0/2050874865 >> 172.21.15.45:0/2050874865 conn(0x7fceb8096a70 msgr2=0x7fceb806bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.042+0000 7fcebf800640 1 -- 172.21.15.45:0/2050874865 shutdown_connections 2024-08-17T02:28:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.043+0000 7fcebf800640 1 -- 172.21.15.45:0/2050874865 wait complete. 2024-08-17T02:28:43.057 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-08-17T02:28:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.209+0000 7f6a23400640 1 Processor -- start 2024-08-17T02:28:43.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.209+0000 7f6a23400640 1 -- start start 2024-08-17T02:28:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.210+0000 7f6a23400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a1c0caa40 0x7f6a1c0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.210+0000 7f6a23400640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1c0cb560 con 0x7f6a1c159350 2024-08-17T02:28:43.211 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.210+0000 7f6a23400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1c0cf7e0 con 0x7f6a1c158f80 2024-08-17T02:28:43.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.210+0000 7f6a23400640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c0cfac0 con 0x7f6a1c0caa40 2024-08-17T02:28:43.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.211+0000 7f6a13e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a1c0caa40 0x7f6a1c0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.211+0000 7f6a21400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6a1c159350 0x7f6a1c0ad380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52074/0 (socket says 172.21.15.45:52074) 2024-08-17T02:28:43.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.211+0000 7f6a21400640 1 -- 172.21.15.45:0/3662492484 learned_addr learned my addr 172.21.15.45:0/3662492484 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:43.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.211+0000 7f6a20a00640 1 --1- 172.21.15.45:0/3662492484 >> v1:172.21.15.169:6789/0 conn(0x7f6a1c158f80 0x7f6a1c0ca330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:36958/0 (socket says 172.21.15.45:36958) 2024-08-17T02:28:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.211+0000 7f6a13e00640 1 -- 172.21.15.45:0/3662492484 >> v1:172.21.15.169:6789/0 conn(0x7f6a1c158f80 legacy=0x7f6a1c0ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.211+0000 7f6a13e00640 1 -- 172.21.15.45:0/3662492484 >> v1:172.21.15.45:6789/0 conn(0x7f6a1c159350 legacy=0x7f6a1c0ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.211+0000 7f6a13e00640 1 -- 172.21.15.45:0/3662492484 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c0caf10 con 0x7f6a1c0caa40 2024-08-17T02:28:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.212+0000 7f6a13e00640 1 --2- 172.21.15.45:0/3662492484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c0caa40 0x7f6a1c0ace40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009850 tx=0x7f6a040090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ac70155f35cedd server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.212+0000 7f6a1be00640 1 -- 172.21.15.45:0/3662492484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0402ae20 con 0x7f6a1c0caa40 2024-08-17T02:28:43.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.212+0000 7f6a1be00640 1 -- 172.21.15.45:0/3662492484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a04032440 con 0x7f6a1c0caa40 2024-08-17T02:28:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.212+0000 7f6a1be00640 1 -- 172.21.15.45:0/3662492484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a04032820 con 0x7f6a1c0caa40 2024-08-17T02:28:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.213+0000 7f6a23400640 1 -- 172.21.15.45:0/3662492484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c0caa40 msgr2=0x7f6a1c0ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.213+0000 7f6a23400640 1 --2- 172.21.15.45:0/3662492484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c0caa40 0x7f6a1c0ace40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f6a04009850 tx=0x7f6a040090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.213+0000 7f6a23400640 1 -- 172.21.15.45:0/3662492484 shutdown_connections 2024-08-17T02:28:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.213+0000 7f6a23400640 1 --2- 172.21.15.45:0/3662492484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c0caa40 0x7f6a1c0ace40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.213+0000 7f6a23400640 1 -- 172.21.15.45:0/3662492484 >> 172.21.15.45:0/3662492484 conn(0x7f6a1c0cfd90 msgr2=0x7f6a1c0d0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.213+0000 7f6a23400640 1 -- 172.21.15.45:0/3662492484 shutdown_connections 2024-08-17T02:28:43.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.213+0000 7f6a23400640 1 -- 172.21.15.45:0/3662492484 wait complete. 2024-08-17T02:28:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.214+0000 7f6a23400640 1 Processor -- start 2024-08-17T02:28:43.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.215+0000 7f6a23400640 1 -- start start 2024-08-17T02:28:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.215+0000 7f6a23400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a1c0caa40 0x7f6a1c169810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.215+0000 7f6a23400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a1c158f80 0x7f6a1c0b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.217 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.215+0000 7f6a23400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c159350 0x7f6a1c0b42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.215+0000 7f6a23400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c169170 con 0x7f6a1c159350 2024-08-17T02:28:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.215+0000 7f6a23400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0b5580 con 0x7f6a1c158f80 2024-08-17T02:28:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.215+0000 7f6a23400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c169d50 con 0x7f6a1c0caa40 2024-08-17T02:28:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a21400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c159350 0x7f6a1c0b42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a21400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c159350 0x7f6a1c0b42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44424/0 (socket says 172.21.15.45:44424) 2024-08-17T02:28:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a21400640 1 -- 172.21.15.45:0/4028841780 learned_addr learned my addr 172.21.15.45:0/4028841780 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:43.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a20a00640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a1c0caa40 0x7f6a1c169810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a13e00640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a1c158f80 0x7f6a1c0b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a21400640 1 -- 172.21.15.45:0/4028841780 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a1c0caa40 msgr2=0x7f6a1c169810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a21400640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a1c0caa40 0x7f6a1c169810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a21400640 1 -- 172.21.15.45:0/4028841780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a1c158f80 msgr2=0x7f6a1c0b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a21400640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a1c158f80 0x7f6a1c0b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a21400640 1 -- 172.21.15.45:0/4028841780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a04009390 con 0x7f6a1c159350 2024-08-17T02:28:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a20a00640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a1c0caa40 0x7f6a1c169810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.216+0000 7f6a21400640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c159350 0x7f6a1c0b42d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400cbf0 tx=0x7f6a14001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.217+0000 7f6a18c00640 1 -- 172.21.15.45:0/4028841780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400ce10 con 0x7f6a1c159350 2024-08-17T02:28:43.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.217+0000 7f6a18c00640 1 -- 172.21.15.45:0/4028841780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14004b20 con 0x7f6a1c159350 2024-08-17T02:28:43.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.217+0000 7f6a18c00640 1 -- 172.21.15.45:0/4028841780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400a850 con 0x7f6a1c159350 2024-08-17T02:28:43.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.217+0000 7f6a23400640 1 -- 172.21.15.45:0/4028841780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c0b4970 con 0x7f6a1c159350 2024-08-17T02:28:43.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.217+0000 7f6a23400640 1 -- 172.21.15.45:0/4028841780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c0b4f30 con 0x7f6a1c159350 2024-08-17T02:28:43.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.218+0000 7f6a23400640 1 -- 172.21.15.45:0/4028841780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c0b5730 con 0x7f6a1c159350 2024-08-17T02:28:43.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.219+0000 7f6a18c00640 1 -- 172.21.15.45:0/4028841780 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f6a1400ac80 con 0x7f6a1c159350 2024-08-17T02:28:43.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.220+0000 7f6a18c00640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f69f8065150 0x7f69f8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.220+0000 7f6a18c00640 1 -- 172.21.15.45:0/4028841780 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f6a14081ca0 con 0x7f6a1c159350 2024-08-17T02:28:43.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.220+0000 7f6a20a00640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f69f8065150 0x7f69f8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.220+0000 7f6a20a00640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f69f8065150 0x7f69f8067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0017a0 tx=0x7f6a0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.224 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.223+0000 7f6a18c00640 1 -- 172.21.15.45:0/4028841780 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f6a1c0b5730 con 0x7f6a1c159350 2024-08-17T02:28:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.405+0000 7f6a23400640 1 -- 172.21.15.45:0/4028841780 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a1c0b5730 con 0x7f69f8065150 2024-08-17T02:28:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.406+0000 7f6a18c00640 1 -- 172.21.15.45:0/4028841780 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6a1c0b5730 con 0x7f69f8065150 2024-08-17T02:28:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 0 to deep-scrub 2024-08-17T02:28:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 -- 172.21.15.45:0/4028841780 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f69f8065150 msgr2=0x7f69f8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f69f8065150 0x7f69f8067600 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0017a0 tx=0x7f6a0c009040 comp rx=0 tx=0).stop 2024-08-17T02:28:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 -- 172.21.15.45:0/4028841780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c159350 msgr2=0x7f6a1c0b42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c159350 0x7f6a1c0b42d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400cbf0 tx=0x7f6a14001a00 comp rx=0 tx=0).stop 2024-08-17T02:28:43.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 -- 172.21.15.45:0/4028841780 shutdown_connections 2024-08-17T02:28:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c159350 0x7f6a1c0b42d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f6a1c158f80 0x7f6a1c0b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f69f8065150 0x7f69f8067600 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 --2- 172.21.15.45:0/4028841780 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f6a1c0caa40 0x7f6a1c169810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 -- 172.21.15.45:0/4028841780 >> 172.21.15.45:0/4028841780 conn(0x7f6a1c0cfd90 msgr2=0x7f6a1c0d0160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 -- 172.21.15.45:0/4028841780 shutdown_connections 2024-08-17T02:28:43.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.408+0000 7f6a23400640 1 -- 172.21.15.45:0/4028841780 wait complete. 2024-08-17T02:28:43.423 INFO:tasks.ceph:Scrubbing osd.1 2024-08-17T02:28:43.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:43.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.578+0000 7f0bc0a00640 1 Processor -- start 2024-08-17T02:28:43.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.578+0000 7f0bc0a00640 1 -- start start 2024-08-17T02:28:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.579+0000 7f0bc0a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bbc1510b0 0x7f0bbc0af110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.579+0000 7f0bc0a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f0bbc157850 0x7f0bbc0ad910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.579+0000 7f0bc0a00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0aec80 con 0x7f0bbc0ad4a0 2024-08-17T02:28:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.579+0000 7f0bc0a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc0af650 con 0x7f0bbc1510b0 2024-08-17T02:28:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.579+0000 7f0bc0a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc0cc6a0 con 0x7f0bbc157850 2024-08-17T02:28:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.579+0000 7f0bba800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bbc1510b0 0x7f0bbc0af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.580+0000 7f0bba800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0bbc1510b0 0x7f0bbc0af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44438/0 (socket says 172.21.15.45:44438) 2024-08-17T02:28:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.580+0000 7f0bba800640 1 -- 172.21.15.45:0/232609170 learned_addr learned my addr 172.21.15.45:0/232609170 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.580+0000 7f0bbb200640 1 --2- 172.21.15.45:0/232609170 >> v2:172.21.15.169:3300/0 conn(0x7f0bbc157850 0x7f0bbc0ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.580+0000 7f0bba800640 1 -- 172.21.15.45:0/232609170 >> v2:172.21.15.169:3300/0 conn(0x7f0bbc157850 msgr2=0x7f0bbc0ad910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.580+0000 7f0bba800640 1 --2- 172.21.15.45:0/232609170 >> v2:172.21.15.169:3300/0 conn(0x7f0bbc157850 0x7f0bbc0ad910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.580+0000 7f0bba800640 1 -- 172.21.15.45:0/232609170 >> v1:172.21.15.169:6789/0 conn(0x7f0bbc0ad4a0 legacy=0x7f0bbc157140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.580+0000 7f0bba800640 1 -- 172.21.15.45:0/232609170 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0ade50 con 0x7f0bbc1510b0 2024-08-17T02:28:43.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.580+0000 7f0bbb200640 1 --2- 172.21.15.45:0/232609170 >> v2:172.21.15.169:3300/0 conn(0x7f0bbc157850 0x7f0bbc0ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:43.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.581+0000 7f0bba800640 1 --2- 172.21.15.45:0/232609170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bbc1510b0 0x7f0bbc0af110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0682b0 tx=0x7f0bac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772dd0fee532a934 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.581+0000 7f0bb9400640 1 -- 172.21.15.45:0/232609170 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac02ade0 con 0x7f0bbc1510b0 2024-08-17T02:28:43.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.581+0000 7f0bb9400640 1 -- 172.21.15.45:0/232609170 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac032440 con 0x7f0bbc1510b0 2024-08-17T02:28:43.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.581+0000 7f0bb9400640 1 -- 172.21.15.45:0/232609170 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac032820 con 0x7f0bbc1510b0 2024-08-17T02:28:43.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.582+0000 7f0bc0a00640 1 -- 172.21.15.45:0/232609170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bbc1510b0 msgr2=0x7f0bbc0af110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.584 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.582+0000 7f0bc0a00640 1 --2- 172.21.15.45:0/232609170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bbc1510b0 0x7f0bbc0af110 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc0682b0 tx=0x7f0bac0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.582+0000 7f0bc0a00640 1 -- 172.21.15.45:0/232609170 shutdown_connections 2024-08-17T02:28:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.582+0000 7f0bc0a00640 1 --2- 172.21.15.45:0/232609170 >> v2:172.21.15.169:3300/0 conn(0x7f0bbc157850 0x7f0bbc0ad910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.582+0000 7f0bc0a00640 1 --2- 172.21.15.45:0/232609170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bbc1510b0 0x7f0bbc0af110 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.582+0000 7f0bc0a00640 1 -- 172.21.15.45:0/232609170 >> 172.21.15.45:0/232609170 conn(0x7f0bbc067750 msgr2=0x7f0bbc0cb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.582+0000 7f0bc0a00640 1 -- 172.21.15.45:0/232609170 shutdown_connections 2024-08-17T02:28:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.582+0000 7f0bc0a00640 1 -- 172.21.15.45:0/232609170 wait complete. 2024-08-17T02:28:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.583+0000 7f0bc0a00640 1 Processor -- start 2024-08-17T02:28:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.583+0000 7f0bc0a00640 1 -- start start 2024-08-17T02:28:43.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.584+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bbc0ad4a0 0x7f0bbc14dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.584+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bbc1510b0 0x7f0bbc14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.584+0000 7f0bc0a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bbc157850 0x7f0bbc16a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.584+0000 7f0bc0a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc14e7d0 con 0x7f0bbc1510b0 2024-08-17T02:28:43.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.584+0000 7f0bc0a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc15b110 con 0x7f0bbc157850 2024-08-17T02:28:43.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.584+0000 7f0bc0a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc15bf20 con 0x7f0bbc0ad4a0 2024-08-17T02:28:43.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.584+0000 7f0bb9e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bbc1510b0 0x7f0bbc14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bb9e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bbc1510b0 0x7f0bbc14d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44442/0 (socket says 172.21.15.45:44442) 2024-08-17T02:28:43.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bb9e00640 1 -- 172.21.15.45:0/3652943155 learned_addr learned my addr 172.21.15.45:0/3652943155 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:43.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bb9e00640 1 -- 172.21.15.45:0/3652943155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bbc0ad4a0 msgr2=0x7f0bbc14dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bb9e00640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f0bbc0ad4a0 0x7f0bbc14dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bb9e00640 1 -- 172.21.15.45:0/3652943155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bbc157850 msgr2=0x7f0bbc16a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bb9e00640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f0bbc157850 0x7f0bbc16a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bb9e00640 1 -- 172.21.15.45:0/3652943155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bac009450 con 0x7f0bbc1510b0 2024-08-17T02:28:43.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bb9e00640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bbc1510b0 0x7f0bbc14d670 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c5e0 tx=0x7f0ba8007ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bb2000640 1 -- 172.21.15.45:0/3652943155 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8012630 con 0x7f0bbc1510b0 2024-08-17T02:28:43.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bb2000640 1 -- 172.21.15.45:0/3652943155 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba80127b0 con 0x7f0bbc1510b0 2024-08-17T02:28:43.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bb2000640 1 -- 172.21.15.45:0/3652943155 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8012bb0 con 0x7f0bbc1510b0 2024-08-17T02:28:43.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.585+0000 7f0bc0a00640 1 -- 172.21.15.45:0/3652943155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc15b310 con 0x7f0bbc1510b0 2024-08-17T02:28:43.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.586+0000 7f0bc0a00640 1 -- 172.21.15.45:0/3652943155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc15b8d0 con 0x7f0bbc1510b0 2024-08-17T02:28:43.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.586+0000 7f0bc0a00640 1 -- 172.21.15.45:0/3652943155 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0bbc071050 con 0x7f0bbc1510b0 2024-08-17T02:28:43.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.587+0000 7f0bb2000640 1 -- 172.21.15.45:0/3652943155 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f0ba801b400 con 0x7f0bbc1510b0 2024-08-17T02:28:43.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.588+0000 7f0bb2000640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0b9c065180 0x7f0b9c067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.588+0000 7f0bb2000640 1 -- 172.21.15.45:0/3652943155 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0ba8082330 con 0x7f0bbc1510b0 2024-08-17T02:28:43.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.588+0000 7f0bb2000640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] conn(0x7f0b9c06b070 0x7f0b9c06d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.588+0000 7f0bb2000640 1 -- 172.21.15.45:0/3652943155 --> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0b9c06db30 con 0x7f0b9c06b070 2024-08-17T02:28:43.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.588+0000 7f0bb2000640 1 -- 172.21.15.45:0/3652943155 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ba8084890 con 0x7f0bbc1510b0 2024-08-17T02:28:43.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.588+0000 7f0bba800640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0b9c065180 0x7f0b9c067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.589+0000 7f0bbb200640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] conn(0x7f0b9c06b070 0x7f0b9c06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.589+0000 7f0bba800640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0b9c065180 0x7f0b9c067630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0bac034000 tx=0x7f0bac032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.589+0000 7f0bbb200640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] conn(0x7f0b9c06b070 0x7f0b9c06d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.592 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.590+0000 7f0bb2000640 1 -- 172.21.15.45:0/3652943155 <== osd.1 v2:172.21.15.45:6816/37437 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f0b9c06db30 con 0x7f0b9c06b070 2024-08-17T02:28:43.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.603+0000 7f0bc0a00640 1 -- 172.21.15.45:0/3652943155 --> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0bbc064720 con 0x7f0b9c06b070 2024-08-17T02:28:43.604 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.603+0000 7f0bb2000640 1 -- 172.21.15.45:0/3652943155 <== osd.1 v2:172.21.15.45:6816/37437 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0bbc064720 con 0x7f0b9c06b070 2024-08-17T02:28:43.604 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-08-17T02:28:43.604 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:43.604 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-08-17T02:28:43.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.604+0000 7f0bc0a00640 1 -- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] conn(0x7f0b9c06b070 msgr2=0x7f0b9c06d480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.605 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.604+0000 7f0bc0a00640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:6816/37437,v1:172.21.15.45:6817/37437] conn(0x7f0b9c06b070 0x7f0b9c06d480 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.604+0000 7f0bc0a00640 1 -- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0b9c065180 msgr2=0x7f0b9c067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.604+0000 7f0bc0a00640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f0b9c065180 0x7f0b9c067630 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0bac034000 tx=0x7f0bac032000 comp rx=0 tx=0).stop 2024-08-17T02:28:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.604+0000 7f0bc0a00640 1 -- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bbc1510b0 msgr2=0x7f0bbc14d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.604+0000 7f0bc0a00640 1 --2- 172.21.15.45:0/3652943155 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0bbc1510b0 0x7f0bbc14d670 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0ba800c5e0 tx=0x7f0ba8007ed0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.604+0000 7f0bbb200640 1 -- 172.21.15.45:0/3652943155 reap_dead start 2024-08-17T02:28:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.604+0000 7f0bc0a00640 1 -- 172.21.15.45:0/3652943155 shutdown_connections 2024-08-17T02:28:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.604+0000 7f0bc0a00640 1 -- 172.21.15.45:0/3652943155 >> 172.21.15.45:0/3652943155 conn(0x7f0bbc067750 msgr2=0x7f0bbc150380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.606 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.604+0000 7f0bc0a00640 1 -- 172.21.15.45:0/3652943155 shutdown_connections 2024-08-17T02:28:43.607 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.604+0000 7f0bc0a00640 1 -- 172.21.15.45:0/3652943155 wait complete. 2024-08-17T02:28:43.619 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-08-17T02:28:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.771+0000 7f63abe00640 1 Processor -- start 2024-08-17T02:28:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.771+0000 7f63abe00640 1 -- start start 2024-08-17T02:28:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.772+0000 7f63abe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a4167b10 0x7f63a406a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.772+0000 7f63abe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63a40ae290 0x7f63a40b0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.772+0000 7f63abe00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a40aea20 con 0x7f63a406a100 2024-08-17T02:28:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.772+0000 7f63abe00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a4166670 con 0x7f63a40ae290 2024-08-17T02:28:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.772+0000 7f63abe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40aec70 con 0x7f63a4167b10 2024-08-17T02:28:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.772+0000 7f63a9400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f63a406a100 0x7f63a4165620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52084/0 (socket says 172.21.15.45:52084) 2024-08-17T02:28:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.772+0000 7f63a9e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63a40ae290 0x7f63a40b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.772+0000 7f63a9400640 1 -- 172.21.15.45:0/1037969098 learned_addr learned my addr 172.21.15.45:0/1037969098 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.773+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678970541 0 0) 0x7f63a40aea20 con 0x7f63a406a100 2024-08-17T02:28:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.772+0000 7f63a8a00640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a4167b10 0x7f63a406a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.773+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f638c0034c0 con 0x7f63a406a100 2024-08-17T02:28:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3730078070 0 0) 0x7f638c0034c0 con 0x7f63a406a100 2024-08-17T02:28:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a4167b10 msgr2=0x7f63a406a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a4167b10 0x7f63a406a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 >> v2:172.21.15.45:3300/0 conn(0x7f63a40ae290 msgr2=0x7f63a40b0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 --2- 172.21.15.45:0/1037969098 >> v2:172.21.15.45:3300/0 conn(0x7f63a40ae290 0x7f63a40b0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40aef50 con 0x7f63a406a100 2024-08-17T02:28:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2870591726 0 0) 0x7f6398001470 con 0x7f63a406a100 2024-08-17T02:28:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 >> v1:172.21.15.45:6789/0 conn(0x7f63a406a100 legacy=0x7f63a4165620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a4167b10 0x7f638c005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c006180 0x7f638c0065f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c006c60 0x7f638c0070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4166670 con 0x7f638c006180 2024-08-17T02:28:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40aec70 con 0x7f638c006c60 2024-08-17T02:28:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f638c00bbe0 con 0x7f63a4167b10 2024-08-17T02:28:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a8a00640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c006180 0x7f638c0065f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a9400640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a4167b10 0x7f638c005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a9e00640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c006c60 0x7f638c0070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a8a00640 1 -- 172.21.15.45:0/1037969098 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a4167b10 msgr2=0x7f638c005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a8a00640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a4167b10 0x7f638c005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a8a00640 1 -- 172.21.15.45:0/1037969098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c006c60 msgr2=0x7f638c0070d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a8a00640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c006c60 0x7f638c0070d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.774+0000 7f63a8a00640 1 -- 172.21.15.45:0/1037969098 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c0034c0 con 0x7f638c006180 2024-08-17T02:28:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.775+0000 7f63a8a00640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c006180 0x7f638c0065f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f639000d990 tx=0x7f639000d5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837a42a31172fe86 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.776+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390037410 con 0x7f638c006180 2024-08-17T02:28:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.776+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6390031030 con 0x7f638c006180 2024-08-17T02:28:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.776+0000 7f63a3e00640 1 -- 172.21.15.45:0/1037969098 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900377a0 con 0x7f638c006180 2024-08-17T02:28:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.776+0000 7f63abe00640 1 -- 172.21.15.45:0/1037969098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c006180 msgr2=0x7f638c0065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.776+0000 7f63abe00640 1 --2- 172.21.15.45:0/1037969098 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f638c006180 0x7f638c0065f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f639000d990 tx=0x7f639000d5a0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.776+0000 7f63a9e00640 1 -- 172.21.15.45:0/1037969098 reap_dead start 2024-08-17T02:28:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.776+0000 7f63abe00640 1 -- 172.21.15.45:0/1037969098 shutdown_connections 2024-08-17T02:28:43.784 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.776+0000 7f63abe00640 1 -- 172.21.15.45:0/1037969098 >> 172.21.15.45:0/1037969098 conn(0x7f63a40cc480 msgr2=0x7f63a40687b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.776+0000 7f63abe00640 1 -- 172.21.15.45:0/1037969098 shutdown_connections 2024-08-17T02:28:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.776+0000 7f63abe00640 1 -- 172.21.15.45:0/1037969098 wait complete. 2024-08-17T02:28:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.778+0000 7f63abe00640 1 Processor -- start 2024-08-17T02:28:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.778+0000 7f63abe00640 1 -- start start 2024-08-17T02:28:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63abe00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c006180 0x7f63a4179810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63abe00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a40c1390 0x7f63a4159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63abe00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a41640b0 0x7f63a4164520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63abe00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a4164a60 con 0x7f63a41640b0 2024-08-17T02:28:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63abe00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40c17e0 con 0x7f638c006180 2024-08-17T02:28:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63abe00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a40c1a90 con 0x7f63a40c1390 2024-08-17T02:28:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63a9e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a41640b0 0x7f63a4164520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63a9e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a41640b0 0x7f63a4164520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44464/0 (socket says 172.21.15.45:44464) 2024-08-17T02:28:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63a9e00640 1 -- 172.21.15.45:0/931021707 learned_addr learned my addr 172.21.15.45:0/931021707 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63a8a00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a40c1390 0x7f63a4159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63a9400640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c006180 0x7f63a4179810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63a9e00640 1 -- 172.21.15.45:0/931021707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a40c1390 msgr2=0x7f63a4159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63a9e00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a40c1390 0x7f63a4159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63a9e00640 1 -- 172.21.15.45:0/931021707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c006180 msgr2=0x7f63a4179810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63a9e00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c006180 0x7f63a4179810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63a9e00640 1 -- 172.21.15.45:0/931021707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a40ab620 con 0x7f63a41640b0 2024-08-17T02:28:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.779+0000 7f63a8a00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a40c1390 0x7f63a4159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:43.787 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.780+0000 7f63a9e00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a41640b0 0x7f63a4164520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f63a406b030 tx=0x7f639c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.780+0000 7f63a0c00640 1 -- 172.21.15.45:0/931021707 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c00c040 con 0x7f63a41640b0 2024-08-17T02:28:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.780+0000 7f63a0c00640 1 -- 172.21.15.45:0/931021707 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639c010820 con 0x7f63a41640b0 2024-08-17T02:28:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.780+0000 7f63abe00640 1 -- 172.21.15.45:0/931021707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a40ab900 con 0x7f63a41640b0 2024-08-17T02:28:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.780+0000 7f63a0c00640 1 -- 172.21.15.45:0/931021707 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639c010be0 con 0x7f63a41640b0 2024-08-17T02:28:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.780+0000 7f63abe00640 1 -- 172.21.15.45:0/931021707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a40abec0 con 0x7f63a41640b0 2024-08-17T02:28:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.781+0000 7f63abe00640 1 -- 172.21.15.45:0/931021707 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a40ac0e0 con 0x7f63a41640b0 2024-08-17T02:28:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.782+0000 7f63a0c00640 1 -- 172.21.15.45:0/931021707 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f639c020460 con 0x7f63a41640b0 2024-08-17T02:28:43.788 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.783+0000 7f63a0c00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6384065150 0x7f6384067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.783+0000 7f63a0c00640 1 -- 172.21.15.45:0/931021707 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f639c0824c0 con 0x7f63a41640b0 2024-08-17T02:28:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.783+0000 7f63a9400640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6384065150 0x7f6384067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.784+0000 7f63a9400640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6384065150 0x7f6384067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6398001c50 tx=0x7f6398009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:43.789 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.787+0000 7f63a0c00640 1 -- 172.21.15.45:0/931021707 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f639c050820 con 0x7f63a41640b0 2024-08-17T02:28:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.970+0000 7f63abe00640 1 -- 172.21.15.45:0/931021707 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f63a4064db0 con 0x7f6384065150 2024-08-17T02:28:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.970+0000 7f63a0c00640 1 -- 172.21.15.45:0/931021707 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f63a4064db0 con 0x7f6384065150 2024-08-17T02:28:43.971 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 1 to deep-scrub 2024-08-17T02:28:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 -- 172.21.15.45:0/931021707 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6384065150 msgr2=0x7f6384067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6384065150 0x7f6384067600 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f6398001c50 tx=0x7f6398009040 comp rx=0 tx=0).stop 2024-08-17T02:28:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 -- 172.21.15.45:0/931021707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a41640b0 msgr2=0x7f63a4164520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a41640b0 0x7f63a4164520 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f63a406b030 tx=0x7f639c00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 -- 172.21.15.45:0/931021707 shutdown_connections 2024-08-17T02:28:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63a41640b0 0x7f63a4164520 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6384065150 0x7f6384067600 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f63a40c1390 0x7f63a4159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 --2- 172.21.15.45:0/931021707 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f638c006180 0x7f63a4179810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:43.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 -- 172.21.15.45:0/931021707 >> 172.21.15.45:0/931021707 conn(0x7f63a40cc480 msgr2=0x7f63a4087550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 -- 172.21.15.45:0/931021707 shutdown_connections 2024-08-17T02:28:43.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:43.972+0000 7f63abe00640 1 -- 172.21.15.45:0/931021707 wait complete. 2024-08-17T02:28:43.987 INFO:tasks.ceph:Scrubbing osd.2 2024-08-17T02:28:43.987 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:44.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.143+0000 7f3a89e00640 1 Processor -- start 2024-08-17T02:28:44.144 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.143+0000 7f3a89e00640 1 -- start start 2024-08-17T02:28:44.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.144+0000 7f3a89e00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a84150130 0x7f3a840aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.144+0000 7f3a89e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8406e5f0 0x7f3a840ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.145 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.144+0000 7f3a89e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a841568b0 con 0x7f3a84156d40 2024-08-17T02:28:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.144+0000 7f3a89e00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a84150500 con 0x7f3a84150130 2024-08-17T02:28:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.144+0000 7f3a89e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84155fc0 con 0x7f3a8406e5f0 2024-08-17T02:28:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.144+0000 7f3a82a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a84150130 0x7f3a840aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.145+0000 7f3a82a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3a84150130 0x7f3a840aa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44466/0 (socket says 172.21.15.45:44466) 2024-08-17T02:28:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.145+0000 7f3a82a00640 1 -- 172.21.15.45:0/1942136826 learned_addr learned my addr 172.21.15.45:0/1942136826 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:44.146 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.145+0000 7f3a83400640 1 --2- 172.21.15.45:0/1942136826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8406e5f0 0x7f3a840ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.145+0000 7f3a82a00640 1 -- 172.21.15.45:0/1942136826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8406e5f0 msgr2=0x7f3a840ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.145+0000 7f3a82a00640 1 --2- 172.21.15.45:0/1942136826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8406e5f0 0x7f3a840ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.145+0000 7f3a82a00640 1 -- 172.21.15.45:0/1942136826 >> v1:172.21.15.169:6789/0 conn(0x7f3a84156d40 legacy=0x7f3a8406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.145+0000 7f3a82a00640 1 -- 172.21.15.45:0/1942136826 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a840add60 con 0x7f3a84150130 2024-08-17T02:28:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.146+0000 7f3a82a00640 1 --2- 172.21.15.45:0/1942136826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a84150130 0x7f3a840aa730 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009910 tx=0x7f3a740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa8541669b399f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.148 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.146+0000 7f3a81600640 1 -- 172.21.15.45:0/1942136826 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7402adb0 con 0x7f3a84150130 2024-08-17T02:28:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.146+0000 7f3a81600640 1 -- 172.21.15.45:0/1942136826 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a74032440 con 0x7f3a84150130 2024-08-17T02:28:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.146+0000 7f3a81600640 1 -- 172.21.15.45:0/1942136826 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a74032820 con 0x7f3a84150130 2024-08-17T02:28:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.147+0000 7f3a89e00640 1 -- 172.21.15.45:0/1942136826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a84150130 msgr2=0x7f3a840aa730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.147+0000 7f3a89e00640 1 --2- 172.21.15.45:0/1942136826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a84150130 0x7f3a840aa730 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f3a74009910 tx=0x7f3a740091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.147+0000 7f3a89e00640 1 -- 172.21.15.45:0/1942136826 shutdown_connections 2024-08-17T02:28:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.147+0000 7f3a89e00640 1 --2- 172.21.15.45:0/1942136826 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a8406e5f0 0x7f3a840ab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.147+0000 7f3a89e00640 1 --2- 172.21.15.45:0/1942136826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a84150130 0x7f3a840aa730 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.149 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.147+0000 7f3a89e00640 1 -- 172.21.15.45:0/1942136826 >> 172.21.15.45:0/1942136826 conn(0x7f3a84067750 msgr2=0x7f3a8406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.147+0000 7f3a89e00640 1 -- 172.21.15.45:0/1942136826 shutdown_connections 2024-08-17T02:28:44.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.147+0000 7f3a89e00640 1 -- 172.21.15.45:0/1942136826 wait complete. 2024-08-17T02:28:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.148+0000 7f3a89e00640 1 Processor -- start 2024-08-17T02:28:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.148+0000 7f3a89e00640 1 -- start start 2024-08-17T02:28:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.149+0000 7f3a89e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a8406e5f0 0x7f3a841442a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.149+0000 7f3a89e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a84150130 0x7f3a840c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.149+0000 7f3a89e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a84156d40 0x7f3a84153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.149+0000 7f3a89e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84150c70 con 0x7f3a84150130 2024-08-17T02:28:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.149+0000 7f3a89e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a84150f50 con 0x7f3a8406e5f0 2024-08-17T02:28:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.149+0000 7f3a89e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a840ca2a0 con 0x7f3a84156d40 2024-08-17T02:28:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a82000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a84150130 0x7f3a840c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a82000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a84150130 0x7f3a840c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44478/0 (socket says 172.21.15.45:44478) 2024-08-17T02:28:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a82000640 1 -- 172.21.15.45:0/3913766096 learned_addr learned my addr 172.21.15.45:0/3913766096 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a83400640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a84156d40 0x7f3a84153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a82a00640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a8406e5f0 0x7f3a841442a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.153 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a82000640 1 -- 172.21.15.45:0/3913766096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a84156d40 msgr2=0x7f3a84153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a82000640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f3a84156d40 0x7f3a84153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a82000640 1 -- 172.21.15.45:0/3913766096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a8406e5f0 msgr2=0x7f3a841442a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a82000640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f3a8406e5f0 0x7f3a841442a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a82000640 1 -- 172.21.15.45:0/3913766096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a74009450 con 0x7f3a84150130 2024-08-17T02:28:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a82000640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a84150130 0x7f3a840c9a20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c4c0 tx=0x7f3a70007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a7a000640 1 -- 172.21.15.45:0/3913766096 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70011590 con 0x7f3a84150130 2024-08-17T02:28:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a7a000640 1 -- 172.21.15.45:0/3913766096 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a70011710 con 0x7f3a84150130 2024-08-17T02:28:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a7a000640 1 -- 172.21.15.45:0/3913766096 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a70011ad0 con 0x7f3a84150130 2024-08-17T02:28:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.150+0000 7f3a89e00640 1 -- 172.21.15.45:0/3913766096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a840ca580 con 0x7f3a84150130 2024-08-17T02:28:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.151+0000 7f3a89e00640 1 -- 172.21.15.45:0/3913766096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a841447e0 con 0x7f3a84150130 2024-08-17T02:28:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.151+0000 7f3a89e00640 1 -- 172.21.15.45:0/3913766096 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a840710c0 con 0x7f3a84150130 2024-08-17T02:28:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.152+0000 7f3a7a000640 1 -- 172.21.15.45:0/3913766096 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f3a7001b3b0 con 0x7f3a84150130 2024-08-17T02:28:44.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.153+0000 7f3a7a000640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3a64065150 0x7f3a64067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.153+0000 7f3a7a000640 1 -- 172.21.15.45:0/3913766096 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f3a700816e0 con 0x7f3a84150130 2024-08-17T02:28:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.153+0000 7f3a7a000640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] conn(0x7f3a6406b040 0x7f3a6406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.153+0000 7f3a7a000640 1 -- 172.21.15.45:0/3913766096 --> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a6406db00 con 0x7f3a6406b040 2024-08-17T02:28:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.153+0000 7f3a7a000640 1 -- 172.21.15.45:0/3913766096 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a70083be0 con 0x7f3a84150130 2024-08-17T02:28:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.153+0000 7f3a82a00640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3a64065150 0x7f3a64067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.154+0000 7f3a83400640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] conn(0x7f3a6406b040 0x7f3a6406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.154+0000 7f3a82a00640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3a64065150 0x7f3a64067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3a74034000 tx=0x7f3a74032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.157 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.154+0000 7f3a83400640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] conn(0x7f3a6406b040 0x7f3a6406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.155+0000 7f3a7a000640 1 -- 172.21.15.45:0/3913766096 <== osd.2 v2:172.21.15.45:6800/37436 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f3a6406db00 con 0x7f3a6406b040 2024-08-17T02:28:44.168 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.168+0000 7f3a89e00640 1 -- 172.21.15.45:0/3913766096 --> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3a840c9f60 con 0x7f3a6406b040 2024-08-17T02:28:44.169 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.168+0000 7f3a7a000640 1 -- 172.21.15.45:0/3913766096 <== osd.2 v2:172.21.15.45:6800/37436 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3a840c9f60 con 0x7f3a6406b040 2024-08-17T02:28:44.169 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-08-17T02:28:44.170 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:44.170 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-08-17T02:28:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.169+0000 7f3a89e00640 1 -- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] conn(0x7f3a6406b040 msgr2=0x7f3a6406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.169+0000 7f3a89e00640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:6800/37436,v1:172.21.15.45:6801/37436] conn(0x7f3a6406b040 0x7f3a6406d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.169+0000 7f3a89e00640 1 -- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3a64065150 msgr2=0x7f3a64067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.169+0000 7f3a89e00640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f3a64065150 0x7f3a64067600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3a74034000 tx=0x7f3a74032000 comp rx=0 tx=0).stop 2024-08-17T02:28:44.171 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.169+0000 7f3a89e00640 1 -- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a84150130 msgr2=0x7f3a840c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.169+0000 7f3a89e00640 1 --2- 172.21.15.45:0/3913766096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3a84150130 0x7f3a840c9a20 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000c4c0 tx=0x7f3a70007ec0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.173 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.169+0000 7f3a83400640 1 -- 172.21.15.45:0/3913766096 reap_dead start 2024-08-17T02:28:44.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.169+0000 7f3a89e00640 1 -- 172.21.15.45:0/3913766096 shutdown_connections 2024-08-17T02:28:44.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.169+0000 7f3a89e00640 1 -- 172.21.15.45:0/3913766096 >> 172.21.15.45:0/3913766096 conn(0x7f3a84067750 msgr2=0x7f3a8406a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.169+0000 7f3a89e00640 1 -- 172.21.15.45:0/3913766096 shutdown_connections 2024-08-17T02:28:44.174 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.169+0000 7f3a89e00640 1 -- 172.21.15.45:0/3913766096 wait complete. 2024-08-17T02:28:44.183 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-08-17T02:28:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.335+0000 7fa9e3400640 1 Processor -- start 2024-08-17T02:28:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.335+0000 7fa9e3400640 1 -- start start 2024-08-17T02:28:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.336+0000 7fa9e3400640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fa9dc1401b0 0x7fa9dc0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.336+0000 7fa9e3400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc0b1440 0x7fa9dc0c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.336+0000 7fa9e3400640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc0caa80 con 0x7fa9dc140580 2024-08-17T02:28:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.336+0000 7fa9e3400640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0cb450 con 0x7fa9dc1401b0 2024-08-17T02:28:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.336+0000 7fa9e3400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0c9e70 con 0x7fa9dc0b1440 2024-08-17T02:28:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.337+0000 7fa9e1400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc0b1440 0x7fa9dc0c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.337+0000 7fa9e1400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc0b1440 0x7fa9dc0c9040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:46572/0 (socket says 172.21.15.45:46572) 2024-08-17T02:28:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.337+0000 7fa9e1400640 1 -- 172.21.15.45:0/3398232809 learned_addr learned my addr 172.21.15.45:0/3398232809 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.337+0000 7fa9e0a00640 1 --2- 172.21.15.45:0/3398232809 >> v2:172.21.15.169:3300/0 conn(0x7fa9dc1401b0 0x7fa9dc0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.338+0000 7fa9e1400640 1 -- 172.21.15.45:0/3398232809 >> v2:172.21.15.169:3300/0 conn(0x7fa9dc1401b0 msgr2=0x7fa9dc0caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.338+0000 7fa9e1400640 1 --2- 172.21.15.45:0/3398232809 >> v2:172.21.15.169:3300/0 conn(0x7fa9dc1401b0 0x7fa9dc0caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.338+0000 7fa9e1400640 1 -- 172.21.15.45:0/3398232809 >> v1:172.21.15.169:6789/0 conn(0x7fa9dc140580 legacy=0x7fa9dc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.338+0000 7fa9e1400640 1 -- 172.21.15.45:0/3398232809 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc0ca150 con 0x7fa9dc0b1440 2024-08-17T02:28:44.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.339+0000 7fa9e1400640 1 --2- 172.21.15.45:0/3398232809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc0b1440 0x7fa9dc0c9040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009f20 tx=0x7fa9d4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3715093dafd021b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.340 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.339+0000 7fa9db400640 1 -- 172.21.15.45:0/3398232809 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4031400 con 0x7fa9dc0b1440 2024-08-17T02:28:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.339+0000 7fa9db400640 1 -- 172.21.15.45:0/3398232809 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d402d050 con 0x7fa9dc0b1440 2024-08-17T02:28:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.339+0000 7fa9db400640 1 -- 172.21.15.45:0/3398232809 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40317d0 con 0x7fa9dc0b1440 2024-08-17T02:28:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.340+0000 7fa9e3400640 1 -- 172.21.15.45:0/3398232809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc0b1440 msgr2=0x7fa9dc0c9040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.340+0000 7fa9e3400640 1 --2- 172.21.15.45:0/3398232809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc0b1440 0x7fa9dc0c9040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4009f20 tx=0x7fa9d4009840 comp rx=0 tx=0).stop 2024-08-17T02:28:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.340+0000 7fa9e3400640 1 -- 172.21.15.45:0/3398232809 shutdown_connections 2024-08-17T02:28:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.340+0000 7fa9e3400640 1 --2- 172.21.15.45:0/3398232809 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc0b1440 0x7fa9dc0c9040 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.340+0000 7fa9e3400640 1 --2- 172.21.15.45:0/3398232809 >> v2:172.21.15.169:3300/0 conn(0x7fa9dc1401b0 0x7fa9dc0caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.340+0000 7fa9e3400640 1 -- 172.21.15.45:0/3398232809 >> 172.21.15.45:0/3398232809 conn(0x7fa9dc0cb9b0 msgr2=0x7fa9dc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.340+0000 7fa9e3400640 1 -- 172.21.15.45:0/3398232809 shutdown_connections 2024-08-17T02:28:44.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.340+0000 7fa9e3400640 1 -- 172.21.15.45:0/3398232809 wait complete. 2024-08-17T02:28:44.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.341+0000 7fa9e3400640 1 Processor -- start 2024-08-17T02:28:44.342 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.341+0000 7fa9e3400640 1 -- start start 2024-08-17T02:28:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.342+0000 7fa9e3400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9dc0b1440 0x7fa9dc0ab6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.342+0000 7fa9e3400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc1401b0 0x7fa9dc0c2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.344 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.342+0000 7fa9e3400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc140580 0x7fa9dc13efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.342+0000 7fa9e3400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0c09a0 con 0x7fa9dc0b1440 2024-08-17T02:28:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.342+0000 7fa9e3400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0c3200 con 0x7fa9dc1401b0 2024-08-17T02:28:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.342+0000 7fa9e3400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc169b10 con 0x7fa9dc140580 2024-08-17T02:28:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.342+0000 7fa9e0a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9dc0b1440 0x7fa9dc0ab6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.342+0000 7fa9e0a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9dc0b1440 0x7fa9dc0ab6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44482/0 (socket says 172.21.15.45:44482) 2024-08-17T02:28:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.342+0000 7fa9e0a00640 1 -- 172.21.15.45:0/2633930068 learned_addr learned my addr 172.21.15.45:0/2633930068 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.342+0000 7fa9e1400640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc140580 0x7fa9dc13efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.342+0000 7fa9dbe00640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc1401b0 0x7fa9dc0c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.345 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.343+0000 7fa9e0a00640 1 -- 172.21.15.45:0/2633930068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc140580 msgr2=0x7fa9dc13efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.343+0000 7fa9e0a00640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc140580 0x7fa9dc13efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.343+0000 7fa9e0a00640 1 -- 172.21.15.45:0/2633930068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc1401b0 msgr2=0x7fa9dc0c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.343+0000 7fa9e0a00640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc1401b0 0x7fa9dc0c2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.343+0000 7fa9e0a00640 1 -- 172.21.15.45:0/2633930068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4009ae0 con 0x7fa9dc0b1440 2024-08-17T02:28:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.343+0000 7fa9e0a00640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9dc0b1440 0x7fa9dc0ab6b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000ea20 tx=0x7fa9d00090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.343+0000 7fa9cfe00640 1 -- 172.21.15.45:0/2633930068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000ca10 con 0x7fa9dc0b1440 2024-08-17T02:28:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.344+0000 7fa9cfe00640 1 -- 172.21.15.45:0/2633930068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d000cb70 con 0x7fa9dc0b1440 2024-08-17T02:28:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.344+0000 7fa9e3400640 1 -- 172.21.15.45:0/2633930068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc169fa0 con 0x7fa9dc0b1440 2024-08-17T02:28:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.344+0000 7fa9cfe00640 1 -- 172.21.15.45:0/2633930068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0013470 con 0x7fa9dc0b1440 2024-08-17T02:28:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.344+0000 7fa9e3400640 1 -- 172.21.15.45:0/2633930068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc1694c0 con 0x7fa9dc0b1440 2024-08-17T02:28:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.345+0000 7fa9e3400640 1 -- 172.21.15.45:0/2633930068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc064db0 con 0x7fa9dc0b1440 2024-08-17T02:28:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.346+0000 7fa9cfe00640 1 -- 172.21.15.45:0/2633930068 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fa9d0013860 con 0x7fa9dc0b1440 2024-08-17T02:28:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.346+0000 7fa9cfe00640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa9bc065180 0x7fa9bc067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.346+0000 7fa9cfe00640 1 -- 172.21.15.45:0/2633930068 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fa9d0082530 con 0x7fa9dc0b1440 2024-08-17T02:28:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.347+0000 7fa9dbe00640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa9bc065180 0x7fa9bc067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.347+0000 7fa9dbe00640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa9bc065180 0x7fa9bc067630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc15b750 tx=0x7fa9c8007e10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.350+0000 7fa9cfe00640 1 -- 172.21.15.45:0/2633930068 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fa9d0050a00 con 0x7fa9dc0b1440 2024-08-17T02:28:44.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.530+0000 7fa9e3400640 1 -- 172.21.15.45:0/2633930068 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa9dc0cb130 con 0x7fa9bc065180 2024-08-17T02:28:44.531 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.531+0000 7fa9cfe00640 1 -- 172.21.15.45:0/2633930068 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa9dc0cb130 con 0x7fa9bc065180 2024-08-17T02:28:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 2 to deep-scrub 2024-08-17T02:28:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 -- 172.21.15.45:0/2633930068 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa9bc065180 msgr2=0x7fa9bc067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa9bc065180 0x7fa9bc067630 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc15b750 tx=0x7fa9c8007e10 comp rx=0 tx=0).stop 2024-08-17T02:28:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 -- 172.21.15.45:0/2633930068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9dc0b1440 msgr2=0x7fa9dc0ab6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9dc0b1440 0x7fa9dc0ab6b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa9d000ea20 tx=0x7fa9d00090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 -- 172.21.15.45:0/2633930068 shutdown_connections 2024-08-17T02:28:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fa9bc065180 0x7fa9bc067630 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fa9dc140580 0x7fa9dc13efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fa9dc1401b0 0x7fa9dc0c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 --2- 172.21.15.45:0/2633930068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa9dc0b1440 0x7fa9dc0ab6b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 -- 172.21.15.45:0/2633930068 >> 172.21.15.45:0/2633930068 conn(0x7fa9dc0cb9b0 msgr2=0x7fa9dc06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 -- 172.21.15.45:0/2633930068 shutdown_connections 2024-08-17T02:28:44.535 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.533+0000 7fa9e3400640 1 -- 172.21.15.45:0/2633930068 wait complete. 2024-08-17T02:28:44.549 INFO:tasks.ceph:Scrubbing osd.3 2024-08-17T02:28:44.549 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:44.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.703+0000 7f5af8a00640 1 Processor -- start 2024-08-17T02:28:44.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.703+0000 7f5af8a00640 1 -- start start 2024-08-17T02:28:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.704+0000 7f5af8a00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f5af4156890 0x7f5af406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.704+0000 7f5af8a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5af4156c60 0x7f5af406e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.704+0000 7f5af8a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5af40c8130 0x7f5af40c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.704+0000 7f5af8a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af40ae9b0 con 0x7f5af40c8130 2024-08-17T02:28:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.704+0000 7f5af8a00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af40ab320 con 0x7f5af4156890 2024-08-17T02:28:44.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.704+0000 7f5af8a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af40aa730 con 0x7f5af4156c60 2024-08-17T02:28:44.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.704+0000 7f5af2800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5af40c8130 0x7f5af40c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.704+0000 7f5af2800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5af40c8130 0x7f5af40c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44494/0 (socket says 172.21.15.45:44494) 2024-08-17T02:28:44.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.704+0000 7f5af2800640 1 -- 172.21.15.45:0/2887981918 learned_addr learned my addr 172.21.15.45:0/2887981918 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:44.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.705+0000 7f5af1e00640 1 --2- 172.21.15.45:0/2887981918 >> v2:172.21.15.169:3300/0 conn(0x7f5af4156890 0x7f5af406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.705+0000 7f5ae9400640 1 --2- 172.21.15.45:0/2887981918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5af4156c60 0x7f5af406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.705+0000 7f5af2800640 1 -- 172.21.15.45:0/2887981918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5af4156c60 msgr2=0x7f5af406e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.705+0000 7f5af2800640 1 --2- 172.21.15.45:0/2887981918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5af4156c60 0x7f5af406e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.705+0000 7f5af2800640 1 -- 172.21.15.45:0/2887981918 >> v2:172.21.15.169:3300/0 conn(0x7f5af4156890 msgr2=0x7f5af406dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.705+0000 7f5af2800640 1 --2- 172.21.15.45:0/2887981918 >> v2:172.21.15.169:3300/0 conn(0x7f5af4156890 0x7f5af406dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.705+0000 7f5af2800640 1 -- 172.21.15.45:0/2887981918 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af40aa9f0 con 0x7f5af40c8130 2024-08-17T02:28:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.705+0000 7f5af1e00640 1 --2- 172.21.15.45:0/2887981918 >> v2:172.21.15.169:3300/0 conn(0x7f5af4156890 0x7f5af406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:44.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.705+0000 7f5ae9400640 1 --2- 172.21.15.45:0/2887981918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5af4156c60 0x7f5af406e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.706+0000 7f5af2800640 1 --2- 172.21.15.45:0/2887981918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af40c8130 0x7f5af40c85b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5af406c5c0 tx=0x7f5aec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468ef9bb0f203007 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.706+0000 7f5af1400640 1 -- 172.21.15.45:0/2887981918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec031400 con 0x7f5af40c8130 2024-08-17T02:28:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.706+0000 7f5af1400640 1 -- 172.21.15.45:0/2887981918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aec02d050 con 0x7f5af40c8130 2024-08-17T02:28:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.706+0000 7f5af1400640 1 -- 172.21.15.45:0/2887981918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aec0317d0 con 0x7f5af40c8130 2024-08-17T02:28:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.706+0000 7f5af8a00640 1 -- 172.21.15.45:0/2887981918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af40c8130 msgr2=0x7f5af40c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.707+0000 7f5af8a00640 1 --2- 172.21.15.45:0/2887981918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af40c8130 0x7f5af40c85b0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5af406c5c0 tx=0x7f5aec009840 comp rx=0 tx=0).stop 2024-08-17T02:28:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.707+0000 7f5af8a00640 1 -- 172.21.15.45:0/2887981918 shutdown_connections 2024-08-17T02:28:44.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.707+0000 7f5af8a00640 1 --2- 172.21.15.45:0/2887981918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af40c8130 0x7f5af40c85b0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.707+0000 7f5af8a00640 1 --2- 172.21.15.45:0/2887981918 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5af4156c60 0x7f5af406e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.707+0000 7f5af8a00640 1 --2- 172.21.15.45:0/2887981918 >> v2:172.21.15.169:3300/0 conn(0x7f5af4156890 0x7f5af406dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.707+0000 7f5af8a00640 1 -- 172.21.15.45:0/2887981918 >> 172.21.15.45:0/2887981918 conn(0x7f5af4067750 msgr2=0x7f5af406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.707+0000 7f5af8a00640 1 -- 172.21.15.45:0/2887981918 shutdown_connections 2024-08-17T02:28:44.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.707+0000 7f5af8a00640 1 -- 172.21.15.45:0/2887981918 wait complete. 2024-08-17T02:28:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.708+0000 7f5af8a00640 1 Processor -- start 2024-08-17T02:28:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.708+0000 7f5af8a00640 1 -- start start 2024-08-17T02:28:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.709+0000 7f5af8a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af40c8130 0x7f5af414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.712 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.709+0000 7f5af8a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5af4156890 0x7f5af40abe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.709+0000 7f5af8a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5af4156c60 0x7f5af40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.709+0000 7f5af8a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af4157fb0 con 0x7f5af40c8130 2024-08-17T02:28:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.709+0000 7f5af8a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af406ca30 con 0x7f5af4156890 2024-08-17T02:28:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.709+0000 7f5af8a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af406cd10 con 0x7f5af4156c60 2024-08-17T02:28:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.709+0000 7f5af1e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af40c8130 0x7f5af414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.709+0000 7f5af1e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af40c8130 0x7f5af414fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44496/0 (socket says 172.21.15.45:44496) 2024-08-17T02:28:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.709+0000 7f5af1e00640 1 -- 172.21.15.45:0/2432260143 learned_addr learned my addr 172.21.15.45:0/2432260143 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:44.713 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.710+0000 7f5ae9400640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5af4156890 0x7f5af40abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.710+0000 7f5af2800640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5af4156c60 0x7f5af40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.710+0000 7f5af1e00640 1 -- 172.21.15.45:0/2432260143 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5af4156c60 msgr2=0x7f5af40a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.710+0000 7f5af1e00640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5af4156c60 0x7f5af40a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.710+0000 7f5af1e00640 1 -- 172.21.15.45:0/2432260143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5af4156890 msgr2=0x7f5af40abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.710+0000 7f5af1e00640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5af4156890 0x7f5af40abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.710+0000 7f5af1e00640 1 -- 172.21.15.45:0/2432260143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aec009ae0 con 0x7f5af40c8130 2024-08-17T02:28:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.710+0000 7f5ae9400640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f5af4156890 0x7f5af40abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:44.714 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.710+0000 7f5af2800640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f5af4156c60 0x7f5af40a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:44.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.710+0000 7f5af1e00640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af40c8130 0x7f5af414fd50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400c880 tx=0x7f5ae4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.710+0000 7f5aea000640 1 -- 172.21.15.45:0/2432260143 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4007620 con 0x7f5af40c8130 2024-08-17T02:28:44.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.711+0000 7f5aea000640 1 -- 172.21.15.45:0/2432260143 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae4007780 con 0x7f5af40c8130 2024-08-17T02:28:44.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.711+0000 7f5af8a00640 1 -- 172.21.15.45:0/2432260143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af406cff0 con 0x7f5af40c8130 2024-08-17T02:28:44.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.711+0000 7f5aea000640 1 -- 172.21.15.45:0/2432260143 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4007b00 con 0x7f5af40c8130 2024-08-17T02:28:44.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.711+0000 7f5af8a00640 1 -- 172.21.15.45:0/2432260143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af4150290 con 0x7f5af40c8130 2024-08-17T02:28:44.715 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.711+0000 7f5af8a00640 1 -- 172.21.15.45:0/2432260143 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5af40710c0 con 0x7f5af40c8130 2024-08-17T02:28:44.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.712+0000 7f5aea000640 1 -- 172.21.15.45:0/2432260143 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f5ae40113f0 con 0x7f5af40c8130 2024-08-17T02:28:44.716 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.713+0000 7f5aea000640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5ad0065150 0x7f5ad0067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.713+0000 7f5aea000640 1 -- 172.21.15.45:0/2432260143 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f5ae4082230 con 0x7f5af40c8130 2024-08-17T02:28:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.714+0000 7f5ae9400640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5ad0065150 0x7f5ad0067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.714+0000 7f5aea000640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] conn(0x7f5ad006b040 0x7f5ad006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.714+0000 7f5aea000640 1 -- 172.21.15.45:0/2432260143 --> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ad006db00 con 0x7f5ad006b040 2024-08-17T02:28:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.714+0000 7f5aea000640 1 -- 172.21.15.45:0/2432260143 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ae4084790 con 0x7f5af40c8130 2024-08-17T02:28:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.714+0000 7f5af2800640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] conn(0x7f5ad006b040 0x7f5ad006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.714+0000 7f5ae9400640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5ad0065150 0x7f5ad0067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5adc006fd0 tx=0x7f5adc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.717 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.714+0000 7f5af2800640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] conn(0x7f5ad006b040 0x7f5ad006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.718 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.715+0000 7f5aea000640 1 -- 172.21.15.45:0/2432260143 <== osd.3 v2:172.21.15.45:6824/37447 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f5ad006db00 con 0x7f5ad006b040 2024-08-17T02:28:44.728 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.728+0000 7f5af8a00640 1 -- 172.21.15.45:0/2432260143 --> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5af4070740 con 0x7f5ad006b040 2024-08-17T02:28:44.729 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.728+0000 7f5aea000640 1 -- 172.21.15.45:0/2432260143 <== osd.3 v2:172.21.15.45:6824/37447 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5af4070740 con 0x7f5ad006b040 2024-08-17T02:28:44.729 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-08-17T02:28:44.729 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:44.730 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-08-17T02:28:44.730 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.729+0000 7f5af8a00640 1 -- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] conn(0x7f5ad006b040 msgr2=0x7f5ad006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.729+0000 7f5af8a00640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:6824/37447,v1:172.21.15.45:6825/37447] conn(0x7f5ad006b040 0x7f5ad006d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.729+0000 7f5af8a00640 1 -- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5ad0065150 msgr2=0x7f5ad0067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.729+0000 7f5af8a00640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f5ad0065150 0x7f5ad0067600 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5adc006fd0 tx=0x7f5adc008040 comp rx=0 tx=0).stop 2024-08-17T02:28:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.729+0000 7f5af8a00640 1 -- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af40c8130 msgr2=0x7f5af414fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.729+0000 7f5af8a00640 1 --2- 172.21.15.45:0/2432260143 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5af40c8130 0x7f5af414fd50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5ae400c880 tx=0x7f5ae4008040 comp rx=0 tx=0).stop 2024-08-17T02:28:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.729+0000 7f5af2800640 1 -- 172.21.15.45:0/2432260143 reap_dead start 2024-08-17T02:28:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.729+0000 7f5af8a00640 1 -- 172.21.15.45:0/2432260143 shutdown_connections 2024-08-17T02:28:44.731 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.729+0000 7f5af8a00640 1 -- 172.21.15.45:0/2432260143 >> 172.21.15.45:0/2432260143 conn(0x7f5af4067750 msgr2=0x7f5af40ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.729+0000 7f5af8a00640 1 -- 172.21.15.45:0/2432260143 shutdown_connections 2024-08-17T02:28:44.732 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.729+0000 7f5af8a00640 1 -- 172.21.15.45:0/2432260143 wait complete. 2024-08-17T02:28:44.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-08-17T02:28:44.773 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:44.792 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:28:44.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.896+0000 7fc880200640 1 Processor -- start 2024-08-17T02:28:44.897 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.896+0000 7fc880200640 1 -- start start 2024-08-17T02:28:44.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.897+0000 7fc880200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8780ad070 0x7fc8780aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.897+0000 7fc880200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7fc8780a98e0 0x7fc8780ab410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.897+0000 7fc880200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8780aaa40 con 0x7fc878158b10 2024-08-17T02:28:44.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.897+0000 7fc880200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8780a9e30 con 0x7fc8780ad070 2024-08-17T02:28:44.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.897+0000 7fc880200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8780aa110 con 0x7fc8780a98e0 2024-08-17T02:28:44.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.898+0000 7fc87ce00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8780ad070 0x7fc8780aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.899 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.898+0000 7fc87ce00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8780ad070 0x7fc8780aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44500/0 (socket says 172.21.15.45:44500) 2024-08-17T02:28:44.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.898+0000 7fc87ce00640 1 -- 172.21.15.45:0/1846341227 learned_addr learned my addr 172.21.15.45:0/1846341227 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:44.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.898+0000 7fc87e200640 1 --2- 172.21.15.45:0/1846341227 >> v2:172.21.15.169:3300/0 conn(0x7fc8780a98e0 0x7fc8780ab410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.898+0000 7fc87ce00640 1 -- 172.21.15.45:0/1846341227 >> v2:172.21.15.169:3300/0 conn(0x7fc8780a98e0 msgr2=0x7fc8780ab410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:44.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.898+0000 7fc87ce00640 1 --2- 172.21.15.45:0/1846341227 >> v2:172.21.15.169:3300/0 conn(0x7fc8780a98e0 0x7fc8780ab410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.898+0000 7fc87ce00640 1 -- 172.21.15.45:0/1846341227 >> v1:172.21.15.169:6789/0 conn(0x7fc878158b10 legacy=0x7fc8780c8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.900 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.898+0000 7fc87ce00640 1 -- 172.21.15.45:0/1846341227 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8780aa3f0 con 0x7fc8780ad070 2024-08-17T02:28:44.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.899+0000 7fc87ce00640 1 --2- 172.21.15.45:0/1846341227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8780ad070 0x7fc8780aaed0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc878064720 tx=0x7fc8640091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3625c076f867423d server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.901 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.899+0000 7fc877e00640 1 -- 172.21.15.45:0/1846341227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86402add0 con 0x7fc8780ad070 2024-08-17T02:28:44.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.900+0000 7fc877e00640 1 -- 172.21.15.45:0/1846341227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc864032440 con 0x7fc8780ad070 2024-08-17T02:28:44.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.900+0000 7fc877e00640 1 -- 172.21.15.45:0/1846341227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864032820 con 0x7fc8780ad070 2024-08-17T02:28:44.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.900+0000 7fc880200640 1 -- 172.21.15.45:0/1846341227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8780ad070 msgr2=0x7fc8780aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.900+0000 7fc880200640 1 --2- 172.21.15.45:0/1846341227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8780ad070 0x7fc8780aaed0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fc878064720 tx=0x7fc8640091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.900+0000 7fc880200640 1 -- 172.21.15.45:0/1846341227 shutdown_connections 2024-08-17T02:28:44.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.900+0000 7fc880200640 1 --2- 172.21.15.45:0/1846341227 >> v2:172.21.15.169:3300/0 conn(0x7fc8780a98e0 0x7fc8780ab410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.902 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.900+0000 7fc880200640 1 --2- 172.21.15.45:0/1846341227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8780ad070 0x7fc8780aaed0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.900+0000 7fc880200640 1 -- 172.21.15.45:0/1846341227 >> 172.21.15.45:0/1846341227 conn(0x7fc878066cd0 msgr2=0x7fc8780670d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:44.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.900+0000 7fc880200640 1 -- 172.21.15.45:0/1846341227 shutdown_connections 2024-08-17T02:28:44.903 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.900+0000 7fc880200640 1 -- 172.21.15.45:0/1846341227 wait complete. 2024-08-17T02:28:44.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.902+0000 7fc880200640 1 Processor -- start 2024-08-17T02:28:44.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.902+0000 7fc880200640 1 -- start start 2024-08-17T02:28:44.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.902+0000 7fc880200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8780a98e0 0x7fc87815aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc880200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8780ad070 0x7fc878169d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.905 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc880200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc878158b10 0x7fc8780c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc880200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87816a2b0 con 0x7fc8780a98e0 2024-08-17T02:28:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc880200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87815b580 con 0x7fc878158b10 2024-08-17T02:28:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc880200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87815b860 con 0x7fc8780ad070 2024-08-17T02:28:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87d800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8780a98e0 0x7fc87815aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87d800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8780a98e0 0x7fc87815aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44510/0 (socket says 172.21.15.45:44510) 2024-08-17T02:28:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87d800640 1 -- 172.21.15.45:0/4147395166 learned_addr learned my addr 172.21.15.45:0/4147395166 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87d800640 1 -- 172.21.15.45:0/4147395166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8780ad070 msgr2=0x7fc878169d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.906 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87e200640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc878158b10 0x7fc8780c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87ce00640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8780ad070 0x7fc878169d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87d800640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8780ad070 0x7fc878169d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87d800640 1 -- 172.21.15.45:0/4147395166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc878158b10 msgr2=0x7fc8780c23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:44.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87d800640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc878158b10 0x7fc8780c23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:44.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87d800640 1 -- 172.21.15.45:0/4147395166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc864009450 con 0x7fc8780a98e0 2024-08-17T02:28:44.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87e200640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc878158b10 0x7fc8780c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:44.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.903+0000 7fc87ce00640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8780ad070 0x7fc878169d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:44.907 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.904+0000 7fc87d800640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8780a98e0 0x7fc87815aef0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00c4c0 tx=0x7fc86c007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.904+0000 7fc874c00640 1 -- 172.21.15.45:0/4147395166 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c011590 con 0x7fc8780a98e0 2024-08-17T02:28:44.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.904+0000 7fc874c00640 1 -- 172.21.15.45:0/4147395166 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86c011710 con 0x7fc8780a98e0 2024-08-17T02:28:44.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.904+0000 7fc880200640 1 -- 172.21.15.45:0/4147395166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87815bb40 con 0x7fc8780a98e0 2024-08-17T02:28:44.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.904+0000 7fc874c00640 1 -- 172.21.15.45:0/4147395166 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86c011ad0 con 0x7fc8780a98e0 2024-08-17T02:28:44.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.904+0000 7fc880200640 1 -- 172.21.15.45:0/4147395166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87815c100 con 0x7fc8780a98e0 2024-08-17T02:28:44.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.905+0000 7fc880200640 1 -- 172.21.15.45:0/4147395166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc878064db0 con 0x7fc8780a98e0 2024-08-17T02:28:44.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.906+0000 7fc874c00640 1 -- 172.21.15.45:0/4147395166 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fc86c01b3b0 con 0x7fc8780a98e0 2024-08-17T02:28:44.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.907+0000 7fc874c00640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc858065150 0x7fc858067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:44.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.907+0000 7fc874c00640 1 -- 172.21.15.45:0/4147395166 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fc86c081680 con 0x7fc8780a98e0 2024-08-17T02:28:44.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.907+0000 7fc87ce00640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc858065150 0x7fc858067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:44.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.907+0000 7fc87ce00640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc858065150 0x7fc858067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc864034000 tx=0x7fc864032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:44.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:44.910+0000 7fc874c00640 1 -- 172.21.15.45:0/4147395166 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fc86c04f9e0 con 0x7fc8780a98e0 2024-08-17T02:28:45.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.093+0000 7fc880200640 1 -- 172.21.15.45:0/4147395166 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc878067990 con 0x7fc858065150 2024-08-17T02:28:45.095 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.094+0000 7fc874c00640 1 -- 172.21.15.45:0/4147395166 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc878067990 con 0x7fc858065150 2024-08-17T02:28:45.095 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 3 to deep-scrub 2024-08-17T02:28:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 -- 172.21.15.45:0/4147395166 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc858065150 msgr2=0x7fc858067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc858065150 0x7fc858067600 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc864034000 tx=0x7fc864032000 comp rx=0 tx=0).stop 2024-08-17T02:28:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 -- 172.21.15.45:0/4147395166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8780a98e0 msgr2=0x7fc87815aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8780a98e0 0x7fc87815aef0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc86c00c4c0 tx=0x7fc86c007ef0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 -- 172.21.15.45:0/4147395166 shutdown_connections 2024-08-17T02:28:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fc878158b10 0x7fc8780c23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fc858065150 0x7fc858067600 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fc8780ad070 0x7fc878169d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 --2- 172.21.15.45:0/4147395166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8780a98e0 0x7fc87815aef0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 -- 172.21.15.45:0/4147395166 >> 172.21.15.45:0/4147395166 conn(0x7fc878066cd0 msgr2=0x7fc8781559b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 -- 172.21.15.45:0/4147395166 shutdown_connections 2024-08-17T02:28:45.098 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.096+0000 7fc880200640 1 -- 172.21.15.45:0/4147395166 wait complete. 2024-08-17T02:28:45.111 INFO:tasks.ceph:Scrubbing osd.4 2024-08-17T02:28:45.111 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.307+0000 7ff793400640 1 Processor -- start 2024-08-17T02:28:45.308 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.307+0000 7ff793400640 1 -- start start 2024-08-17T02:28:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.308+0000 7ff793400640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff78c152d80 0x7ff78c1561c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.308+0000 7ff793400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff78c0cb040 0x7ff78c0aca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.308+0000 7ff793400640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c156910 con 0x7ff78c0acfa0 2024-08-17T02:28:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.308+0000 7ff793400640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c0ad3e0 con 0x7ff78c152d80 2024-08-17T02:28:45.309 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.308+0000 7ff793400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c153150 con 0x7ff78c0cb040 2024-08-17T02:28:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.309+0000 7ff790a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff78c152d80 0x7ff78c1561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.310 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.309+0000 7ff791400640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff78c0acfa0 0x7ff78c158d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52098/0 (socket says 172.21.15.45:52098) 2024-08-17T02:28:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.309+0000 7ff791400640 1 -- 172.21.15.45:0/2274678608 learned_addr learned my addr 172.21.15.45:0/2274678608 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.309+0000 7ff78be00640 1 --2- 172.21.15.45:0/2274678608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff78c0cb040 0x7ff78c0aca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.309+0000 7ff790a00640 1 -- 172.21.15.45:0/2274678608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff78c0cb040 msgr2=0x7ff78c0aca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.309+0000 7ff790a00640 1 --2- 172.21.15.45:0/2274678608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff78c0cb040 0x7ff78c0aca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.309+0000 7ff790a00640 1 -- 172.21.15.45:0/2274678608 >> v1:172.21.15.45:6789/0 conn(0x7ff78c0acfa0 legacy=0x7ff78c158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.311 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.309+0000 7ff790a00640 1 -- 172.21.15.45:0/2274678608 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c156b60 con 0x7ff78c152d80 2024-08-17T02:28:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.310+0000 7ff790a00640 1 --2- 172.21.15.45:0/2274678608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78c152d80 0x7ff78c1561c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff780009850 tx=0x7ff7800090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984e9bb8c06b1640 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.311+0000 7ff78b400640 1 -- 172.21.15.45:0/2274678608 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78002ad90 con 0x7ff78c152d80 2024-08-17T02:28:45.312 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.311+0000 7ff78b400640 1 -- 172.21.15.45:0/2274678608 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff780032440 con 0x7ff78c152d80 2024-08-17T02:28:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.311+0000 7ff78b400640 1 -- 172.21.15.45:0/2274678608 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff780032820 con 0x7ff78c152d80 2024-08-17T02:28:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.311+0000 7ff793400640 1 -- 172.21.15.45:0/2274678608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78c152d80 msgr2=0x7ff78c1561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.311+0000 7ff793400640 1 --2- 172.21.15.45:0/2274678608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78c152d80 0x7ff78c1561c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7ff780009850 tx=0x7ff7800090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.311+0000 7ff793400640 1 -- 172.21.15.45:0/2274678608 shutdown_connections 2024-08-17T02:28:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.311+0000 7ff793400640 1 --2- 172.21.15.45:0/2274678608 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff78c0cb040 0x7ff78c0aca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.311+0000 7ff793400640 1 --2- 172.21.15.45:0/2274678608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78c152d80 0x7ff78c1561c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.311+0000 7ff793400640 1 -- 172.21.15.45:0/2274678608 >> 172.21.15.45:0/2274678608 conn(0x7ff78c067750 msgr2=0x7ff78c06c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.313 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.311+0000 7ff793400640 1 -- 172.21.15.45:0/2274678608 shutdown_connections 2024-08-17T02:28:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.312+0000 7ff793400640 1 -- 172.21.15.45:0/2274678608 wait complete. 2024-08-17T02:28:45.314 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.313+0000 7ff793400640 1 Processor -- start 2024-08-17T02:28:45.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.313+0000 7ff793400640 1 -- start start 2024-08-17T02:28:45.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.314+0000 7ff793400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff78c0acfa0 0x7ff78c0c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.314+0000 7ff793400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78c0cb040 0x7ff78c153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.314+0000 7ff793400640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c152d80 0x7ff78c0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.314+0000 7ff793400640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0aac70 con 0x7ff78c0cb040 2024-08-17T02:28:45.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.314+0000 7ff793400640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0aaf50 con 0x7ff78c152d80 2024-08-17T02:28:45.315 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.314+0000 7ff793400640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c0ab230 con 0x7ff78c0acfa0 2024-08-17T02:28:45.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.314+0000 7ff78be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78c0cb040 0x7ff78c153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.314+0000 7ff78be00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78c0cb040 0x7ff78c153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44532/0 (socket says 172.21.15.45:44532) 2024-08-17T02:28:45.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.314+0000 7ff78be00640 1 -- 172.21.15.45:0/330518905 learned_addr learned my addr 172.21.15.45:0/330518905 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:45.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.314+0000 7ff791400640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c152d80 0x7ff78c0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.317 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.314+0000 7ff790a00640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff78c0acfa0 0x7ff78c0c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.315+0000 7ff78be00640 1 -- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff78c0acfa0 msgr2=0x7ff78c0c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.315+0000 7ff78be00640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff78c0acfa0 0x7ff78c0c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.315+0000 7ff78be00640 1 -- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c152d80 msgr2=0x7ff78c0c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.315+0000 7ff78be00640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c152d80 0x7ff78c0c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.315+0000 7ff78be00640 1 -- 172.21.15.45:0/330518905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780009390 con 0x7ff78c0cb040 2024-08-17T02:28:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.315+0000 7ff791400640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff78c152d80 0x7ff78c0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:45.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.315+0000 7ff790a00640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff78c0acfa0 0x7ff78c0c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-17T02:28:45.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.315+0000 7ff78be00640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78c0cb040 0x7ff78c153f10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff77800ea20 tx=0x7ff7780090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.316+0000 7ff77fe00640 1 -- 172.21.15.45:0/330518905 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77800ca10 con 0x7ff78c0cb040 2024-08-17T02:28:45.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.316+0000 7ff77fe00640 1 -- 172.21.15.45:0/330518905 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77800cb70 con 0x7ff78c0cb040 2024-08-17T02:28:45.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.316+0000 7ff77fe00640 1 -- 172.21.15.45:0/330518905 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff778013470 con 0x7ff78c0cb040 2024-08-17T02:28:45.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.316+0000 7ff793400640 1 -- 172.21.15.45:0/330518905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c0ab510 con 0x7ff78c0cb040 2024-08-17T02:28:45.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.316+0000 7ff793400640 1 -- 172.21.15.45:0/330518905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c0aa8b0 con 0x7ff78c0cb040 2024-08-17T02:28:45.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.317+0000 7ff793400640 1 -- 172.21.15.45:0/330518905 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff78c0710c0 con 0x7ff78c0cb040 2024-08-17T02:28:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.318+0000 7ff77fe00640 1 -- 172.21.15.45:0/330518905 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff778013860 con 0x7ff78c0cb040 2024-08-17T02:28:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.318+0000 7ff77fe00640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff76c065150 0x7ff76c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.318+0000 7ff77fe00640 1 -- 172.21.15.45:0/330518905 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff778082490 con 0x7ff78c0cb040 2024-08-17T02:28:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.319+0000 7ff790a00640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff76c065150 0x7ff76c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.319+0000 7ff77fe00640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] conn(0x7ff76c06b040 0x7ff76c06d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.319+0000 7ff77fe00640 1 -- 172.21.15.45:0/330518905 --> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff76c06db00 con 0x7ff76c06b040 2024-08-17T02:28:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.319+0000 7ff77fe00640 1 -- 172.21.15.45:0/330518905 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7780849f0 con 0x7ff78c0cb040 2024-08-17T02:28:45.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.319+0000 7ff791400640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] conn(0x7ff76c06b040 0x7ff76c06d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.319+0000 7ff790a00640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff76c065150 0x7ff76c067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff780034000 tx=0x7ff780032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.320+0000 7ff791400640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] conn(0x7ff76c06b040 0x7ff76c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.321+0000 7ff77fe00640 1 -- 172.21.15.45:0/330518905 <== osd.4 v2:172.21.15.169:6824/37316 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff76c06db00 con 0x7ff76c06b040 2024-08-17T02:28:45.334 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.334+0000 7ff793400640 1 -- 172.21.15.45:0/330518905 --> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff78c06ddc0 con 0x7ff76c06b040 2024-08-17T02:28:45.335 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.334+0000 7ff77fe00640 1 -- 172.21.15.45:0/330518905 <== osd.4 v2:172.21.15.169:6824/37316 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff78c06ddc0 con 0x7ff76c06b040 2024-08-17T02:28:45.335 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-08-17T02:28:45.335 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:45.336 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-08-17T02:28:45.336 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.335+0000 7ff793400640 1 -- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] conn(0x7ff76c06b040 msgr2=0x7ff76c06d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.335+0000 7ff793400640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.169:6824/37316,v1:172.21.15.169:6825/37316] conn(0x7ff76c06b040 0x7ff76c06d450 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.335+0000 7ff793400640 1 -- 172.21.15.45:0/330518905 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff76c065150 msgr2=0x7ff76c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.335+0000 7ff793400640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff76c065150 0x7ff76c067600 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff780034000 tx=0x7ff780032000 comp rx=0 tx=0).stop 2024-08-17T02:28:45.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.335+0000 7ff793400640 1 -- 172.21.15.45:0/330518905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78c0cb040 msgr2=0x7ff78c153f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.335+0000 7ff793400640 1 --2- 172.21.15.45:0/330518905 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff78c0cb040 0x7ff78c153f10 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff77800ea20 tx=0x7ff7780090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.335+0000 7ff791400640 1 -- 172.21.15.45:0/330518905 reap_dead start 2024-08-17T02:28:45.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.335+0000 7ff793400640 1 -- 172.21.15.45:0/330518905 shutdown_connections 2024-08-17T02:28:45.337 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.335+0000 7ff793400640 1 -- 172.21.15.45:0/330518905 >> 172.21.15.45:0/330518905 conn(0x7ff78c067750 msgr2=0x7ff78c14ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.335+0000 7ff793400640 1 -- 172.21.15.45:0/330518905 shutdown_connections 2024-08-17T02:28:45.338 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.335+0000 7ff793400640 1 -- 172.21.15.45:0/330518905 wait complete. 2024-08-17T02:28:45.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-08-17T02:28:45.503 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.502+0000 7f61b3200640 1 Processor -- start 2024-08-17T02:28:45.504 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.503+0000 7f61b3200640 1 -- start start 2024-08-17T02:28:45.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.504+0000 7f61b3200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61ac0ccca0 0x7f61ac163870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.504+0000 7f61b3200640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac0cadc0 con 0x7f61ac159ca0 2024-08-17T02:28:45.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.504+0000 7f61b3200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac0cb060 con 0x7f61ac0ceb40 2024-08-17T02:28:45.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.504+0000 7f61b3200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac0cd6e0 con 0x7f61ac0ccca0 2024-08-17T02:28:45.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.504+0000 7f61b1e00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f61ac159ca0 0x7f61ac0ca360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52102/0 (socket says 172.21.15.45:52102) 2024-08-17T02:28:45.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.504+0000 7f61b1e00640 1 -- 172.21.15.45:0/4024745357 learned_addr learned my addr 172.21.15.45:0/4024745357 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:45.505 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.504+0000 7f61b2800640 1 --2- 172.21.15.45:0/4024745357 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61ac0ccca0 0x7f61ac163870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.505+0000 7f61b0a00640 1 -- 172.21.15.45:0/4024745357 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485277644 0 0) 0x7f61ac0cadc0 con 0x7f61ac159ca0 2024-08-17T02:28:45.506 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.505+0000 7f61b0a00640 1 -- 172.21.15.45:0/4024745357 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61940034e0 con 0x7f61ac159ca0 2024-08-17T02:28:45.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.505+0000 7f61b0a00640 1 -- 172.21.15.45:0/4024745357 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3886213896 0 0) 0x7f61ac0cb060 con 0x7f61ac0ceb40 2024-08-17T02:28:45.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.505+0000 7f61b0a00640 1 -- 172.21.15.45:0/4024745357 --> v1:172.21.15.169:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61ac0cadc0 con 0x7f61ac0ceb40 2024-08-17T02:28:45.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.505+0000 7f61b2800640 1 -- 172.21.15.45:0/4024745357 >> v1:172.21.15.169:6789/0 conn(0x7f61ac0ceb40 legacy=0x7f61ac0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.505+0000 7f61b2800640 1 -- 172.21.15.45:0/4024745357 >> v1:172.21.15.45:6789/0 conn(0x7f61ac159ca0 legacy=0x7f61ac0ca360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.507 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.505+0000 7f61b2800640 1 -- 172.21.15.45:0/4024745357 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac0cb300 con 0x7f61ac0ccca0 2024-08-17T02:28:45.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.506+0000 7f61b2800640 1 --2- 172.21.15.45:0/4024745357 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61ac0ccca0 0x7f61ac163870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009e90 tx=0x7f61a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=651d4ad2b7c3084f server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.507+0000 7f61b0a00640 1 -- 172.21.15.45:0/4024745357 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a8007550 con 0x7f61ac0ccca0 2024-08-17T02:28:45.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.507+0000 7f61b0a00640 1 -- 172.21.15.45:0/4024745357 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a802d050 con 0x7f61ac0ccca0 2024-08-17T02:28:45.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.507+0000 7f61b0a00640 1 -- 172.21.15.45:0/4024745357 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a80078e0 con 0x7f61ac0ccca0 2024-08-17T02:28:45.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.507+0000 7f61b3200640 1 -- 172.21.15.45:0/4024745357 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61ac0ccca0 msgr2=0x7f61ac163870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.508 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.507+0000 7f61b3200640 1 --2- 172.21.15.45:0/4024745357 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61ac0ccca0 0x7f61ac163870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f61a8009e90 tx=0x7f61a8009780 comp rx=0 tx=0).stop 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.507+0000 7f61b3200640 1 -- 172.21.15.45:0/4024745357 shutdown_connections 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.507+0000 7f61b3200640 1 --2- 172.21.15.45:0/4024745357 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61ac0ccca0 0x7f61ac163870 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.508+0000 7f61b3200640 1 -- 172.21.15.45:0/4024745357 >> 172.21.15.45:0/4024745357 conn(0x7f61ac098e00 msgr2=0x7f61ac06eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.509 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.508+0000 7f61b3200640 1 -- 172.21.15.45:0/4024745357 shutdown_connections 2024-08-17T02:28:45.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.508+0000 7f61b3200640 1 -- 172.21.15.45:0/4024745357 wait complete. 2024-08-17T02:28:45.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.509+0000 7f61b3200640 1 Processor -- start 2024-08-17T02:28:45.510 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.509+0000 7f61b3200640 1 -- start start 2024-08-17T02:28:45.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.510+0000 7f61b3200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61ac0ccca0 0x7f61ac154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.510+0000 7f61b3200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61ac0ceb40 0x7f61ac09a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.510+0000 7f61b3200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61ac159ca0 0x7f61ac0c5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.510+0000 7f61b3200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac09cf90 con 0x7f61ac0ccca0 2024-08-17T02:28:45.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.510+0000 7f61b3200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac09c380 con 0x7f61ac159ca0 2024-08-17T02:28:45.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.510+0000 7f61b3200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac09c660 con 0x7f61ac0ceb40 2024-08-17T02:28:45.512 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.510+0000 7f61b1e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61ac0ccca0 0x7f61ac154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.511+0000 7f61b1e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61ac0ccca0 0x7f61ac154d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44548/0 (socket says 172.21.15.45:44548) 2024-08-17T02:28:45.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.511+0000 7f61b1e00640 1 -- 172.21.15.45:0/1445032746 learned_addr learned my addr 172.21.15.45:0/1445032746 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:45.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.511+0000 7f61b2800640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61ac159ca0 0x7f61ac0c5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.511+0000 7f61b1400640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61ac0ceb40 0x7f61ac09a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.511+0000 7f61b1e00640 1 -- 172.21.15.45:0/1445032746 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61ac0ceb40 msgr2=0x7f61ac09a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.511+0000 7f61b1e00640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61ac0ceb40 0x7f61ac09a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.511+0000 7f61b1e00640 1 -- 172.21.15.45:0/1445032746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61ac159ca0 msgr2=0x7f61ac0c5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.511+0000 7f61b1e00640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61ac159ca0 0x7f61ac0c5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.513 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.511+0000 7f61b1e00640 1 -- 172.21.15.45:0/1445032746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8009a20 con 0x7f61ac0ccca0 2024-08-17T02:28:45.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.511+0000 7f61b1e00640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61ac0ccca0 0x7f61ac154d30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005840 tx=0x7f61a0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.514 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.512+0000 7f61a5600640 1 -- 172.21.15.45:0/1445032746 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a0005aa0 con 0x7f61ac0ccca0 2024-08-17T02:28:45.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.512+0000 7f61a5600640 1 -- 172.21.15.45:0/1445032746 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a0005c00 con 0x7f61ac0ccca0 2024-08-17T02:28:45.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.512+0000 7f61a5600640 1 -- 172.21.15.45:0/1445032746 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00070d0 con 0x7f61ac0ccca0 2024-08-17T02:28:45.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.512+0000 7f61b3200640 1 -- 172.21.15.45:0/1445032746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac09c940 con 0x7f61ac0ccca0 2024-08-17T02:28:45.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.512+0000 7f61b3200640 1 -- 172.21.15.45:0/1445032746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac155270 con 0x7f61ac0ccca0 2024-08-17T02:28:45.515 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.513+0000 7f61b3200640 1 -- 172.21.15.45:0/1445032746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ac071050 con 0x7f61ac0ccca0 2024-08-17T02:28:45.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.514+0000 7f61a5600640 1 -- 172.21.15.45:0/1445032746 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f61a00074c0 con 0x7f61ac0ccca0 2024-08-17T02:28:45.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.515+0000 7f61a5600640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6190065180 0x7f6190067630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.515+0000 7f61a5600640 1 -- 172.21.15.45:0/1445032746 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f61a00816c0 con 0x7f61ac0ccca0 2024-08-17T02:28:45.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.515+0000 7f61b1400640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6190065180 0x7f6190067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.516 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.516+0000 7f61b1400640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6190065180 0x7f6190067630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f61ac1591c0 tx=0x7f619c007cc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.519 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.519+0000 7f61a5600640 1 -- 172.21.15.45:0/1445032746 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f61a004faf0 con 0x7f61ac0ccca0 2024-08-17T02:28:45.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.702+0000 7f61b3200640 1 -- 172.21.15.45:0/1445032746 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f61ac09d0d0 con 0x7f6190065180 2024-08-17T02:28:45.703 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.702+0000 7f61a5600640 1 -- 172.21.15.45:0/1445032746 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f619c002980 con 0x7f6190065180 2024-08-17T02:28:45.703 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 4 to deep-scrub 2024-08-17T02:28:45.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.704+0000 7f61b3200640 1 -- 172.21.15.45:0/1445032746 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6190065180 msgr2=0x7f6190067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.704+0000 7f61b3200640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6190065180 0x7f6190067630 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f61ac1591c0 tx=0x7f619c007cc0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.704+0000 7f61b3200640 1 -- 172.21.15.45:0/1445032746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61ac0ccca0 msgr2=0x7f61ac154d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.704+0000 7f61b3200640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61ac0ccca0 0x7f61ac154d30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f61a0005840 tx=0x7f61a0007df0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.705+0000 7f61b3200640 1 -- 172.21.15.45:0/1445032746 shutdown_connections 2024-08-17T02:28:45.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.705+0000 7f61b3200640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f61ac159ca0 0x7f61ac0c5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.705+0000 7f61b3200640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6190065180 0x7f6190067630 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.705+0000 7f61b3200640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f61ac0ceb40 0x7f61ac09a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.705+0000 7f61b3200640 1 --2- 172.21.15.45:0/1445032746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f61ac0ccca0 0x7f61ac154d30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.705+0000 7f61b3200640 1 -- 172.21.15.45:0/1445032746 >> 172.21.15.45:0/1445032746 conn(0x7f61ac098e00 msgr2=0x7f61ac155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.705+0000 7f61b3200640 1 -- 172.21.15.45:0/1445032746 shutdown_connections 2024-08-17T02:28:45.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.705+0000 7f61b3200640 1 -- 172.21.15.45:0/1445032746 wait complete. 2024-08-17T02:28:45.723 INFO:tasks.ceph:Scrubbing osd.5 2024-08-17T02:28:45.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:45.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.880+0000 7ffa29a00640 1 Processor -- start 2024-08-17T02:28:45.881 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.880+0000 7ffa29a00640 1 -- start start 2024-08-17T02:28:45.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.882+0000 7ffa29a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa240adc00 0x7ffa240b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.882+0000 7ffa29a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa240b11e0 0x7ffa240b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.882+0000 7ffa29a00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa240b0030 con 0x7ffa240b59f0 2024-08-17T02:28:45.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.882+0000 7ffa29a00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa240aefc0 con 0x7ffa240adc00 2024-08-17T02:28:45.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.882+0000 7ffa29a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa240af2a0 con 0x7ffa240b11e0 2024-08-17T02:28:45.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.882+0000 7ffa1be00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffa240b59f0 0x7ffa240b0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52108/0 (socket says 172.21.15.45:52108) 2024-08-17T02:28:45.883 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.882+0000 7ffa1be00640 1 -- 172.21.15.45:0/1897613409 learned_addr learned my addr 172.21.15.45:0/1897613409 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:45.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.882+0000 7ffa22a00640 1 --2- 172.21.15.45:0/1897613409 >> v2:172.21.15.45:3300/0 conn(0x7ffa240adc00 0x7ffa240b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.882+0000 7ffa23400640 1 --2- 172.21.15.45:0/1897613409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa240b11e0 0x7ffa240b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.884 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.883+0000 7ffa22a00640 1 -- 172.21.15.45:0/1897613409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa240b11e0 msgr2=0x7ffa240b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:45.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.883+0000 7ffa22a00640 1 --2- 172.21.15.45:0/1897613409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa240b11e0 0x7ffa240b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.883+0000 7ffa22a00640 1 -- 172.21.15.45:0/1897613409 >> v1:172.21.15.45:6789/0 conn(0x7ffa240b59f0 legacy=0x7ffa240b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.883+0000 7ffa22a00640 1 -- 172.21.15.45:0/1897613409 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa240b02d0 con 0x7ffa240adc00 2024-08-17T02:28:45.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.883+0000 7ffa22000640 1 -- 172.21.15.45:0/1897613409 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291484032 0 0) 0x7ffa240b0030 con 0x7ffa240b59f0 2024-08-17T02:28:45.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.884+0000 7ffa22a00640 1 --2- 172.21.15.45:0/1897613409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa240adc00 0x7ffa240b2ce0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009850 tx=0x7ffa140090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43df836a7edcc881 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.884+0000 7ffa22000640 1 -- 172.21.15.45:0/1897613409 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1402ad00 con 0x7ffa240adc00 2024-08-17T02:28:45.885 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.884+0000 7ffa22000640 1 -- 172.21.15.45:0/1897613409 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1402ae60 con 0x7ffa240adc00 2024-08-17T02:28:45.886 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.884+0000 7ffa22000640 1 -- 172.21.15.45:0/1897613409 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14032670 con 0x7ffa240adc00 2024-08-17T02:28:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.884+0000 7ffa29a00640 1 -- 172.21.15.45:0/1897613409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa240adc00 msgr2=0x7ffa240b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.884+0000 7ffa29a00640 1 --2- 172.21.15.45:0/1897613409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa240adc00 0x7ffa240b2ce0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009850 tx=0x7ffa140090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.885+0000 7ffa29a00640 1 -- 172.21.15.45:0/1897613409 shutdown_connections 2024-08-17T02:28:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.885+0000 7ffa29a00640 1 --2- 172.21.15.45:0/1897613409 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa240b11e0 0x7ffa240b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.885+0000 7ffa29a00640 1 --2- 172.21.15.45:0/1897613409 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa240adc00 0x7ffa240b2ce0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.885+0000 7ffa29a00640 1 -- 172.21.15.45:0/1897613409 >> 172.21.15.45:0/1897613409 conn(0x7ffa240cfdb0 msgr2=0x7ffa240d0180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.887 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.885+0000 7ffa29a00640 1 -- 172.21.15.45:0/1897613409 shutdown_connections 2024-08-17T02:28:45.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.885+0000 7ffa29a00640 1 -- 172.21.15.45:0/1897613409 wait complete. 2024-08-17T02:28:45.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.886+0000 7ffa29a00640 1 Processor -- start 2024-08-17T02:28:45.888 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.886+0000 7ffa29a00640 1 -- start start 2024-08-17T02:28:45.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.887+0000 7ffa29a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa240adc00 0x7ffa24148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.889 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.887+0000 7ffa29a00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa240b11e0 0x7ffa24067730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.887+0000 7ffa29a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa240b59f0 0x7ffa24067c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.887+0000 7ffa29a00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2415abe0 con 0x7ffa240b59f0 2024-08-17T02:28:45.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.887+0000 7ffa29a00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2415aec0 con 0x7ffa240b11e0 2024-08-17T02:28:45.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.887+0000 7ffa29a00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2415b1a0 con 0x7ffa240adc00 2024-08-17T02:28:45.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.887+0000 7ffa23400640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa240b59f0 0x7ffa24067c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.888+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa240b11e0 0x7ffa24067730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.890 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.887+0000 7ffa22a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa240adc00 0x7ffa24148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.888+0000 7ffa1be00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa240b11e0 0x7ffa24067730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3300/0 says I am v2:172.21.15.45:51102/0 (socket says 172.21.15.45:51102) 2024-08-17T02:28:45.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.888+0000 7ffa1be00640 1 -- 172.21.15.45:0/1568921181 learned_addr learned my addr 172.21.15.45:0/1568921181 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:45.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.888+0000 7ffa22a00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa240adc00 0x7ffa24148570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:46652/0 (socket says 172.21.15.45:46652) 2024-08-17T02:28:45.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.888+0000 7ffa1be00640 1 -- 172.21.15.45:0/1568921181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa240adc00 msgr2=0x7ffa24148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.888+0000 7ffa1be00640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ffa240adc00 0x7ffa24148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.888+0000 7ffa1be00640 1 -- 172.21.15.45:0/1568921181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa240b59f0 msgr2=0x7ffa24067c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.888+0000 7ffa1be00640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa240b59f0 0x7ffa24067c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.891 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.888+0000 7ffa1be00640 1 -- 172.21.15.45:0/1568921181 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14009390 con 0x7ffa240b11e0 2024-08-17T02:28:45.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.888+0000 7ffa1be00640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa240b11e0 0x7ffa24067730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00c510 tx=0x7ffa0c00c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.889+0000 7ffa1a000640 1 -- 172.21.15.45:0/1568921181 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c005aa0 con 0x7ffa240b11e0 2024-08-17T02:28:45.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.889+0000 7ffa1a000640 1 -- 172.21.15.45:0/1568921181 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0c005c00 con 0x7ffa240b11e0 2024-08-17T02:28:45.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.889+0000 7ffa1a000640 1 -- 172.21.15.45:0/1568921181 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0c0070d0 con 0x7ffa240b11e0 2024-08-17T02:28:45.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.889+0000 7ffa29a00640 1 -- 172.21.15.45:0/1568921181 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2415b480 con 0x7ffa240b11e0 2024-08-17T02:28:45.892 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.889+0000 7ffa29a00640 1 -- 172.21.15.45:0/1568921181 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa24148ab0 con 0x7ffa240b11e0 2024-08-17T02:28:45.893 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.890+0000 7ffa29a00640 1 -- 172.21.15.45:0/1568921181 --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa240710c0 con 0x7ffa240b11e0 2024-08-17T02:28:45.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.891+0000 7ffa1a000640 1 -- 172.21.15.45:0/1568921181 <== mon.1 v2:172.21.15.169:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ffa0c007500 con 0x7ffa240b11e0 2024-08-17T02:28:45.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.892+0000 7ffa1a000640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ffa00065150 0x7ffa00067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.892+0000 7ffa1a000640 1 -- 172.21.15.45:0/1568921181 <== mon.1 v2:172.21.15.169:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ffa0c081e70 con 0x7ffa240b11e0 2024-08-17T02:28:45.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.892+0000 7ffa22a00640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ffa00065150 0x7ffa00067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.892+0000 7ffa1a000640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] conn(0x7ffa0006b040 0x7ffa0006d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:45.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.892+0000 7ffa1a000640 1 -- 172.21.15.45:0/1568921181 --> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa0006db00 con 0x7ffa0006b040 2024-08-17T02:28:45.894 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.892+0000 7ffa1a000640 1 -- 172.21.15.45:0/1568921181 <== mon.1 v2:172.21.15.169:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa0c082160 con 0x7ffa240b11e0 2024-08-17T02:28:45.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.893+0000 7ffa23400640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] conn(0x7ffa0006b040 0x7ffa0006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:45.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.893+0000 7ffa22a00640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ffa00065150 0x7ffa00067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa14034000 tx=0x7ffa14032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.895 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.894+0000 7ffa23400640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] conn(0x7ffa0006b040 0x7ffa0006d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:45.896 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.894+0000 7ffa1a000640 1 -- 172.21.15.45:0/1568921181 <== osd.5 v2:172.21.15.169:6808/37297 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ffa0006db00 con 0x7ffa0006b040 2024-08-17T02:28:45.908 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.907+0000 7ffa29a00640 1 -- 172.21.15.45:0/1568921181 --> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffa2415b000 con 0x7ffa0006b040 2024-08-17T02:28:45.909 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.908+0000 7ffa1a000640 1 -- 172.21.15.45:0/1568921181 <== osd.5 v2:172.21.15.169:6808/37297 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffa2415b000 con 0x7ffa0006b040 2024-08-17T02:28:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-08-17T02:28:45.909 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:45.909 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-08-17T02:28:45.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.908+0000 7ffa29a00640 1 -- 172.21.15.45:0/1568921181 >> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] conn(0x7ffa0006b040 msgr2=0x7ffa0006d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.909+0000 7ffa29a00640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.169:6808/37297,v1:172.21.15.169:6809/37297] conn(0x7ffa0006b040 0x7ffa0006d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:45.910 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.909+0000 7ffa29a00640 1 -- 172.21.15.45:0/1568921181 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ffa00065150 msgr2=0x7ffa00067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.909+0000 7ffa29a00640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ffa00065150 0x7ffa00067600 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffa14034000 tx=0x7ffa14032000 comp rx=0 tx=0).stop 2024-08-17T02:28:45.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.909+0000 7ffa29a00640 1 -- 172.21.15.45:0/1568921181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa240b11e0 msgr2=0x7ffa24067730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:45.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.909+0000 7ffa29a00640 1 --2- 172.21.15.45:0/1568921181 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ffa240b11e0 0x7ffa24067730 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ffa0c00c510 tx=0x7ffa0c00c910 comp rx=0 tx=0).stop 2024-08-17T02:28:45.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.909+0000 7ffa23400640 1 -- 172.21.15.45:0/1568921181 reap_dead start 2024-08-17T02:28:45.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.909+0000 7ffa29a00640 1 -- 172.21.15.45:0/1568921181 shutdown_connections 2024-08-17T02:28:45.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.909+0000 7ffa29a00640 1 -- 172.21.15.45:0/1568921181 >> 172.21.15.45:0/1568921181 conn(0x7ffa240cfdb0 msgr2=0x7ffa240b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:45.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.909+0000 7ffa29a00640 1 -- 172.21.15.45:0/1568921181 shutdown_connections 2024-08-17T02:28:45.911 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:45.909+0000 7ffa29a00640 1 -- 172.21.15.45:0/1568921181 wait complete. 2024-08-17T02:28:45.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-08-17T02:28:46.081 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.081+0000 7fb810200640 1 Processor -- start 2024-08-17T02:28:46.082 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.081+0000 7fb810200640 1 -- start start 2024-08-17T02:28:46.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.082+0000 7fb810200640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8080b1440 0x7fb8080caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.082+0000 7fb810200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb808140580 0x7fb8080c9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.082+0000 7fb810200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8080caa80 con 0x7fb8081401b0 2024-08-17T02:28:46.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.082+0000 7fb810200640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8080cb450 con 0x7fb8080b1440 2024-08-17T02:28:46.083 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.082+0000 7fb810200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080c9e70 con 0x7fb808140580 2024-08-17T02:28:46.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.082+0000 7fb80ce00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8080b1440 0x7fb8080caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.082+0000 7fb80ce00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb8080b1440 0x7fb8080caf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44580/0 (socket says 172.21.15.45:44580) 2024-08-17T02:28:46.084 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.082+0000 7fb80ce00640 1 -- 172.21.15.45:0/284477861 learned_addr learned my addr 172.21.15.45:0/284477861 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.083+0000 7fb80e200640 1 --2- 172.21.15.45:0/284477861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb808140580 0x7fb8080c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.083+0000 7fb80ce00640 1 -- 172.21.15.45:0/284477861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb808140580 msgr2=0x7fb8080c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.083+0000 7fb80ce00640 1 --2- 172.21.15.45:0/284477861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb808140580 0x7fb8080c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.083+0000 7fb80ce00640 1 -- 172.21.15.45:0/284477861 >> v1:172.21.15.169:6789/0 conn(0x7fb8081401b0 legacy=0x7fb8080b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.083+0000 7fb80ce00640 1 -- 172.21.15.45:0/284477861 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8080ca150 con 0x7fb8080b1440 2024-08-17T02:28:46.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.084+0000 7fb80ce00640 1 --2- 172.21.15.45:0/284477861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8080b1440 0x7fb8080caf10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009910 tx=0x7fb7f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e8a3ff592e9e92 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.084+0000 7fb807e00640 1 -- 172.21.15.45:0/284477861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f402ae40 con 0x7fb8080b1440 2024-08-17T02:28:46.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.084+0000 7fb807e00640 1 -- 172.21.15.45:0/284477861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f4032440 con 0x7fb8080b1440 2024-08-17T02:28:46.086 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.084+0000 7fb807e00640 1 -- 172.21.15.45:0/284477861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4032820 con 0x7fb8080b1440 2024-08-17T02:28:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.085+0000 7fb810200640 1 -- 172.21.15.45:0/284477861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8080b1440 msgr2=0x7fb8080caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.085+0000 7fb810200640 1 --2- 172.21.15.45:0/284477861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8080b1440 0x7fb8080caf10 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4009910 tx=0x7fb7f40091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.085+0000 7fb810200640 1 -- 172.21.15.45:0/284477861 shutdown_connections 2024-08-17T02:28:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.085+0000 7fb810200640 1 --2- 172.21.15.45:0/284477861 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb808140580 0x7fb8080c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.085+0000 7fb810200640 1 --2- 172.21.15.45:0/284477861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8080b1440 0x7fb8080caf10 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.085+0000 7fb810200640 1 -- 172.21.15.45:0/284477861 >> 172.21.15.45:0/284477861 conn(0x7fb8080cb9b0 msgr2=0x7fb8080cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.085+0000 7fb810200640 1 -- 172.21.15.45:0/284477861 shutdown_connections 2024-08-17T02:28:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.085+0000 7fb810200640 1 -- 172.21.15.45:0/284477861 wait complete. 2024-08-17T02:28:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.086+0000 7fb810200640 1 Processor -- start 2024-08-17T02:28:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.087+0000 7fb810200640 1 -- start start 2024-08-17T02:28:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.087+0000 7fb810200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8080b1440 0x7fb80815ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.089 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.087+0000 7fb810200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8081401b0 0x7fb8080c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.087+0000 7fb810200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb808140580 0x7fb8080c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb810200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080c6210 con 0x7fb8081401b0 2024-08-17T02:28:46.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb810200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080c5600 con 0x7fb808140580 2024-08-17T02:28:46.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb810200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8080c58e0 con 0x7fb8080b1440 2024-08-17T02:28:46.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb80ce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8081401b0 0x7fb8080c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb80ce00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8081401b0 0x7fb8080c4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44584/0 (socket says 172.21.15.45:44584) 2024-08-17T02:28:46.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb80ce00640 1 -- 172.21.15.45:0/563082359 learned_addr learned my addr 172.21.15.45:0/563082359 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:46.090 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb80d800640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8080b1440 0x7fb80815ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb80e200640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb808140580 0x7fb8080c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb80ce00640 1 -- 172.21.15.45:0/563082359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8080b1440 msgr2=0x7fb80815ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb80ce00640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8080b1440 0x7fb80815ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb80ce00640 1 -- 172.21.15.45:0/563082359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb808140580 msgr2=0x7fb8080c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb80ce00640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb808140580 0x7fb8080c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.088+0000 7fb80ce00640 1 -- 172.21.15.45:0/563082359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f4009450 con 0x7fb8081401b0 2024-08-17T02:28:46.091 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.089+0000 7fb80ce00640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8081401b0 0x7fb8080c4db0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4035040 tx=0x7fb7f4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.092 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.089+0000 7fb804c00640 1 -- 172.21.15.45:0/563082359 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4031bb0 con 0x7fb8081401b0 2024-08-17T02:28:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.089+0000 7fb804c00640 1 -- 172.21.15.45:0/563082359 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f4031d30 con 0x7fb8081401b0 2024-08-17T02:28:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.089+0000 7fb810200640 1 -- 172.21.15.45:0/563082359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8080c5bc0 con 0x7fb8081401b0 2024-08-17T02:28:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.089+0000 7fb804c00640 1 -- 172.21.15.45:0/563082359 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f4031ea0 con 0x7fb8081401b0 2024-08-17T02:28:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.089+0000 7fb810200640 1 -- 172.21.15.45:0/563082359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80815b190 con 0x7fb8081401b0 2024-08-17T02:28:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.090+0000 7fb810200640 1 -- 172.21.15.45:0/563082359 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb808064db0 con 0x7fb8081401b0 2024-08-17T02:28:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.091+0000 7fb804c00640 1 -- 172.21.15.45:0/563082359 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fb7f4039040 con 0x7fb8081401b0 2024-08-17T02:28:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.092+0000 7fb804c00640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb7e8065150 0x7fb7e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.092+0000 7fb804c00640 1 -- 172.21.15.45:0/563082359 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fb7f402ae40 con 0x7fb8081401b0 2024-08-17T02:28:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.092+0000 7fb80d800640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb7e8065150 0x7fb7e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.094 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.093+0000 7fb80d800640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb7e8065150 0x7fb7e8067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0037c0 tx=0x7fb7fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.097 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.097+0000 7fb804c00640 1 -- 172.21.15.45:0/563082359 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fb7f40707c0 con 0x7fb8081401b0 2024-08-17T02:28:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.279+0000 7fb810200640 1 -- 172.21.15.45:0/563082359 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fb8080c6040 con 0x7fb7e8065150 2024-08-17T02:28:46.281 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.280+0000 7fb804c00640 1 -- 172.21.15.45:0/563082359 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb7fc003410 con 0x7fb7e8065150 2024-08-17T02:28:46.281 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 5 to deep-scrub 2024-08-17T02:28:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 -- 172.21.15.45:0/563082359 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb7e8065150 msgr2=0x7fb7e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb7e8065150 0x7fb7e8067600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc0037c0 tx=0x7fb7fc009040 comp rx=0 tx=0).stop 2024-08-17T02:28:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 -- 172.21.15.45:0/563082359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8081401b0 msgr2=0x7fb8080c4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8081401b0 0x7fb8080c4db0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4035040 tx=0x7fb7f4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 -- 172.21.15.45:0/563082359 shutdown_connections 2024-08-17T02:28:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fb808140580 0x7fb8080c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb8081401b0 0x7fb8080c4db0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fb7e8065150 0x7fb7e8067600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 --2- 172.21.15.45:0/563082359 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fb8080b1440 0x7fb80815ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 -- 172.21.15.45:0/563082359 >> 172.21.15.45:0/563082359 conn(0x7fb8080cb9b0 msgr2=0x7fb80813e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 -- 172.21.15.45:0/563082359 shutdown_connections 2024-08-17T02:28:46.284 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.282+0000 7fb810200640 1 -- 172.21.15.45:0/563082359 wait complete. 2024-08-17T02:28:46.298 INFO:tasks.ceph:Scrubbing osd.6 2024-08-17T02:28:46.298 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:46.455 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.455+0000 7ff409c00640 1 Processor -- start 2024-08-17T02:28:46.456 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.455+0000 7ff409c00640 1 -- start start 2024-08-17T02:28:46.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.456+0000 7ff409c00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff404156890 0x7ff40406dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.456+0000 7ff409c00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4040ae9b0 con 0x7ff404156c60 2024-08-17T02:28:46.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.456+0000 7ff409c00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4040ab320 con 0x7ff4040c8840 2024-08-17T02:28:46.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.456+0000 7ff409c00640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4040aa730 con 0x7ff404156890 2024-08-17T02:28:46.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.456+0000 7ff402a00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff404156890 0x7ff40406dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.456+0000 7ff402000640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff404156c60 0x7ff4040c8130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52122/0 (socket says 172.21.15.45:52122) 2024-08-17T02:28:46.457 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.456+0000 7ff402000640 1 -- 172.21.15.45:0/1504955640 learned_addr learned my addr 172.21.15.45:0/1504955640 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:46.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.457+0000 7ff402a00640 1 -- 172.21.15.45:0/1504955640 >> v1:172.21.15.169:6789/0 conn(0x7ff4040c8840 legacy=0x7ff4040ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.457+0000 7ff402a00640 1 -- 172.21.15.45:0/1504955640 >> v1:172.21.15.45:6789/0 conn(0x7ff404156c60 legacy=0x7ff4040c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.458 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.457+0000 7ff402a00640 1 -- 172.21.15.45:0/1504955640 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4040aa9f0 con 0x7ff404156890 2024-08-17T02:28:46.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.457+0000 7ff401600640 1 -- 172.21.15.45:0/1504955640 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3717089257 0 0) 0x7ff4040ae9b0 con 0x7ff404156c60 2024-08-17T02:28:46.459 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.458+0000 7ff402a00640 1 --2- 172.21.15.45:0/1504955640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff404156890 0x7ff40406dee0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009850 tx=0x7ff3f40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccc2d9d0e609d79 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.458+0000 7ff401600640 1 -- 172.21.15.45:0/1504955640 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f402ad90 con 0x7ff404156890 2024-08-17T02:28:46.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.458+0000 7ff401600640 1 -- 172.21.15.45:0/1504955640 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4032440 con 0x7ff404156890 2024-08-17T02:28:46.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.458+0000 7ff401600640 1 -- 172.21.15.45:0/1504955640 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40327e0 con 0x7ff404156890 2024-08-17T02:28:46.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.459+0000 7ff409c00640 1 -- 172.21.15.45:0/1504955640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff404156890 msgr2=0x7ff40406dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.459+0000 7ff409c00640 1 --2- 172.21.15.45:0/1504955640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff404156890 0x7ff40406dee0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009850 tx=0x7ff3f40090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.459+0000 7ff409c00640 1 -- 172.21.15.45:0/1504955640 shutdown_connections 2024-08-17T02:28:46.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.459+0000 7ff409c00640 1 --2- 172.21.15.45:0/1504955640 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff404156890 0x7ff40406dee0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.460 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.459+0000 7ff409c00640 1 -- 172.21.15.45:0/1504955640 >> 172.21.15.45:0/1504955640 conn(0x7ff404067750 msgr2=0x7ff40406c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.459+0000 7ff409c00640 1 -- 172.21.15.45:0/1504955640 shutdown_connections 2024-08-17T02:28:46.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.459+0000 7ff409c00640 1 -- 172.21.15.45:0/1504955640 wait complete. 2024-08-17T02:28:46.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.460+0000 7ff409c00640 1 Processor -- start 2024-08-17T02:28:46.461 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.460+0000 7ff409c00640 1 -- start start 2024-08-17T02:28:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.461+0000 7ff409c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4040c8840 0x7ff404169e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.461+0000 7ff409c00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff404156890 0x7ff404148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.461+0000 7ff409c00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff404156c60 0x7ff404150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.461+0000 7ff409c00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40416a3c0 con 0x7ff4040c8840 2024-08-17T02:28:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.461+0000 7ff409c00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff404148fe0 con 0x7ff404156c60 2024-08-17T02:28:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.461+0000 7ff409c00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40414b280 con 0x7ff404156890 2024-08-17T02:28:46.463 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.461+0000 7ff402a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4040c8840 0x7ff404169e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.462+0000 7ff402a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4040c8840 0x7ff404169e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44598/0 (socket says 172.21.15.45:44598) 2024-08-17T02:28:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.462+0000 7ff402a00640 1 -- 172.21.15.45:0/3688948503 learned_addr learned my addr 172.21.15.45:0/3688948503 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.462+0000 7ff402000640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff404156890 0x7ff404148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.462+0000 7ff403400640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff404156c60 0x7ff404150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.462+0000 7ff402a00640 1 -- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff404156890 msgr2=0x7ff404148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.462+0000 7ff402a00640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff404156890 0x7ff404148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.462+0000 7ff402a00640 1 -- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff404156c60 msgr2=0x7ff404150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.464 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.462+0000 7ff402a00640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7ff404156c60 0x7ff404150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.462+0000 7ff402a00640 1 -- 172.21.15.45:0/3688948503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f4009390 con 0x7ff4040c8840 2024-08-17T02:28:46.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.462+0000 7ff402000640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7ff404156890 0x7ff404148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:46.465 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.462+0000 7ff402a00640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4040c8840 0x7ff404169e80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009850 tx=0x7ff3f4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.463+0000 7ff3fa000640 1 -- 172.21.15.45:0/3688948503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4031b30 con 0x7ff4040c8840 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.463+0000 7ff3fa000640 1 -- 172.21.15.45:0/3688948503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f4031c90 con 0x7ff4040c8840 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.463+0000 7ff3fa000640 1 -- 172.21.15.45:0/3688948503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f403c660 con 0x7ff4040c8840 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.463+0000 7ff409c00640 1 -- 172.21.15.45:0/3688948503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40414b560 con 0x7ff4040c8840 2024-08-17T02:28:46.466 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.463+0000 7ff409c00640 1 -- 172.21.15.45:0/3688948503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40414bb20 con 0x7ff4040c8840 2024-08-17T02:28:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.464+0000 7ff409c00640 1 -- 172.21.15.45:0/3688948503 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff404149230 con 0x7ff4040c8840 2024-08-17T02:28:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.465+0000 7ff3fa000640 1 -- 172.21.15.45:0/3688948503 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7ff3f4039050 con 0x7ff4040c8840 2024-08-17T02:28:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.465+0000 7ff3fa000640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff3e4065150 0x7ff3e4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.467 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.465+0000 7ff3fa000640 1 -- 172.21.15.45:0/3688948503 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7ff3f40a2720 con 0x7ff4040c8840 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.466+0000 7ff3fa000640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] conn(0x7ff3e406b040 0x7ff3e406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.466+0000 7ff3fa000640 1 -- 172.21.15.45:0/3688948503 --> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff3e406db00 con 0x7ff3e406b040 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.466+0000 7ff402000640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff3e4065150 0x7ff3e4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.466+0000 7ff3fa000640 1 -- 172.21.15.45:0/3688948503 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3f40a4c20 con 0x7ff4040c8840 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.466+0000 7ff403400640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] conn(0x7ff3e406b040 0x7ff3e406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.466+0000 7ff402000640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff3e4065150 0x7ff3e4067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0007fd0 tx=0x7ff3f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.468 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.467+0000 7ff403400640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] conn(0x7ff3e406b040 0x7ff3e406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.469 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.468+0000 7ff3fa000640 1 -- 172.21.15.45:0/3688948503 <== osd.6 v2:172.21.15.169:6800/37298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7ff3e406db00 con 0x7ff3e406b040 2024-08-17T02:28:46.481 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.481+0000 7ff409c00640 1 -- 172.21.15.45:0/3688948503 --> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff4040710c0 con 0x7ff3e406b040 2024-08-17T02:28:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.481+0000 7ff3fa000640 1 -- 172.21.15.45:0/3688948503 <== osd.6 v2:172.21.15.169:6800/37298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff4040710c0 con 0x7ff3e406b040 2024-08-17T02:28:46.482 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-08-17T02:28:46.483 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:46.483 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.482+0000 7ff409c00640 1 -- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] conn(0x7ff3e406b040 msgr2=0x7ff3e406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.482+0000 7ff409c00640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.169:6800/37298,v1:172.21.15.169:6801/37298] conn(0x7ff3e406b040 0x7ff3e406d450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.482+0000 7ff409c00640 1 -- 172.21.15.45:0/3688948503 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff3e4065150 msgr2=0x7ff3e4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.482+0000 7ff409c00640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7ff3e4065150 0x7ff3e4067600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0007fd0 tx=0x7ff3f0009040 comp rx=0 tx=0).stop 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.482+0000 7ff409c00640 1 -- 172.21.15.45:0/3688948503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4040c8840 msgr2=0x7ff404169e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.482+0000 7ff409c00640 1 --2- 172.21.15.45:0/3688948503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4040c8840 0x7ff404169e80 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4009850 tx=0x7ff3f4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.482+0000 7ff403400640 1 -- 172.21.15.45:0/3688948503 reap_dead start 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.482+0000 7ff409c00640 1 -- 172.21.15.45:0/3688948503 shutdown_connections 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.482+0000 7ff409c00640 1 -- 172.21.15.45:0/3688948503 >> 172.21.15.45:0/3688948503 conn(0x7ff404067750 msgr2=0x7ff4040c8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.482+0000 7ff409c00640 1 -- 172.21.15.45:0/3688948503 shutdown_connections 2024-08-17T02:28:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.482+0000 7ff409c00640 1 -- 172.21.15.45:0/3688948503 wait complete. 2024-08-17T02:28:46.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-08-17T02:28:46.649 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.649+0000 7f224c600640 1 Processor -- start 2024-08-17T02:28:46.650 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.649+0000 7f224c600640 1 -- start start 2024-08-17T02:28:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.650+0000 7f224c600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f224406ddf0 0x7f2244158fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.650+0000 7f224c600640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22440a9a10 con 0x7f224406da20 2024-08-17T02:28:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.650+0000 7f224c600640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22440a9cf0 con 0x7f22440aa7d0 2024-08-17T02:28:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.650+0000 7f224c600640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22440ac400 con 0x7f224406ddf0 2024-08-17T02:28:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.650+0000 7f224a600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f224406ddf0 0x7f2244158fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.650+0000 7f224a600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f224406ddf0 0x7f2244158fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44614/0 (socket says 172.21.15.45:44614) 2024-08-17T02:28:46.651 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.650+0000 7f2249c00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f224406da20 0x7f2244158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52130/0 (socket says 172.21.15.45:52130) 2024-08-17T02:28:46.652 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.650+0000 7f224a600640 1 -- 172.21.15.45:0/3716264034 learned_addr learned my addr 172.21.15.45:0/3716264034 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.651+0000 7f224a600640 1 -- 172.21.15.45:0/3716264034 >> v1:172.21.15.169:6789/0 conn(0x7f22440aa7d0 legacy=0x7f22440ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.651+0000 7f224a600640 1 -- 172.21.15.45:0/3716264034 >> v1:172.21.15.45:6789/0 conn(0x7f224406da20 legacy=0x7f2244158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.651+0000 7f224a600640 1 -- 172.21.15.45:0/3716264034 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22440a9fd0 con 0x7f224406ddf0 2024-08-17T02:28:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.651+0000 7f2243e00640 1 -- 172.21.15.45:0/3716264034 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2426166731 0 0) 0x7f22440a9a10 con 0x7f224406da20 2024-08-17T02:28:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.652+0000 7f224a600640 1 --2- 172.21.15.45:0/3716264034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224406ddf0 0x7f2244158fa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f223c009f20 tx=0x7f223c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281fc719dc124653 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.652+0000 7f2243e00640 1 -- 172.21.15.45:0/3716264034 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c031400 con 0x7f224406ddf0 2024-08-17T02:28:46.653 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.652+0000 7f2243e00640 1 -- 172.21.15.45:0/3716264034 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c02d050 con 0x7f224406ddf0 2024-08-17T02:28:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.652+0000 7f2243e00640 1 -- 172.21.15.45:0/3716264034 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c031790 con 0x7f224406ddf0 2024-08-17T02:28:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.652+0000 7f224c600640 1 -- 172.21.15.45:0/3716264034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224406ddf0 msgr2=0x7f2244158fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.654 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.652+0000 7f224c600640 1 --2- 172.21.15.45:0/3716264034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224406ddf0 0x7f2244158fa0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f223c009f20 tx=0x7f223c009840 comp rx=0 tx=0).stop 2024-08-17T02:28:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.653+0000 7f224c600640 1 -- 172.21.15.45:0/3716264034 shutdown_connections 2024-08-17T02:28:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.653+0000 7f224c600640 1 --2- 172.21.15.45:0/3716264034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224406ddf0 0x7f2244158fa0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.653+0000 7f224c600640 1 -- 172.21.15.45:0/3716264034 >> 172.21.15.45:0/3716264034 conn(0x7f22440cb9b0 msgr2=0x7f22440cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.653+0000 7f224c600640 1 -- 172.21.15.45:0/3716264034 shutdown_connections 2024-08-17T02:28:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.653+0000 7f224c600640 1 -- 172.21.15.45:0/3716264034 wait complete. 2024-08-17T02:28:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.654+0000 7f224c600640 1 Processor -- start 2024-08-17T02:28:46.655 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.654+0000 7f224c600640 1 -- start start 2024-08-17T02:28:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.655+0000 7f224c600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f224406da20 0x7f2244158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.655+0000 7f224c600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f224406ddf0 0x7f224415a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.655+0000 7f224c600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440aa7d0 0x7f224415ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.655+0000 7f224c600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224415c060 con 0x7f22440aa7d0 2024-08-17T02:28:46.657 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.655+0000 7f224c600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224415b450 con 0x7f224406ddf0 2024-08-17T02:28:46.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.655+0000 7f224c600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224415b730 con 0x7f224406da20 2024-08-17T02:28:46.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.655+0000 7f224a600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440aa7d0 0x7f224415ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.655+0000 7f224a600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440aa7d0 0x7f224415ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44630/0 (socket says 172.21.15.45:44630) 2024-08-17T02:28:46.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.655+0000 7f224a600640 1 -- 172.21.15.45:0/3233182552 learned_addr learned my addr 172.21.15.45:0/3233182552 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:46.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f2249c00640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f224406da20 0x7f2244158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f2249200640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f224406ddf0 0x7f224415a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f224a600640 1 -- 172.21.15.45:0/3233182552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f224406da20 msgr2=0x7f2244158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.658 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f224a600640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f224406da20 0x7f2244158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f224a600640 1 -- 172.21.15.45:0/3233182552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f224406ddf0 msgr2=0x7f224415a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f224a600640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f224406ddf0 0x7f224415a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f224a600640 1 -- 172.21.15.45:0/3233182552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c009ae0 con 0x7f22440aa7d0 2024-08-17T02:28:46.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f2249c00640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f224406da20 0x7f2244158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:46.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f2249200640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f224406ddf0 0x7f224415a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:46.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f224a600640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440aa7d0 0x7f224415ac20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f223c009f20 tx=0x7f223c036000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f2240c00640 1 -- 172.21.15.45:0/3233182552 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c031e60 con 0x7f22440aa7d0 2024-08-17T02:28:46.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f2240c00640 1 -- 172.21.15.45:0/3233182552 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c007ac0 con 0x7f22440aa7d0 2024-08-17T02:28:46.659 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f2240c00640 1 -- 172.21.15.45:0/3233182552 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c007e80 con 0x7f22440aa7d0 2024-08-17T02:28:46.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.656+0000 7f224c600640 1 -- 172.21.15.45:0/3233182552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224415ba10 con 0x7f22440aa7d0 2024-08-17T02:28:46.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.657+0000 7f224c600640 1 -- 172.21.15.45:0/3233182552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224415b160 con 0x7f22440aa7d0 2024-08-17T02:28:46.660 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.657+0000 7f224c600640 1 -- 172.21.15.45:0/3233182552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2244064db0 con 0x7f22440aa7d0 2024-08-17T02:28:46.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.658+0000 7f2240c00640 1 -- 172.21.15.45:0/3233182552 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f223c03c630 con 0x7f22440aa7d0 2024-08-17T02:28:46.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.659+0000 7f2240c00640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2224065150 0x7f2224067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:46.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.659+0000 7f2240c00640 1 -- 172.21.15.45:0/3233182552 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f223c0a3220 con 0x7f22440aa7d0 2024-08-17T02:28:46.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.659+0000 7f2249c00640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2224065150 0x7f2224067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:46.661 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.660+0000 7f2249c00640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2224065150 0x7f2224067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f22380011e0 tx=0x7f2238007c00 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:46.663 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.663+0000 7f2240c00640 1 -- 172.21.15.45:0/3233182552 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f223c0714e0 con 0x7f22440aa7d0 2024-08-17T02:28:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.844+0000 7f224c600640 1 -- 172.21.15.45:0/3233182552 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f2244158310 con 0x7f2224065150 2024-08-17T02:28:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.844+0000 7f2240c00640 1 -- 172.21.15.45:0/3233182552 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2244158310 con 0x7f2224065150 2024-08-17T02:28:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 6 to deep-scrub 2024-08-17T02:28:46.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.846+0000 7f224c600640 1 -- 172.21.15.45:0/3233182552 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2224065150 msgr2=0x7f2224067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.847 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.846+0000 7f224c600640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2224065150 0x7f2224067600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f22380011e0 tx=0x7f2238007c00 comp rx=0 tx=0).stop 2024-08-17T02:28:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.846+0000 7f224c600640 1 -- 172.21.15.45:0/3233182552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440aa7d0 msgr2=0x7f224415ac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.846+0000 7f224c600640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440aa7d0 0x7f224415ac20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f223c009f20 tx=0x7f223c036000 comp rx=0 tx=0).stop 2024-08-17T02:28:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.847+0000 7f224c600640 1 -- 172.21.15.45:0/3233182552 shutdown_connections 2024-08-17T02:28:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.847+0000 7f224c600640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22440aa7d0 0x7f224415ac20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.847+0000 7f224c600640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f224406ddf0 0x7f224415a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.847+0000 7f224c600640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f2224065150 0x7f2224067600 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.847+0000 7f224c600640 1 --2- 172.21.15.45:0/3233182552 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f224406da20 0x7f2244158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.847+0000 7f224c600640 1 -- 172.21.15.45:0/3233182552 >> 172.21.15.45:0/3233182552 conn(0x7f22440cb9b0 msgr2=0x7f224406c750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.847+0000 7f224c600640 1 -- 172.21.15.45:0/3233182552 shutdown_connections 2024-08-17T02:28:46.849 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:46.847+0000 7f224c600640 1 -- 172.21.15.45:0/3233182552 wait complete. 2024-08-17T02:28:46.862 INFO:tasks.ceph:Scrubbing osd.7 2024-08-17T02:28:46.862 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-08-17T02:28:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.016+0000 7f9b1ee00640 1 Processor -- start 2024-08-17T02:28:47.017 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.016+0000 7f9b1ee00640 1 -- start start 2024-08-17T02:28:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.017+0000 7f9b1ee00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b18156890 0x7f9b1806dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.017+0000 7f9b1ee00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b180ae9b0 con 0x7f9b180c8840 2024-08-17T02:28:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.017+0000 7f9b1ee00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b180ab320 con 0x7f9b18156c60 2024-08-17T02:28:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.017+0000 7f9b1ee00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180aa730 con 0x7f9b18156890 2024-08-17T02:28:47.018 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.017+0000 7f9b1ce00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9b180c8840 0x7f9b180ca3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52142/0 (socket says 172.21.15.45:52142) 2024-08-17T02:28:47.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.017+0000 7f9b1ce00640 1 -- 172.21.15.45:0/883791236 learned_addr learned my addr 172.21.15.45:0/883791236 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:28:47.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.018+0000 7f9b17e00640 1 --2- 172.21.15.45:0/883791236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b18156890 0x7f9b1806dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.019 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.018+0000 7f9b17400640 1 -- 172.21.15.45:0/883791236 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899464548 0 0) 0x7f9b180ae9b0 con 0x7f9b180c8840 2024-08-17T02:28:47.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.018+0000 7f9b17400640 1 -- 172.21.15.45:0/883791236 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9afc0034e0 con 0x7f9b180c8840 2024-08-17T02:28:47.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.018+0000 7f9b17e00640 1 -- 172.21.15.45:0/883791236 >> v1:172.21.15.169:6789/0 conn(0x7f9b18156c60 legacy=0x7f9b180c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.018+0000 7f9b17e00640 1 -- 172.21.15.45:0/883791236 >> v1:172.21.15.45:6789/0 conn(0x7f9b180c8840 legacy=0x7f9b180ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.018+0000 7f9b17400640 1 -- 172.21.15.45:0/883791236 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1952596633 0 0) 0x7f9b180ab320 con 0x7f9b18156c60 2024-08-17T02:28:47.020 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.018+0000 7f9b17e00640 1 -- 172.21.15.45:0/883791236 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b180aa9f0 con 0x7f9b18156890 2024-08-17T02:28:47.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.019+0000 7f9b17e00640 1 --2- 172.21.15.45:0/883791236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b18156890 0x7f9b1806dee0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009880 tx=0x7f9b080090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bd44f156fd8a3fa server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.021 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.019+0000 7f9b17400640 1 -- 172.21.15.45:0/883791236 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0802ad70 con 0x7f9b18156890 2024-08-17T02:28:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.020+0000 7f9b17400640 1 -- 172.21.15.45:0/883791236 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b08032440 con 0x7f9b18156890 2024-08-17T02:28:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.020+0000 7f9b17400640 1 -- 172.21.15.45:0/883791236 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b080327c0 con 0x7f9b18156890 2024-08-17T02:28:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.020+0000 7f9b1ee00640 1 -- 172.21.15.45:0/883791236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b18156890 msgr2=0x7f9b1806dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.020+0000 7f9b1ee00640 1 --2- 172.21.15.45:0/883791236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b18156890 0x7f9b1806dee0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009880 tx=0x7f9b080090f0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.020+0000 7f9b1ee00640 1 -- 172.21.15.45:0/883791236 shutdown_connections 2024-08-17T02:28:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.020+0000 7f9b1ee00640 1 --2- 172.21.15.45:0/883791236 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b18156890 0x7f9b1806dee0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.020+0000 7f9b1ee00640 1 -- 172.21.15.45:0/883791236 >> 172.21.15.45:0/883791236 conn(0x7f9b18067750 msgr2=0x7f9b1806c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:47.022 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.020+0000 7f9b1ee00640 1 -- 172.21.15.45:0/883791236 shutdown_connections 2024-08-17T02:28:47.023 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.020+0000 7f9b1ee00640 1 -- 172.21.15.45:0/883791236 wait complete. 2024-08-17T02:28:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.022+0000 7f9b1ee00640 1 Processor -- start 2024-08-17T02:28:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.022+0000 7f9b1ee00640 1 -- start start 2024-08-17T02:28:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b1ee00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b180c8840 0x7f9b1814b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b1ee00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b18156890 0x7f9b1814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b1ee00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b18156c60 0x7f9b1806da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b1ee00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180ac070 con 0x7f9b180c8840 2024-08-17T02:28:47.025 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b1ee00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180ab740 con 0x7f9b18156c60 2024-08-17T02:28:47.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b1ee00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180aba20 con 0x7f9b18156890 2024-08-17T02:28:47.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b17e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b180c8840 0x7f9b1814b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b17e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b180c8840 0x7f9b1814b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44634/0 (socket says 172.21.15.45:44634) 2024-08-17T02:28:47.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b17e00640 1 -- 172.21.15.45:0/2740453832 learned_addr learned my addr 172.21.15.45:0/2740453832 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:47.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b0f400640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b18156890 0x7f9b1814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b1ce00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b18156c60 0x7f9b1806da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.026 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b17e00640 1 -- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b18156890 msgr2=0x7f9b1814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b17e00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f9b18156890 0x7f9b1814de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b17e00640 1 -- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b18156c60 msgr2=0x7f9b1806da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b17e00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b18156c60 0x7f9b1806da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b17e00640 1 -- 172.21.15.45:0/2740453832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08009390 con 0x7f9b180c8840 2024-08-17T02:28:47.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.023+0000 7f9b1ce00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f9b18156c60 0x7f9b1806da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-17T02:28:47.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.024+0000 7f9b17e00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b180c8840 0x7f9b1814b720 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9b080097d0 tx=0x7f9b08032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.027 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.024+0000 7f9b0fe00640 1 -- 172.21.15.45:0/2740453832 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08031a60 con 0x7f9b180c8840 2024-08-17T02:28:47.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.024+0000 7f9b0fe00640 1 -- 172.21.15.45:0/2740453832 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b08031bc0 con 0x7f9b180c8840 2024-08-17T02:28:47.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.024+0000 7f9b1ee00640 1 -- 172.21.15.45:0/2740453832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b180abd00 con 0x7f9b180c8840 2024-08-17T02:28:47.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.024+0000 7f9b0fe00640 1 -- 172.21.15.45:0/2740453832 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0803e450 con 0x7f9b180c8840 2024-08-17T02:28:47.028 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.024+0000 7f9b1ee00640 1 -- 172.21.15.45:0/2740453832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1814e900 con 0x7f9b180c8840 2024-08-17T02:28:47.029 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.025+0000 7f9b1ee00640 1 -- 172.21.15.45:0/2740453832 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b180710c0 con 0x7f9b180c8840 2024-08-17T02:28:47.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.026+0000 7f9b0fe00640 1 -- 172.21.15.45:0/2740453832 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f9b0803c400 con 0x7f9b180c8840 2024-08-17T02:28:47.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.027+0000 7f9b0fe00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9af4065150 0x7f9af4067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.027+0000 7f9b0fe00640 1 -- 172.21.15.45:0/2740453832 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9b080a2290 con 0x7f9b180c8840 2024-08-17T02:28:47.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.027+0000 7f9b0f400640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9af4065150 0x7f9af4067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.027+0000 7f9b0fe00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] conn(0x7f9af406b040 0x7f9af406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.027+0000 7f9b0fe00640 1 -- 172.21.15.45:0/2740453832 --> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9af406db00 con 0x7f9af406b040 2024-08-17T02:28:47.030 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.027+0000 7f9b0fe00640 1 -- 172.21.15.45:0/2740453832 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b080a48d0 con 0x7f9b180c8840 2024-08-17T02:28:47.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.028+0000 7f9b1ce00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] conn(0x7f9af406b040 0x7f9af406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.028+0000 7f9b0f400640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9af4065150 0x7f9af4067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b1816a2b0 tx=0x7f9b00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.028+0000 7f9b1ce00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] conn(0x7f9af406b040 0x7f9af406d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.031 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.029+0000 7f9b0fe00640 1 -- 172.21.15.45:0/2740453832 <== osd.7 v2:172.21.15.169:6816/37299 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f9af406db00 con 0x7f9af406b040 2024-08-17T02:28:47.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.042+0000 7f9b1ee00640 1 -- 172.21.15.45:0/2740453832 --> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9b18070740 con 0x7f9af406b040 2024-08-17T02:28:47.043 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.043+0000 7f9b0fe00640 1 -- 172.21.15.45:0/2740453832 <== osd.7 v2:172.21.15.169:6816/37299 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9b18070740 con 0x7f9af406b040 2024-08-17T02:28:47.044 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2024-08-17T02:28:47.044 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-08-17T02:28:47.044 INFO:teuthology.orchestra.run.smithi045.stdout:} 2024-08-17T02:28:47.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.043+0000 7f9b1ee00640 1 -- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] conn(0x7f9af406b040 msgr2=0x7f9af406d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.043+0000 7f9b1ee00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.169:6816/37299,v1:172.21.15.169:6817/37299] conn(0x7f9af406b040 0x7f9af406d450 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.045 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.043+0000 7f9b1ee00640 1 -- 172.21.15.45:0/2740453832 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9af4065150 msgr2=0x7f9af4067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.043+0000 7f9b1ee00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f9af4065150 0x7f9af4067600 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9b1816a2b0 tx=0x7f9b00009040 comp rx=0 tx=0).stop 2024-08-17T02:28:47.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.043+0000 7f9b1ee00640 1 -- 172.21.15.45:0/2740453832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b180c8840 msgr2=0x7f9b1814b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.043+0000 7f9b1ee00640 1 --2- 172.21.15.45:0/2740453832 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b180c8840 0x7f9b1814b720 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f9b080097d0 tx=0x7f9b08032000 comp rx=0 tx=0).stop 2024-08-17T02:28:47.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.043+0000 7f9b1ce00640 1 -- 172.21.15.45:0/2740453832 reap_dead start 2024-08-17T02:28:47.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.043+0000 7f9b1ee00640 1 -- 172.21.15.45:0/2740453832 shutdown_connections 2024-08-17T02:28:47.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.043+0000 7f9b1ee00640 1 -- 172.21.15.45:0/2740453832 >> 172.21.15.45:0/2740453832 conn(0x7f9b18067750 msgr2=0x7f9b18152310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:47.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.043+0000 7f9b1ee00640 1 -- 172.21.15.45:0/2740453832 shutdown_connections 2024-08-17T02:28:47.046 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.044+0000 7f9b1ee00640 1 -- 172.21.15.45:0/2740453832 wait complete. 2024-08-17T02:28:47.058 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-08-17T02:28:47.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.209+0000 7f4d5a800640 1 Processor -- start 2024-08-17T02:28:47.210 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.209+0000 7f4d5a800640 1 -- start start 2024-08-17T02:28:47.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.210+0000 7f4d5a800640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4d5406df00 0x7f4d540adf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.210+0000 7f4d5a800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d54155df0 0x7f4d540ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.210+0000 7f4d5a800640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d54156670 con 0x7f4d54155a20 2024-08-17T02:28:47.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.211+0000 7f4d5a800640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d540b0350 con 0x7f4d5406df00 2024-08-17T02:28:47.212 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.211+0000 7f4d5a800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5406e5e0 con 0x7f4d54155df0 2024-08-17T02:28:47.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.211+0000 7f4d4aa00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4d5406df00 0x7f4d540adf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.211+0000 7f4d4aa00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4d5406df00 0x7f4d540adf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44648/0 (socket says 172.21.15.45:44648) 2024-08-17T02:28:47.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.211+0000 7f4d4aa00640 1 -- 172.21.15.45:0/2431179189 learned_addr learned my addr 172.21.15.45:0/2431179189 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:47.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.211+0000 7f4d53e00640 1 --2- 172.21.15.45:0/2431179189 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d54155df0 0x7f4d540ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.211+0000 7f4d4aa00640 1 -- 172.21.15.45:0/2431179189 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d54155df0 msgr2=0x7f4d540ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:47.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.211+0000 7f4d4aa00640 1 --2- 172.21.15.45:0/2431179189 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d54155df0 0x7f4d540ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.213 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.211+0000 7f4d4aa00640 1 -- 172.21.15.45:0/2431179189 >> v1:172.21.15.169:6789/0 conn(0x7f4d54155a20 legacy=0x7f4d5406d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.211+0000 7f4d4aa00640 1 -- 172.21.15.45:0/2431179189 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5406e8c0 con 0x7f4d5406df00 2024-08-17T02:28:47.214 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.211+0000 7f4d52a00640 1 -- 172.21.15.45:0/2431179189 <== mon.1 v1:172.21.15.169:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435430176 0 0) 0x7f4d54156670 con 0x7f4d54155a20 2024-08-17T02:28:47.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.212+0000 7f4d4aa00640 1 --2- 172.21.15.45:0/2431179189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5406df00 0x7f4d540adf10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009910 tx=0x7f4d3c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a853d29d0d03f23c server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.213+0000 7f4d52a00640 1 -- 172.21.15.45:0/2431179189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c02ae40 con 0x7f4d5406df00 2024-08-17T02:28:47.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.213+0000 7f4d52a00640 1 -- 172.21.15.45:0/2431179189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d3c032440 con 0x7f4d5406df00 2024-08-17T02:28:47.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.213+0000 7f4d52a00640 1 -- 172.21.15.45:0/2431179189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0327e0 con 0x7f4d5406df00 2024-08-17T02:28:47.215 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.213+0000 7f4d5a800640 1 -- 172.21.15.45:0/2431179189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5406df00 msgr2=0x7f4d540adf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.213+0000 7f4d5a800640 1 --2- 172.21.15.45:0/2431179189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5406df00 0x7f4d540adf10 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009910 tx=0x7f4d3c0091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.213+0000 7f4d5a800640 1 -- 172.21.15.45:0/2431179189 shutdown_connections 2024-08-17T02:28:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.213+0000 7f4d5a800640 1 --2- 172.21.15.45:0/2431179189 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d54155df0 0x7f4d540ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.213+0000 7f4d5a800640 1 --2- 172.21.15.45:0/2431179189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5406df00 0x7f4d540adf10 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.213+0000 7f4d5a800640 1 -- 172.21.15.45:0/2431179189 >> 172.21.15.45:0/2431179189 conn(0x7f4d540cb9b0 msgr2=0x7f4d540cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.213+0000 7f4d5a800640 1 -- 172.21.15.45:0/2431179189 shutdown_connections 2024-08-17T02:28:47.216 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.213+0000 7f4d5a800640 1 -- 172.21.15.45:0/2431179189 wait complete. 2024-08-17T02:28:47.218 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.215+0000 7f4d5a800640 1 Processor -- start 2024-08-17T02:28:47.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.215+0000 7f4d5a800640 1 -- start start 2024-08-17T02:28:47.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.216+0000 7f4d5a800640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d5406df00 0x7f4d54169b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.216+0000 7f4d5a800640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d54155a20 0x7f4d540a9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.216+0000 7f4d5a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d54155df0 0x7f4d540a9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.216+0000 7f4d5a800640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54167290 con 0x7f4d54155df0 2024-08-17T02:28:47.219 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.216+0000 7f4d5a800640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540aa240 con 0x7f4d54155a20 2024-08-17T02:28:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.216+0000 7f4d5a800640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540aa520 con 0x7f4d5406df00 2024-08-17T02:28:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.216+0000 7f4d53e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d54155df0 0x7f4d540a9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.216+0000 7f4d53400640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d5406df00 0x7f4d54169b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.216+0000 7f4d53e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d54155df0 0x7f4d540a9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44660/0 (socket says 172.21.15.45:44660) 2024-08-17T02:28:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.216+0000 7f4d53e00640 1 -- 172.21.15.45:0/228805886 learned_addr learned my addr 172.21.15.45:0/228805886 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.216+0000 7f4d4aa00640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d54155a20 0x7f4d540a9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.217+0000 7f4d53e00640 1 -- 172.21.15.45:0/228805886 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d5406df00 msgr2=0x7f4d54169b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.220 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.217+0000 7f4d53e00640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d5406df00 0x7f4d54169b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.217+0000 7f4d53e00640 1 -- 172.21.15.45:0/228805886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d54155a20 msgr2=0x7f4d540a9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.217+0000 7f4d53e00640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d54155a20 0x7f4d540a9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.217+0000 7f4d53e00640 1 -- 172.21.15.45:0/228805886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c009450 con 0x7f4d54155df0 2024-08-17T02:28:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.217+0000 7f4d53e00640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d54155df0 0x7f4d540a9b70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009d70 tx=0x7f4d4c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.217+0000 7f4d4b400640 1 -- 172.21.15.45:0/228805886 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c00cd40 con 0x7f4d54155df0 2024-08-17T02:28:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.217+0000 7f4d4b400640 1 -- 172.21.15.45:0/228805886 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c00f040 con 0x7f4d54155df0 2024-08-17T02:28:47.221 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.217+0000 7f4d4b400640 1 -- 172.21.15.45:0/228805886 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c00cea0 con 0x7f4d54155df0 2024-08-17T02:28:47.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.217+0000 7f4d5a800640 1 -- 172.21.15.45:0/228805886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d540aa800 con 0x7f4d54155df0 2024-08-17T02:28:47.222 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.217+0000 7f4d5a800640 1 -- 172.21.15.45:0/228805886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5416a090 con 0x7f4d54155df0 2024-08-17T02:28:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.219+0000 7f4d5a800640 1 -- 172.21.15.45:0/228805886 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d540ab000 con 0x7f4d54155df0 2024-08-17T02:28:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.220+0000 7f4d4b400640 1 -- 172.21.15.45:0/228805886 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4d4c014920 con 0x7f4d54155df0 2024-08-17T02:28:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.221+0000 7f4d4b400640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4d30065150 0x7f4d30067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.221+0000 7f4d4b400640 1 -- 172.21.15.45:0/228805886 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f4d4c082e70 con 0x7f4d54155df0 2024-08-17T02:28:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.221+0000 7f4d53400640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4d30065150 0x7f4d30067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.223 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.222+0000 7f4d53400640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4d30065150 0x7f4d30067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4d440011e0 tx=0x7f4d44007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.225 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.225+0000 7f4d4b400640 1 -- 172.21.15.45:0/228805886 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f4d540ab000 con 0x7f4d54155df0 2024-08-17T02:28:47.406 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.405+0000 7f4d5a800640 1 -- 172.21.15.45:0/228805886 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d5416a2e0 con 0x7f4d30065150 2024-08-17T02:28:47.407 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.406+0000 7f4d4b400640 1 -- 172.21.15.45:0/228805886 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4d5416a2e0 con 0x7f4d30065150 2024-08-17T02:28:47.407 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 7 to deep-scrub 2024-08-17T02:28:47.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.407+0000 7f4d5a800640 1 -- 172.21.15.45:0/228805886 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4d30065150 msgr2=0x7f4d30067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.408 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.407+0000 7f4d5a800640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4d30065150 0x7f4d30067600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4d440011e0 tx=0x7f4d44007ca0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.407+0000 7f4d5a800640 1 -- 172.21.15.45:0/228805886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d54155df0 msgr2=0x7f4d540a9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.407+0000 7f4d5a800640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d54155df0 0x7f4d540a9b70 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c009d70 tx=0x7f4d4c00b040 comp rx=0 tx=0).stop 2024-08-17T02:28:47.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.407+0000 7f4d5a800640 1 -- 172.21.15.45:0/228805886 shutdown_connections 2024-08-17T02:28:47.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.407+0000 7f4d5a800640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d54155df0 0x7f4d540a9b70 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.407+0000 7f4d5a800640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f4d54155a20 0x7f4d540a9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.409 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.407+0000 7f4d5a800640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f4d30065150 0x7f4d30067600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.407+0000 7f4d5a800640 1 --2- 172.21.15.45:0/228805886 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f4d5406df00 0x7f4d54169b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.407+0000 7f4d5a800640 1 -- 172.21.15.45:0/228805886 >> 172.21.15.45:0/228805886 conn(0x7f4d540cb9b0 msgr2=0x7f4d5406c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:47.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.408+0000 7f4d5a800640 1 -- 172.21.15.45:0/228805886 shutdown_connections 2024-08-17T02:28:47.410 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.408+0000 7f4d5a800640 1 -- 172.21.15.45:0/228805886 wait complete. 2024-08-17T02:28:47.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:28:47.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.574+0000 7f64bb200640 1 Processor -- start 2024-08-17T02:28:47.575 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.574+0000 7f64bb200640 1 -- start start 2024-08-17T02:28:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.575+0000 7f64bb200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b406da20 0x7f64b406ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.575+0000 7f64bb200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f64b4158fa0 0x7f64b40ab6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.575+0000 7f64bb200640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64b40a9a10 con 0x7f64b40aa7d0 2024-08-17T02:28:47.577 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.575+0000 7f64bb200640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b40ac400 con 0x7f64b4158fa0 2024-08-17T02:28:47.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.575+0000 7f64bb200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40a9cf0 con 0x7f64b406da20 2024-08-17T02:28:47.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.576+0000 7f64b3e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b406da20 0x7f64b406ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.576+0000 7f64b9200640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f64b4158fa0 0x7f64b40ab6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.578 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.576+0000 7f64b3e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b406da20 0x7f64b406ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.169:3301/0 says I am v2:172.21.15.45:46726/0 (socket says 172.21.15.45:46726) 2024-08-17T02:28:47.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.576+0000 7f64b3e00640 1 -- 172.21.15.45:0/460492599 learned_addr learned my addr 172.21.15.45:0/460492599 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:47.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.576+0000 7f64b3400640 1 --1- 172.21.15.45:0/460492599 >> v1:172.21.15.169:6789/0 conn(0x7f64b40aa7d0 0x7f64b4158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.169:6789/0 says I am v1:172.21.15.45:37072/0 (socket says 172.21.15.45:37072) 2024-08-17T02:28:47.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.576+0000 7f64b3e00640 1 -- 172.21.15.45:0/460492599 >> v2:172.21.15.169:3300/0 conn(0x7f64b4158fa0 msgr2=0x7f64b40ab6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:28:47.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.576+0000 7f64b3e00640 1 --2- 172.21.15.45:0/460492599 >> v2:172.21.15.169:3300/0 conn(0x7f64b4158fa0 0x7f64b40ab6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.576+0000 7f64b3e00640 1 -- 172.21.15.45:0/460492599 >> v1:172.21.15.169:6789/0 conn(0x7f64b40aa7d0 legacy=0x7f64b4158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.579 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.576+0000 7f64b3e00640 1 -- 172.21.15.45:0/460492599 --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b40a9fd0 con 0x7f64b406da20 2024-08-17T02:28:47.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.577+0000 7f64b3e00640 1 --2- 172.21.15.45:0/460492599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b406da20 0x7f64b406ddf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009910 tx=0x7f64a40091d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35dd61b7db03b8e server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.578+0000 7f64b2a00640 1 -- 172.21.15.45:0/460492599 <== mon.2 v2:172.21.15.169:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a402adb0 con 0x7f64b406da20 2024-08-17T02:28:47.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.578+0000 7f64b2a00640 1 -- 172.21.15.45:0/460492599 <== mon.2 v2:172.21.15.169:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a4032440 con 0x7f64b406da20 2024-08-17T02:28:47.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.578+0000 7f64b2a00640 1 -- 172.21.15.45:0/460492599 <== mon.2 v2:172.21.15.169:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4032820 con 0x7f64b406da20 2024-08-17T02:28:47.581 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.578+0000 7f64bb200640 1 -- 172.21.15.45:0/460492599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b406da20 msgr2=0x7f64b406ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.578+0000 7f64bb200640 1 --2- 172.21.15.45:0/460492599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b406da20 0x7f64b406ddf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f64a4009910 tx=0x7f64a40091d0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.578+0000 7f64bb200640 1 -- 172.21.15.45:0/460492599 shutdown_connections 2024-08-17T02:28:47.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.578+0000 7f64bb200640 1 --2- 172.21.15.45:0/460492599 >> v2:172.21.15.169:3300/0 conn(0x7f64b4158fa0 0x7f64b40ab6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.578+0000 7f64bb200640 1 --2- 172.21.15.45:0/460492599 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b406da20 0x7f64b406ddf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.582 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.578+0000 7f64bb200640 1 -- 172.21.15.45:0/460492599 >> 172.21.15.45:0/460492599 conn(0x7f64b40cb9b0 msgr2=0x7f64b40cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:47.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.578+0000 7f64bb200640 1 -- 172.21.15.45:0/460492599 shutdown_connections 2024-08-17T02:28:47.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.578+0000 7f64bb200640 1 -- 172.21.15.45:0/460492599 wait complete. 2024-08-17T02:28:47.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.580+0000 7f64bb200640 1 Processor -- start 2024-08-17T02:28:47.583 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.580+0000 7f64bb200640 1 -- start start 2024-08-17T02:28:47.585 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64bb200640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b406da20 0x7f64b4156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64bb200640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64b40aa7d0 0x7f64b406a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64bb200640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b4158fa0 0x7f64b416bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64bb200640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40c1590 con 0x7f64b406da20 2024-08-17T02:28:47.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64bb200640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40c09a0 con 0x7f64b40aa7d0 2024-08-17T02:28:47.586 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64bb200640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b40c0c60 con 0x7f64b4158fa0 2024-08-17T02:28:47.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64b3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b406da20 0x7f64b4156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64b3e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b406da20 0x7f64b4156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44670/0 (socket says 172.21.15.45:44670) 2024-08-17T02:28:47.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64b3e00640 1 -- 172.21.15.45:0/1890253577 learned_addr learned my addr 172.21.15.45:0/1890253577 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:28:47.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64b3400640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64b40aa7d0 0x7f64b406a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64b9200640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b4158fa0 0x7f64b416bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.587 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64b3e00640 1 -- 172.21.15.45:0/1890253577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b4158fa0 msgr2=0x7f64b416bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64b3e00640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b4158fa0 0x7f64b416bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64b3e00640 1 -- 172.21.15.45:0/1890253577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64b40aa7d0 msgr2=0x7f64b406a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64b3e00640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64b40aa7d0 0x7f64b406a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64b3e00640 1 -- 172.21.15.45:0/1890253577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a4009450 con 0x7f64b406da20 2024-08-17T02:28:47.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.581+0000 7f64b9200640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b4158fa0 0x7f64b416bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:28:47.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.582+0000 7f64b3e00640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b406da20 0x7f64b4156760 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f64a4035040 tx=0x7f64a4032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.588 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.582+0000 7f64ab400640 1 -- 172.21.15.45:0/1890253577 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a4031c80 con 0x7f64b406da20 2024-08-17T02:28:47.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.582+0000 7f64ab400640 1 -- 172.21.15.45:0/1890253577 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a4031e40 con 0x7f64b406da20 2024-08-17T02:28:47.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.582+0000 7f64ab400640 1 -- 172.21.15.45:0/1890253577 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a403d670 con 0x7f64b406da20 2024-08-17T02:28:47.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.582+0000 7f64bb200640 1 -- 172.21.15.45:0/1890253577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b40c0f40 con 0x7f64b406da20 2024-08-17T02:28:47.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.582+0000 7f64bb200640 1 -- 172.21.15.45:0/1890253577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b4156ca0 con 0x7f64b406da20 2024-08-17T02:28:47.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.583+0000 7f64bb200640 1 -- 172.21.15.45:0/1890253577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b4064db0 con 0x7f64b406da20 2024-08-17T02:28:47.589 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.584+0000 7f64ab400640 1 -- 172.21.15.45:0/1890253577 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f64a4039040 con 0x7f64b406da20 2024-08-17T02:28:47.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.585+0000 7f64ab400640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6494065150 0x7f6494067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:28:47.590 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.585+0000 7f64ab400640 1 -- 172.21.15.45:0/1890253577 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f64a40a2060 con 0x7f64b406da20 2024-08-17T02:28:47.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.586+0000 7f64b3400640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6494065150 0x7f6494067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:28:47.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.586+0000 7f64b3400640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6494065150 0x7f6494067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f64b40c3b80 tx=0x7f64a0007e20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:28:47.591 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.589+0000 7f64ab400640 1 -- 172.21.15.45:0/1890253577 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f64a40d3e40 con 0x7f64b406da20 2024-08-17T02:28:47.769 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.768+0000 7f64bb200640 1 -- 172.21.15.45:0/1890253577 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f64b40c16d0 con 0x7f6494065150 2024-08-17T02:28:47.771 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.770+0000 7f64ab400640 1 -- 172.21.15.45:0/1890253577 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50298 (secure 0 0 0) 0x7f64a0007490 con 0x7f6494065150 2024-08-17T02:28:47.772 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:28:47.772 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:28:47.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.772+0000 7f64bb200640 1 -- 172.21.15.45:0/1890253577 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6494065150 msgr2=0x7f6494067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.772+0000 7f64bb200640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6494065150 0x7f6494067600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f64b40c3b80 tx=0x7f64a0007e20 comp rx=0 tx=0).stop 2024-08-17T02:28:47.774 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.772+0000 7f64bb200640 1 -- 172.21.15.45:0/1890253577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b406da20 msgr2=0x7f64b4156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:28:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.772+0000 7f64bb200640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b406da20 0x7f64b4156760 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f64a4035040 tx=0x7f64a4032000 comp rx=0 tx=0).stop 2024-08-17T02:28:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.773+0000 7f64bb200640 1 -- 172.21.15.45:0/1890253577 shutdown_connections 2024-08-17T02:28:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.773+0000 7f64bb200640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f6494065150 0x7f6494067600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.773+0000 7f64bb200640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f64b4158fa0 0x7f64b416bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.773+0000 7f64bb200640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f64b40aa7d0 0x7f64b406a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.773+0000 7f64bb200640 1 --2- 172.21.15.45:0/1890253577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64b406da20 0x7f64b4156760 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:28:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.773+0000 7f64bb200640 1 -- 172.21.15.45:0/1890253577 >> 172.21.15.45:0/1890253577 conn(0x7f64b40cb9b0 msgr2=0x7f64b40cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:28:47.775 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.773+0000 7f64bb200640 1 -- 172.21.15.45:0/1890253577 shutdown_connections 2024-08-17T02:28:47.776 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:28:47.773+0000 7f64bb200640 1 -- 172.21.15.45:0/1890253577 wait complete. 2024-08-17T02:28:47.789 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-08-17T02:28:47.710466+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400672,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574048,"statfs":{"total":773094113280,"available":770635825152,"internally_reserved":0,"allocated":5283840,"data_stored":2895968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.701850"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":185,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:28:37.026137+0000","last_change":"2024-08-17T02:25:05.193253+0000","last_active":"2024-08-17T02:28:37.026137+0000","last_peered":"2024-08-17T02:28:37.026137+0000","last_clean":"2024-08-17T02:28:37.026137+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:28:37.026137+0000","last_undegraded":"2024-08-17T02:28:37.026137+0000","last_fullsized":"2024-08-17T02:28:37.026137+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-17T02:25:03.711096+0000","last_clean_scrub_stamp":"2024-08-17T02:25:03.711096+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298440,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073400,"statfs":{"total":96636764160,"available":96331161600,"internally_reserved":0,"allocated":1105920,"data_stored":804772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.622,"15min":0.58699999999999997},"min":{"1min":0.497,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.69899999999999995,"15min":0.68799999999999994},"min":{"1min":0.627,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.92500000000000004,"5min":1.173,"15min":1.173},"last":0.64000000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64000000000000001,"15min":0.625},"min":{"1min":0.47799999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.65100000000000002,"15min":0.63500000000000001},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.67400000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91100000000000003,"5min":1.042,"15min":1.042},"last":0.748},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.629,"15min":0.61399999999999999},"min":{"1min":0.49199999999999999,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.83899999999999997,"5min":0.879,"15min":0.879},"last":0.629}]},{"osd":3,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.69899999999999995,"15min":0.66900000000000004},"min":{"1min":0.54300000000000004,"5min":0.496,"15min":0.496},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.71999999999999997,"15min":0.71399999999999997},"min":{"1min":0.57999999999999996,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.94699999999999995,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.68799999999999994}]},{"osd":4,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.61599999999999999,"15min":0.63400000000000001},"min":{"1min":0.42799999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76500000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.39300000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.77700000000000002,"5min":0.874,"15min":0.874},"last":0.65600000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.61499999999999999,"15min":0.627},"min":{"1min":0.437,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71799999999999997,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.71199999999999997,"15min":0.745},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:04 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73599999999999999,"15min":0.748},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.93100000000000005,"5min":1.137,"15min":1.137},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66500000000000004,"15min":0.65300000000000002},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.79100000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.66200000000000003,"15min":0.65300000000000002},"min":{"1min":0.48599999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.88200000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.67300000000000004,"15min":0.65700000000000003},"min":{"1min":0.50900000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.89900000000000002,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.56599999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.51400000000000001,"5min":0.497,"15min":0.497},"max":{"1min":0.97799999999999998,"5min":1.339,"15min":1.339},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.68200000000000005,"15min":0.67800000000000005},"min":{"1min":0.55700000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.88800000000000001,"5min":1.196,"15min":1.196},"last":0.75700000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71199999999999997,"15min":0.69999999999999996},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.90300000000000002,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.81200000000000006,"15min":0.84999999999999998},"min":{"1min":0.52900000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.873,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.70999999999999996}]},{"osd":3,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.748,"15min":0.73699999999999999},"min":{"1min":0.54000000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.95399999999999996,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.86899999999999999,"15min":0.92300000000000004},"min":{"1min":0.58099999999999996,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.0820000000000001,"5min":4.8449999999999998,"15min":4.8449999999999998},"last":0.78900000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.625,"15min":0.66900000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.79800000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.628,"15min":0.65900000000000003},"min":{"1min":0.44600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.84899999999999998,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.61099999999999999}]},{"osd":5,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.47399999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95799999999999996,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.75700000000000001,"15min":0.80000000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.92100000000000004,"5min":1.804,"15min":1.804},"last":0.84599999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71499999999999997,"15min":0.749},"min":{"1min":0.501,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.94299999999999995,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.71099999999999997,"15min":0.73399999999999999},"min":{"1min":0.52900000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80200000000000005,"5min":1.002,"15min":1.002},"last":0.80300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.57799999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":0.85799999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.624}]},{"osd":1,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68300000000000005,"15min":0.63200000000000001},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68300000000000005,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.59199999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65200000000000002,"15min":0.61899999999999999},"min":{"1min":0.56999999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65900000000000003,"15min":0.624},"min":{"1min":0.495,"5min":0.443,"15min":0.443},"max":{"1min":0.92400000000000004,"5min":1.425,"15min":1.425},"last":0.746}]},{"osd":3,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70799999999999996,"15min":0.68600000000000005},"min":{"1min":0.60699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84499999999999997,"5min":1.776,"15min":1.776},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69999999999999996,"15min":0.68100000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.90400000000000003,"5min":1.014,"15min":1.014},"last":0.57099999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60599999999999998,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81999999999999995,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.877,"5min":2.262,"15min":2.262},"last":0.70599999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":1.829,"15min":1.829},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.71299999999999997},"min":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.86299999999999999,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":0.78600000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80900000000000005,"5min":2.351,"15min":2.351},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.86199999999999999,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.84999999999999998},"min":{"1min":0.48599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.94999999999999996,"5min":4.5339999999999998,"15min":4.5339999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.79300000000000004,"15min":0.83099999999999996},"min":{"1min":0.54200000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.80000000000000004,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.61599999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96499999999999997,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52500000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.745,"15min":0.75},"min":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.93400000000000005,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.66600000000000004}]},{"osd":3,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70099999999999996,"15min":0.68700000000000006},"min":{"1min":0.57799999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.56100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.624}]},{"osd":5,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.754,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80300000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.63200000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86799999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.50700000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.75800000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.502,"5min":0.437,"15min":0.437},"max":{"1min":0.79200000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0740000000000001,"5min":1.077,"15min":1.077},"last":0.67900000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.56699999999999995,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.44},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.47699999999999998,"15min":0.46500000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59799999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.372}]},{"osd":1,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46600000000000003,"15min":0.45400000000000001},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.505,"5min":0.372,"15min":0.372},"max":{"1min":0.72899999999999998,"5min":1.349,"15min":1.349},"last":0.53400000000000003}]},{"osd":2,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84099999999999997,"5min":0.871,"15min":0.871},"last":0.51700000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.621,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.131,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78500000000000003,"15min":0.77500000000000002},"min":{"1min":0.66300000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.0109999999999999,"5min":1.252,"15min":1.252},"last":0.77500000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80400000000000005,"15min":0.79500000000000004},"min":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.075,"5min":1.216,"15min":1.216},"last":0.95099999999999996},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.113,"5min":1.446,"15min":1.446},"last":0.76100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85699999999999998,"15min":0.86599999999999999},"min":{"1min":0.76500000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0589999999999999,"5min":1.522,"15min":1.522},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82399999999999995},"min":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.996,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.90600000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.752,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.083,"5min":1.446,"15min":1.446},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81200000000000006,"15min":0.80800000000000005},"min":{"1min":0.65900000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.097,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.81100000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68200000000000005,"5min":1.931,"15min":1.931},"last":0.498},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68000000000000005,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.51400000000000001}]},{"osd":1,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.626,"5min":1.478,"15min":1.478},"last":0.437},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59199999999999997,"15min":0.627},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.45600000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70199999999999996,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.53800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86399999999999999,"15min":0.88200000000000001},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.083,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.044,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.57499999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.65100000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98399999999999999,"5min":2.302,"15min":2.302},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.876,"15min":0.90400000000000003},"min":{"1min":0.66300000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96499999999999997,"5min":2.444,"15min":2.444},"last":0.63100000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.68000000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.002,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.84999999999999998,"15min":0.86499999999999999},"min":{"1min":0.61499999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0589999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.871,"15min":0.89300000000000002},"min":{"1min":0.68899999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.032,"5min":2.512,"15min":2.512},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.84299999999999997,"15min":0.84599999999999997},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0069999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.621}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.40400000000000003},"min":{"1min":0.32500000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.56100000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.46600000000000003,"15min":0.45400000000000001},"min":{"1min":0.36699999999999999,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.66400000000000003,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51700000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.497},"min":{"1min":0.40000000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.752,"5min":0.878,"15min":0.878},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61599999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48199999999999998}]},{"osd":3,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.48199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.92900000000000005,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.505,"15min":0.47999999999999998},"min":{"1min":0.44900000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.56299999999999994}]},{"osd":4,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.78300000000000003,"15min":0.78500000000000003},"min":{"1min":0.63800000000000001,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.04,"5min":1.137,"15min":1.137},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.81399999999999995,"15min":0.81799999999999995},"min":{"1min":0.69999999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.018,"5min":1.867,"15min":1.867},"last":0.65900000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.77200000000000002,"15min":0.78000000000000003},"min":{"1min":0.59199999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0269999999999999,"5min":1.464,"15min":1.464},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.79100000000000004,"15min":0.79900000000000004},"min":{"1min":0.623,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.079,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.61099999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81799999999999995,"15min":0.82499999999999996},"min":{"1min":0.61899999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.117,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.68700000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.0589999999999999,"5min":1.548,"15min":1.548},"last":0.74399999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:03 2024","interfaces":[{"interface":"back","average":{"1min":0.80600000000000005,"5min":0.78600000000000003,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0629999999999999,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80900000000000005},"min":{"1min":0.627,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.99399999999999999,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.70699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302604,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069236,"statfs":{"total":96636764160,"available":96326897664,"internally_reserved":0,"allocated":1105920,"data_stored":804772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.32000000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.752,"15min":0.752},"last":0.54900000000000004}]},{"osd":2,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.623,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.45900000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.40200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58799999999999997,"15min":0.59699999999999998},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.441}]},{"osd":4,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.76200000000000001},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.623},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.99299999999999999,"5min":1.141,"15min":1.141},"last":0.69699999999999995}]},{"osd":5,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.77600000000000002},"min":{"1min":0.68999999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.99199999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.268,"15min":1.268},"last":0.67700000000000005}]},{"osd":6,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.038,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.62,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0609999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96599999999999997,"5min":1.333,"15min":1.333},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83899999999999997,"15min":0.85099999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.179,"5min":1.204,"15min":1.204},"last":0.65500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:28:47.792 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-08-17T02:25:03.711096+0000 time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=25, tm_sec=3, tm_wday=5, tm_yday=230, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=8, tm_mday=17, tm_hour=2, tm_min=28, tm_sec=41, tm_wday=5, tm_yday=230, tm_isdst=0) 2024-08-17T02:28:47.793 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-08-17T02:29:07.794 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-17T02:29:07.957 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.956+0000 7fd0c3600640 1 Processor -- start 2024-08-17T02:29:07.958 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.956+0000 7fd0c3600640 1 -- start start 2024-08-17T02:29:07.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.958+0000 7fd0c3600640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd0bc0b1440 0x7fd0bc0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.958+0000 7fd0c3600640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0bc0caa80 con 0x7fd0bc140580 2024-08-17T02:29:07.962 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.958+0000 7fd0c3600640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0bc0c9e70 con 0x7fd0bc1401b0 2024-08-17T02:29:07.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.958+0000 7fd0c3600640 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0bc0cb450 con 0x7fd0bc0b1440 2024-08-17T02:29:07.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.958+0000 7fd0bbe00640 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd0bc0b1440 0x7fd0bc0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.963 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.958+0000 7fd0c1600640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd0bc140580 0x7fd0bc0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60708/0 (socket says 172.21.15.45:60708) 2024-08-17T02:29:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.958+0000 7fd0c1600640 1 -- 172.21.15.45:0/2850975861 learned_addr learned my addr 172.21.15.45:0/2850975861 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:29:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.958+0000 7fd0bb400640 1 -- 172.21.15.45:0/2850975861 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903224867 0 0) 0x7fd0bc0caa80 con 0x7fd0bc140580 2024-08-17T02:29:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.958+0000 7fd0bb400640 1 -- 172.21.15.45:0/2850975861 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a40034e0 con 0x7fd0bc140580 2024-08-17T02:29:07.964 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.959+0000 7fd0bbe00640 1 -- 172.21.15.45:0/2850975861 >> v1:172.21.15.169:6789/0 conn(0x7fd0bc1401b0 legacy=0x7fd0bc0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.959+0000 7fd0bbe00640 1 -- 172.21.15.45:0/2850975861 >> v1:172.21.15.45:6789/0 conn(0x7fd0bc140580 legacy=0x7fd0bc0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.959+0000 7fd0bbe00640 1 -- 172.21.15.45:0/2850975861 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc0ca150 con 0x7fd0bc0b1440 2024-08-17T02:29:07.965 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.960+0000 7fd0bbe00640 1 --2- 172.21.15.45:0/2850975861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0bc0b1440 0x7fd0bc0caf10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009850 tx=0x7fd0a80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb86cceecfd8a9b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.960+0000 7fd0bb400640 1 -- 172.21.15.45:0/2850975861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a802ae20 con 0x7fd0bc0b1440 2024-08-17T02:29:07.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.960+0000 7fd0bb400640 1 -- 172.21.15.45:0/2850975861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a8032440 con 0x7fd0bc0b1440 2024-08-17T02:29:07.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.960+0000 7fd0bb400640 1 -- 172.21.15.45:0/2850975861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a80327e0 con 0x7fd0bc0b1440 2024-08-17T02:29:07.966 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.960+0000 7fd0c3600640 1 -- 172.21.15.45:0/2850975861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0bc0b1440 msgr2=0x7fd0bc0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.960+0000 7fd0c3600640 1 --2- 172.21.15.45:0/2850975861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0bc0b1440 0x7fd0bc0caf10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009850 tx=0x7fd0a80090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.960+0000 7fd0c3600640 1 -- 172.21.15.45:0/2850975861 shutdown_connections 2024-08-17T02:29:07.967 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.960+0000 7fd0c3600640 1 --2- 172.21.15.45:0/2850975861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0bc0b1440 0x7fd0bc0caf10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.961+0000 7fd0c3600640 1 -- 172.21.15.45:0/2850975861 >> 172.21.15.45:0/2850975861 conn(0x7fd0bc0cb9b0 msgr2=0x7fd0bc0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.961+0000 7fd0c3600640 1 -- 172.21.15.45:0/2850975861 shutdown_connections 2024-08-17T02:29:07.968 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.961+0000 7fd0c3600640 1 -- 172.21.15.45:0/2850975861 wait complete. 2024-08-17T02:29:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.962+0000 7fd0c3600640 1 Processor -- start 2024-08-17T02:29:07.973 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.962+0000 7fd0c3600640 1 -- start start 2024-08-17T02:29:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.963+0000 7fd0c3600640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0bc0b1440 0x7fd0bc0ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.963+0000 7fd0c3600640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0bc1401b0 0x7fd0bc15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.974 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.963+0000 7fd0c3600640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0bc140580 0x7fd0bc0a5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.963+0000 7fd0c3600640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc0aca70 con 0x7fd0bc0b1440 2024-08-17T02:29:07.975 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.963+0000 7fd0c3600640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc130cf0 con 0x7fd0bc140580 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.963+0000 7fd0c3600640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0bc15b280 con 0x7fd0bc1401b0 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.963+0000 7fd0c0c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0bc0b1440 0x7fd0bc0ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.976 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.963+0000 7fd0c0c00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0bc0b1440 0x7fd0bc0ac530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50096/0 (socket says 172.21.15.45:50096) 2024-08-17T02:29:07.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.963+0000 7fd0c0c00640 1 -- 172.21.15.45:0/423370250 learned_addr learned my addr 172.21.15.45:0/423370250 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:29:07.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.963+0000 7fd0c1600640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0bc140580 0x7fd0bc0a5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.977 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.963+0000 7fd0bbe00640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0bc1401b0 0x7fd0bc15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0c0c00640 1 -- 172.21.15.45:0/423370250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0bc1401b0 msgr2=0x7fd0bc15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0c0c00640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0bc1401b0 0x7fd0bc15ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.978 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0c0c00640 1 -- 172.21.15.45:0/423370250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0bc140580 msgr2=0x7fd0bc0a5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0c0c00640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0bc140580 0x7fd0bc0a5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0c0c00640 1 -- 172.21.15.45:0/423370250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8009390 con 0x7fd0bc0b1440 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0c1600640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0bc140580 0x7fd0bc0a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:07.979 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0c0c00640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0bc0b1440 0x7fd0bc0ac530 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000c560 tx=0x7fd0b0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0afe00640 1 -- 172.21.15.45:0/423370250 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0011590 con 0x7fd0bc0b1440 2024-08-17T02:29:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0afe00640 1 -- 172.21.15.45:0/423370250 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b0011710 con 0x7fd0bc0b1440 2024-08-17T02:29:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0afe00640 1 -- 172.21.15.45:0/423370250 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0011ad0 con 0x7fd0bc0b1440 2024-08-17T02:29:07.980 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0c3600640 1 -- 172.21.15.45:0/423370250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0bc0ad500 con 0x7fd0bc0b1440 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.964+0000 7fd0c3600640 1 -- 172.21.15.45:0/423370250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0bc0acf40 con 0x7fd0bc0b1440 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.965+0000 7fd0c3600640 1 -- 172.21.15.45:0/423370250 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0bc064db0 con 0x7fd0bc0b1440 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.966+0000 7fd0afe00640 1 -- 172.21.15.45:0/423370250 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7fd0b001b3b0 con 0x7fd0bc0b1440 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.967+0000 7fd0afe00640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd09c065150 0x7fd09c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.968+0000 7fd0afe00640 1 -- 172.21.15.45:0/423370250 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd0b0081740 con 0x7fd0bc0b1440 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.968+0000 7fd0bbe00640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd09c065150 0x7fd09c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.968+0000 7fd0bbe00640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd09c065150 0x7fd09c067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8034000 tx=0x7fd0a8032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:07.981 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:07.972+0000 7fd0afe00640 1 -- 172.21.15.45:0/423370250 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7fd0b004fab0 con 0x7fd0bc0b1440 2024-08-17T02:29:08.150 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.149+0000 7fd0c3600640 1 -- 172.21.15.45:0/423370250 --> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd0bc06e030 con 0x7fd09c065150 2024-08-17T02:29:08.152 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.151+0000 7fd0afe00640 1 -- 172.21.15.45:0/423370250 <== mgr.4108 v2:172.21.15.45:6832/37172 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50591 (secure 0 0 0) 0x7fd0bc06e030 con 0x7fd09c065150 2024-08-17T02:29:08.153 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:29:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2024-08-17T02:29:08.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 -- 172.21.15.45:0/423370250 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd09c065150 msgr2=0x7fd09c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd09c065150 0x7fd09c067600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8034000 tx=0x7fd0a8032000 comp rx=0 tx=0).stop 2024-08-17T02:29:08.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 -- 172.21.15.45:0/423370250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0bc0b1440 msgr2=0x7fd0bc0ac530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0bc0b1440 0x7fd0bc0ac530 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fd0b000c560 tx=0x7fd0b0007ef0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.155 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 -- 172.21.15.45:0/423370250 shutdown_connections 2024-08-17T02:29:08.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7fd0bc140580 0x7fd0bc0a5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7fd09c065150 0x7fd09c067600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7fd0bc1401b0 0x7fd0bc15ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 --2- 172.21.15.45:0/423370250 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0bc0b1440 0x7fd0bc0ac530 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 -- 172.21.15.45:0/423370250 >> 172.21.15.45:0/423370250 conn(0x7fd0bc0cb9b0 msgr2=0x7fd0bc0aeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 -- 172.21.15.45:0/423370250 shutdown_connections 2024-08-17T02:29:08.156 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.154+0000 7fd0c3600640 1 -- 172.21.15.45:0/423370250 wait complete. 2024-08-17T02:29:08.170 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-08-17T02:29:07.714593+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2400652,"kb_used_data":5160,"kb_used_omap":13,"kb_used_meta":2395378,"kb_avail":752574068,"statfs":{"total":773094113280,"available":770635845632,"internally_reserved":0,"allocated":5283840,"data_stored":2895968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13632,"internal_metadata":2452867776},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002397"},"pg_stats":[{"pgid":"1.0","version":"43'119","reported_seq":197,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-08-17T02:28:50.930074+0000","last_change":"2024-08-17T02:28:50.930049+0000","last_active":"2024-08-17T02:28:50.930074+0000","last_peered":"2024-08-17T02:28:50.930074+0000","last_clean":"2024-08-17T02:28:50.930074+0000","last_became_active":"2024-08-17T02:25:05.191912+0000","last_became_peered":"2024-08-17T02:25:05.191912+0000","last_unstale":"2024-08-17T02:28:50.930074+0000","last_undegraded":"2024-08-17T02:28:50.930074+0000","last_fullsized":"2024-08-17T02:28:50.930074+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'119","last_scrub_stamp":"2024-08-17T02:28:50.929973+0000","last_deep_scrub":"43'119","last_deep_scrub_stamp":"2024-08-17T02:28:50.929973+0000","last_clean_scrub_stamp":"2024-08-17T02:28:50.929973+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-08-18T06:31:46.364179+0000","scrub_duration":0.0062896319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574899,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298432,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073408,"statfs":{"total":96636764160,"available":96331169792,"internally_reserved":0,"allocated":1105920,"data_stored":804772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63600000000000001,"15min":0.59199999999999997},"min":{"1min":0.438,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84899999999999998,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.69799999999999995,"15min":0.68799999999999994},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.81100000000000005,"5min":1.173,"15min":1.173},"last":0.72399999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.64400000000000002,"15min":0.626},"min":{"1min":0.46800000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.86499999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65700000000000003,"15min":0.63700000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.86899999999999999,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.77400000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68999999999999995,"15min":0.66900000000000004},"min":{"1min":0.48099999999999998,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.91300000000000003,"5min":1.042,"15min":1.042},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.64200000000000002,"15min":0.61799999999999999},"min":{"1min":0.58399999999999996,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78000000000000003,"5min":0.879,"15min":0.879},"last":0.78500000000000003}]},{"osd":3,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70899999999999996,"15min":0.67300000000000004},"min":{"1min":0.51800000000000002,"5min":0.496,"15min":0.496},"max":{"1min":0.88800000000000001,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71899999999999997,"15min":0.71299999999999997},"min":{"1min":0.54400000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86799999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.81999999999999995}]},{"osd":4,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.60199999999999998,"15min":0.629},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81799999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59299999999999997,"15min":0.59399999999999997},"min":{"1min":0.39400000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.75700000000000001,"5min":0.874,"15min":0.874},"last":0.44400000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60999999999999999,"15min":0.625},"min":{"1min":0.46200000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.89700000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.68700000000000006,"15min":0.73699999999999999},"min":{"1min":0.441,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.875,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.72299999999999998,"15min":0.74399999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.85799999999999998,"5min":1.137,"15min":1.137},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67500000000000004,"15min":0.65600000000000003},"min":{"1min":0.47399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.88800000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.501}]}]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297860,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073980,"statfs":{"total":96636764160,"available":96331755520,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.38500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.94399999999999995,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.67100000000000004,"15min":0.65600000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.83999999999999997,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.69499999999999995}]},{"osd":1,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.71499999999999997,"15min":0.70699999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.94799999999999995,"5min":1.339,"15min":1.339},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.69099999999999995,"15min":0.68100000000000005},"min":{"1min":0.439,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.89400000000000002,"5min":1.196,"15min":1.196},"last":0.72799999999999998}]},{"osd":2,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71499999999999997,"15min":0.70099999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.84499999999999997,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.78600000000000003,"15min":0.84099999999999997},"min":{"1min":0.53800000000000003,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.99099999999999999,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":0.74299999999999999}]},{"osd":3,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.753,"15min":0.73899999999999999},"min":{"1min":0.58799999999999997,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97799999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.82799999999999996,"15min":0.90900000000000003},"min":{"1min":0.59599999999999997,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.91500000000000004,"5min":4.8449999999999998,"15min":4.8449999999999998},"last":0.63500000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60299999999999998,"15min":0.66100000000000003},"min":{"1min":0.44800000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80100000000000005,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.61299999999999999,"15min":0.65400000000000003},"min":{"1min":0.48099999999999998,"5min":0.44,"15min":0.44},"max":{"1min":0.90000000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.53200000000000003}]},{"osd":5,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.71899999999999997},"min":{"1min":0.53800000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.016,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73499999999999999,"15min":0.79300000000000004},"min":{"1min":0.54000000000000004,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.84699999999999998,"5min":1.804,"15min":1.804},"last":0.78200000000000003}]},{"osd":7,"last update":"Sat Aug 17 02:29:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.69699999999999995,"15min":0.74299999999999999},"min":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86599999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.752},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.70799999999999996,"15min":0.73299999999999998},"min":{"1min":0.57199999999999995,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97699999999999998,"5min":1.002,"15min":1.002},"last":0.76500000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297864,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073976,"statfs":{"total":96636764160,"available":96331751424,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.67500000000000004,"15min":0.65500000000000003},"min":{"1min":0.57799999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.64800000000000002,"15min":0.624},"min":{"1min":0.57399999999999995,"5min":0.441,"15min":0.441},"max":{"1min":0.85799999999999998,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.66400000000000003}]},{"osd":1,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68300000000000005,"15min":0.63200000000000001},"min":{"1min":0.51700000000000002,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.874,"5min":4.9139999999999997,"15min":4.9139999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.68300000000000005,"15min":0.64900000000000002},"min":{"1min":0.53500000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88200000000000001,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.84299999999999997}]},{"osd":2,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.65200000000000002,"15min":0.61899999999999999},"min":{"1min":0.56999999999999995,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.89500000000000002,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65900000000000003,"15min":0.624},"min":{"1min":0.495,"5min":0.443,"15min":0.443},"max":{"1min":0.92400000000000004,"5min":1.425,"15min":1.425},"last":0.64100000000000001}]},{"osd":3,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.70799999999999996,"15min":0.68600000000000005},"min":{"1min":0.60699999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":0.84499999999999997,"5min":1.776,"15min":1.776},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.69999999999999996,"15min":0.68100000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.90400000000000003,"5min":1.014,"15min":1.014},"last":0.78200000000000003}]},{"osd":4,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.60599999999999998,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.81999999999999995,"5min":4.8650000000000002,"15min":4.8650000000000002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63900000000000001,"15min":0.64300000000000002},"min":{"1min":0.40400000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.877,"5min":2.262,"15min":2.262},"last":0.71899999999999997}]},{"osd":6,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.45900000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.85499999999999998,"5min":1.829,"15min":1.829},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.73599999999999999,"15min":0.71299999999999997},"min":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.86299999999999999,"5min":4.0720000000000001,"15min":4.0720000000000001},"last":0.75900000000000001}]},{"osd":7,"last update":"Sat Aug 17 02:28:06 2024","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.47599999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.80900000000000005,"5min":2.351,"15min":2.351},"last":0.876},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.745,"15min":0.72299999999999998},"min":{"1min":0.53100000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.86199999999999999,"5min":5.6319999999999997,"15min":5.6319999999999997},"last":0.85499999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297856,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":94073984,"statfs":{"total":96636764160,"available":96331759616,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.81100000000000005,"15min":0.84999999999999998},"min":{"1min":0.48599999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.94999999999999996,"5min":4.5339999999999998,"15min":4.5339999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.79300000000000004,"15min":0.83099999999999996},"min":{"1min":0.54200000000000004,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.80000000000000004,"5min":4.5119999999999996,"15min":4.5119999999999996},"last":0.74199999999999999}]},{"osd":1,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.70299999999999996,"15min":0.69099999999999995},"min":{"1min":0.625,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.96499999999999997,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.52800000000000002,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.70499999999999996}]},{"osd":2,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.47799999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.745,"15min":0.75},"min":{"1min":0.57599999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.93400000000000005,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.67600000000000005}]},{"osd":3,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.70099999999999996,"15min":0.68700000000000006},"min":{"1min":0.57799999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.72399999999999998,"15min":0.72199999999999998},"min":{"1min":0.56100000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.996,"5min":0.996,"15min":0.996},"last":0.65100000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.63600000000000001,"15min":0.65600000000000003},"min":{"1min":0.46899999999999997,"5min":0.379,"15min":0.379},"max":{"1min":0.754,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.80300000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.52400000000000002}]},{"osd":6,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.629,"15min":0.64900000000000002},"min":{"1min":0.40300000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.86799999999999999,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.622,"5min":0.69999999999999996,"15min":0.72199999999999998},"min":{"1min":0.50700000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.75800000000000001,"5min":1.2649999999999999,"15min":1.2649999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Sat Aug 17 02:28:14 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66800000000000004,"15min":0.66400000000000003},"min":{"1min":0.502,"5min":0.437,"15min":0.437},"max":{"1min":0.79200000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.625},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.71899999999999997,"15min":0.73099999999999998},"min":{"1min":0.48199999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0740000000000001,"5min":1.077,"15min":1.077},"last":0.54900000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45500000000000002,"15min":0.46200000000000002},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.56699999999999995,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.437},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.47699999999999998,"15min":0.46500000000000002},"min":{"1min":0.33400000000000002,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.59799999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.34699999999999998}]},{"osd":1,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46600000000000003,"15min":0.45400000000000001},"min":{"1min":0.34899999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.37},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.505,"5min":0.372,"15min":0.372},"max":{"1min":0.72899999999999998,"5min":1.349,"15min":1.349},"last":0.51800000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53800000000000003,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.76700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53900000000000003,"15min":0.53100000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.84099999999999997,"5min":0.871,"15min":0.871},"last":0.48999999999999999}]},{"osd":4,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.621,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.131,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.622},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.78500000000000003,"15min":0.77500000000000002},"min":{"1min":0.66300000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.0109999999999999,"5min":1.252,"15min":1.252},"last":0.65000000000000002}]},{"osd":5,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80400000000000005,"15min":0.79500000000000004},"min":{"1min":0.59399999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.075,"5min":1.216,"15min":1.216},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.57199999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.113,"5min":1.446,"15min":1.446},"last":0.70399999999999996}]},{"osd":6,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85699999999999998,"15min":0.86599999999999999},"min":{"1min":0.76500000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.0589999999999999,"5min":1.522,"15min":1.522},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82399999999999995},"min":{"1min":0.63800000000000001,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":0.996,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.77600000000000002}]},{"osd":7,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83099999999999996,"15min":0.83399999999999996},"min":{"1min":0.752,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.083,"5min":1.446,"15min":1.446},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81200000000000006,"15min":0.80800000000000005},"min":{"1min":0.65900000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.097,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.68600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.48299999999999998,"15min":0.49299999999999999},"min":{"1min":0.32600000000000001,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68200000000000005,"5min":1.931,"15min":1.931},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.57199999999999995,"15min":0.58199999999999996},"min":{"1min":0.47299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68000000000000005,"5min":2.3969999999999998,"15min":2.3969999999999998},"last":0.58399999999999996}]},{"osd":1,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53000000000000003,"15min":0.54200000000000004},"min":{"1min":0.36099999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.626,"5min":1.478,"15min":1.478},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.59199999999999997,"15min":0.627},"min":{"1min":0.39900000000000002,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73099999999999998,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":0.501}]},{"osd":3,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.54700000000000004,"15min":0.57099999999999995},"min":{"1min":0.36199999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70199999999999996,"5min":3.0800000000000001,"15min":3.0800000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64100000000000001,"15min":0.63800000000000001},"min":{"1min":0.53800000000000003,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82299999999999995,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.59299999999999997}]},{"osd":4,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.86399999999999999,"15min":0.88200000000000001},"min":{"1min":0.60099999999999998,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.083,"5min":2.4790000000000001,"15min":2.4790000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.59599999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.044,"5min":2.1339999999999999,"15min":2.1339999999999999},"last":0.88100000000000001}]},{"osd":5,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.81000000000000005},"min":{"1min":0.65100000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.98399999999999999,"5min":2.302,"15min":2.302},"last":0.753},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.876,"15min":0.90400000000000003},"min":{"1min":0.66300000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":0.96499999999999997,"5min":2.444,"15min":2.444},"last":0.85699999999999998}]},{"osd":6,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80700000000000005,"15min":0.81299999999999994},"min":{"1min":0.68000000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.002,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.84999999999999998,"15min":0.86499999999999999},"min":{"1min":0.61499999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.0589999999999999,"5min":2.3420000000000001,"15min":2.3420000000000001},"last":0.84599999999999997}]},{"osd":7,"last update":"Sat Aug 17 02:28:12 2024","interfaces":[{"interface":"back","average":{"1min":0.83399999999999996,"5min":0.871,"15min":0.89300000000000002},"min":{"1min":0.68899999999999995,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.032,"5min":2.512,"15min":2.512},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.84299999999999997,"15min":0.84599999999999997},"min":{"1min":0.68000000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.0069999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.94099999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574900,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":302016,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069824,"statfs":{"total":96636764160,"available":96327499776,"internally_reserved":0,"allocated":512000,"data_stored":214404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.40899999999999997,"15min":0.40400000000000003},"min":{"1min":0.32300000000000001,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.59599999999999997,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.47399999999999998,"15min":0.45600000000000002},"min":{"1min":0.32000000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.63500000000000001,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.63500000000000001}]},{"osd":2,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.501,"15min":0.496},"min":{"1min":0.38900000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.54300000000000004,"5min":0.878,"15min":0.878},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.503,"15min":0.48499999999999999},"min":{"1min":0.39300000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.83199999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.46500000000000002}]},{"osd":3,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.41199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.753,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.51900000000000002,"15min":0.48499999999999999},"min":{"1min":0.40400000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.80300000000000005,"5min":0.876,"15min":0.876},"last":0.51100000000000001}]},{"osd":4,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.77000000000000002,"15min":0.78100000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.997,"5min":1.137,"15min":1.137},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80500000000000005,"15min":0.81499999999999995},"min":{"1min":0.65900000000000003,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":0.93200000000000005,"5min":1.867,"15min":1.867},"last":0.79100000000000004}]},{"osd":5,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.75600000000000001,"15min":0.77500000000000002},"min":{"1min":0.57999999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":0.91000000000000003,"5min":1.464,"15min":1.464},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.79400000000000004},"min":{"1min":0.55100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.88200000000000001,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":0.73799999999999999}]},{"osd":6,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80800000000000005,"15min":0.82199999999999995},"min":{"1min":0.59599999999999997,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.94799999999999995,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.84199999999999997,"15min":0.85499999999999998},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":0.95599999999999996,"5min":1.548,"15min":1.548},"last":0.86199999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:29:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.77500000000000002,"15min":0.78100000000000003},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.93500000000000005,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":0.755},{"interface":"front","average":{"1min":0.745,"5min":0.79200000000000004,"15min":0.80400000000000005},"min":{"1min":0.622,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":0.90100000000000002,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.82199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302592,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":301502,"kb_avail":94069248,"statfs":{"total":96636764160,"available":96326909952,"internally_reserved":0,"allocated":1105920,"data_stored":804772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":308738392},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.45100000000000001,"15min":0.46100000000000002},"min":{"1min":0.32000000000000001,"5min":0.246,"15min":0.246},"max":{"1min":0.60399999999999998,"5min":0.64300000000000002,"15min":0.64300000000000002},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.49299999999999999,"15min":0.495},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.752,"15min":0.752},"last":0.40000000000000002}]},{"osd":2,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.51000000000000001,"15min":0.51700000000000002},"min":{"1min":0.41399999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.623,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.432},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.47699999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.71099999999999997}]},{"osd":3,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.40200000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58799999999999997,"15min":0.59699999999999998},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.72799999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51900000000000002}]},{"osd":4,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76900000000000002,"15min":0.76200000000000001},"min":{"1min":0.57699999999999996,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.79200000000000004,"15min":0.79000000000000004},"min":{"1min":0.56499999999999995,"5min":0.501,"15min":0.501},"max":{"1min":0.99299999999999999,"5min":1.141,"15min":1.141},"last":0.82699999999999996}]},{"osd":5,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.78500000000000003,"15min":0.77600000000000002},"min":{"1min":0.68999999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.99199999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.80500000000000005,"15min":0.80600000000000005},"min":{"1min":0.56499999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.2250000000000001,"5min":1.268,"15min":1.268},"last":0.88400000000000001}]},{"osd":6,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.038,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81899999999999995,"15min":0.82199999999999995},"min":{"1min":0.62,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0609999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.85999999999999999}]},{"osd":7,"last update":"Sat Aug 17 02:28:10 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81799999999999995,"15min":0.82299999999999995},"min":{"1min":0.63700000000000001,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96599999999999997,"5min":1.333,"15min":1.333},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.83899999999999997,"15min":0.85099999999999998},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.179,"5min":1.204,"15min":1.204},"last":0.91500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-17T02:29:08.172 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-08-17T02:29:08.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.317+0000 7f1b43e00640 1 Processor -- start 2024-08-17T02:29:08.318 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.317+0000 7f1b43e00640 1 -- start start 2024-08-17T02:29:08.319 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.319+0000 7f1b43e00640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f1b3c158da0 0x7f1b3c0ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.319+0000 7f1b43e00640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0681f0 con 0x7f1b3c159170 2024-08-17T02:29:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.319+0000 7f1b43e00640 1 -- --> v1:172.21.15.169:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b3c0b08c0 con 0x7f1b3c0aaf20 2024-08-17T02:29:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.319+0000 7f1b43e00640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b3c0aca00 con 0x7f1b3c158da0 2024-08-17T02:29:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.319+0000 7f1b40a00640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1b3c159170 0x7f1b3c0aa810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60718/0 (socket says 172.21.15.45:60718) 2024-08-17T02:29:08.320 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.319+0000 7f1b40a00640 1 -- 172.21.15.45:0/3032023309 learned_addr learned my addr 172.21.15.45:0/3032023309 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:29:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.319+0000 7f1b41400640 1 --2- 172.21.15.45:0/3032023309 >> v2:172.21.15.169:3300/0 conn(0x7f1b3c158da0 0x7f1b3c0ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.319+0000 7f1b3be00640 1 -- 172.21.15.45:0/3032023309 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 827242492 0 0) 0x7f1b3c0681f0 con 0x7f1b3c159170 2024-08-17T02:29:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.320+0000 7f1b3be00640 1 -- 172.21.15.45:0/3032023309 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b240034e0 con 0x7f1b3c159170 2024-08-17T02:29:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.320+0000 7f1b41400640 1 -- 172.21.15.45:0/3032023309 >> v1:172.21.15.169:6789/0 conn(0x7f1b3c0aaf20 legacy=0x7f1b3c0ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.321 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.320+0000 7f1b41400640 1 -- 172.21.15.45:0/3032023309 >> v1:172.21.15.45:6789/0 conn(0x7f1b3c159170 legacy=0x7f1b3c0aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.322 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.320+0000 7f1b41400640 1 -- 172.21.15.45:0/3032023309 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b3c0acce0 con 0x7f1b3c158da0 2024-08-17T02:29:08.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.321+0000 7f1b41400640 1 --2- 172.21.15.45:0/3032023309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c158da0 0x7f1b3c0ac3e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009850 tx=0x7f1b300090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f51583b2dab5c12 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.321+0000 7f1b3be00640 1 -- 172.21.15.45:0/3032023309 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3002adb0 con 0x7f1b3c158da0 2024-08-17T02:29:08.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.321+0000 7f1b3be00640 1 -- 172.21.15.45:0/3032023309 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30032440 con 0x7f1b3c158da0 2024-08-17T02:29:08.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.321+0000 7f1b3be00640 1 -- 172.21.15.45:0/3032023309 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b300327e0 con 0x7f1b3c158da0 2024-08-17T02:29:08.323 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.322+0000 7f1b43e00640 1 -- 172.21.15.45:0/3032023309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c158da0 msgr2=0x7f1b3c0ac3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.322+0000 7f1b43e00640 1 --2- 172.21.15.45:0/3032023309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c158da0 0x7f1b3c0ac3e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f1b30009850 tx=0x7f1b300090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.322+0000 7f1b43e00640 1 -- 172.21.15.45:0/3032023309 shutdown_connections 2024-08-17T02:29:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.322+0000 7f1b43e00640 1 --2- 172.21.15.45:0/3032023309 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c158da0 0x7f1b3c0ac3e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.322+0000 7f1b43e00640 1 -- 172.21.15.45:0/3032023309 >> 172.21.15.45:0/3032023309 conn(0x7f1b3c096a70 msgr2=0x7f1b3c096e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.322+0000 7f1b43e00640 1 -- 172.21.15.45:0/3032023309 shutdown_connections 2024-08-17T02:29:08.324 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.322+0000 7f1b43e00640 1 -- 172.21.15.45:0/3032023309 wait complete. 2024-08-17T02:29:08.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.324+0000 7f1b43e00640 1 Processor -- start 2024-08-17T02:29:08.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.324+0000 7f1b43e00640 1 -- start start 2024-08-17T02:29:08.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b43e00640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b3c0aaf20 0x7f1b3c097b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.326 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b43e00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b3c158da0 0x7f1b3c099a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b43e00640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c098080 0x7f1b3c099f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b43e00640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c09a810 con 0x7f1b3c158da0 2024-08-17T02:29:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b43e00640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c09aaf0 con 0x7f1b3c098080 2024-08-17T02:29:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b43e00640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c09add0 con 0x7f1b3c0aaf20 2024-08-17T02:29:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b40a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b3c158da0 0x7f1b3c099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b40a00640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b3c158da0 0x7f1b3c099a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50112/0 (socket says 172.21.15.45:50112) 2024-08-17T02:29:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b40a00640 1 -- 172.21.15.45:0/1549025663 learned_addr learned my addr 172.21.15.45:0/1549025663 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:29:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b41400640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b3c0aaf20 0x7f1b3c097b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.327 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b41e00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c098080 0x7f1b3c099f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b40a00640 1 -- 172.21.15.45:0/1549025663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b3c0aaf20 msgr2=0x7f1b3c097b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b40a00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b3c0aaf20 0x7f1b3c097b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b40a00640 1 -- 172.21.15.45:0/1549025663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c098080 msgr2=0x7f1b3c099f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b40a00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c098080 0x7f1b3c099f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b40a00640 1 -- 172.21.15.45:0/1549025663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b30009390 con 0x7f1b3c158da0 2024-08-17T02:29:08.328 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.325+0000 7f1b41e00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c098080 0x7f1b3c099f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-17T02:29:08.329 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.326+0000 7f1b40a00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b3c158da0 0x7f1b3c099a20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c590 tx=0x7f1b28007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.326+0000 7f1b38c00640 1 -- 172.21.15.45:0/1549025663 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28005b70 con 0x7f1b3c158da0 2024-08-17T02:29:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.326+0000 7f1b38c00640 1 -- 172.21.15.45:0/1549025663 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b28005cf0 con 0x7f1b3c158da0 2024-08-17T02:29:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.326+0000 7f1b38c00640 1 -- 172.21.15.45:0/1549025663 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b28007320 con 0x7f1b3c158da0 2024-08-17T02:29:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.326+0000 7f1b43e00640 1 -- 172.21.15.45:0/1549025663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c09b0b0 con 0x7f1b3c158da0 2024-08-17T02:29:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.326+0000 7f1b43e00640 1 -- 172.21.15.45:0/1549025663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c09a4a0 con 0x7f1b3c158da0 2024-08-17T02:29:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.327+0000 7f1b43e00640 1 -- 172.21.15.45:0/1549025663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c071050 con 0x7f1b3c158da0 2024-08-17T02:29:08.330 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.328+0000 7f1b38c00640 1 -- 172.21.15.45:0/1549025663 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f1b28012400 con 0x7f1b3c158da0 2024-08-17T02:29:08.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.329+0000 7f1b38c00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1b1c065150 0x7f1b1c067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.329+0000 7f1b38c00640 1 -- 172.21.15.45:0/1549025663 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f1b280816c0 con 0x7f1b3c158da0 2024-08-17T02:29:08.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.329+0000 7f1b41400640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1b1c065150 0x7f1b1c067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.331 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.330+0000 7f1b41400640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1b1c065150 0x7f1b1c067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b30034000 tx=0x7f1b30032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.333 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.333+0000 7f1b38c00640 1 -- 172.21.15.45:0/1549025663 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f1b2804fa30 con 0x7f1b3c158da0 2024-08-17T02:29:08.518 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.517+0000 7f1b43e00640 1 -- 172.21.15.45:0/1549025663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1b3c06d160 con 0x7f1b3c158da0 2024-08-17T02:29:08.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.522+0000 7f1b38c00640 1 -- 172.21.15.45:0/1549025663 <== mon.0 v2:172.21.15.45:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1b2804fa30 con 0x7f1b3c158da0 2024-08-17T02:29:08.522 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.522+0000 7f1b38c00640 1 -- 172.21.15.45:0/1549025663 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1b280170c0 con 0x7f1b3c158da0 2024-08-17T02:29:08.525 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.524+0000 7f1b43e00640 1 -- 172.21.15.45:0/1549025663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1b1c065150 msgr2=0x7f1b1c067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.524+0000 7f1b43e00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1b1c065150 0x7f1b1c067600 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1b30034000 tx=0x7f1b30032000 comp rx=0 tx=0).stop 2024-08-17T02:29:08.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.524+0000 7f1b43e00640 1 -- 172.21.15.45:0/1549025663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b3c158da0 msgr2=0x7f1b3c099a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.524+0000 7f1b43e00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b3c158da0 0x7f1b3c099a20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800c590 tx=0x7f1b28007d70 comp rx=0 tx=0).stop 2024-08-17T02:29:08.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.524+0000 7f1b43e00640 1 -- 172.21.15.45:0/1549025663 shutdown_connections 2024-08-17T02:29:08.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.524+0000 7f1b43e00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f1b3c098080 0x7f1b3c099f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.524+0000 7f1b43e00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b3c158da0 0x7f1b3c099a20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.526 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.524+0000 7f1b43e00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f1b1c065150 0x7f1b1c067600 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.524+0000 7f1b43e00640 1 --2- 172.21.15.45:0/1549025663 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f1b3c0aaf20 0x7f1b3c097b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.524+0000 7f1b43e00640 1 -- 172.21.15.45:0/1549025663 >> 172.21.15.45:0/1549025663 conn(0x7f1b3c096a70 msgr2=0x7f1b3c0ac240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.525+0000 7f1b43e00640 1 -- 172.21.15.45:0/1549025663 shutdown_connections 2024-08-17T02:29:08.527 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.525+0000 7f1b43e00640 1 -- 172.21.15.45:0/1549025663 wait complete. 2024-08-17T02:29:08.542 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-17T02:29:08.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-08-17T02:29:08.694 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.693+0000 7f4311000640 1 Processor -- start 2024-08-17T02:29:08.695 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.693+0000 7f4311000640 1 -- start start 2024-08-17T02:29:08.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.694+0000 7f4311000640 1 --2- >> v2:172.21.15.169:3300/0 conn(0x7f430c1401b0 0x7f430c0caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.697 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.694+0000 7f4311000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c140580 0x7f430c0b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.694+0000 7f4311000640 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430c0b16d0 con 0x7f430c0b1270 2024-08-17T02:29:08.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.694+0000 7f4311000640 1 -- --> v2:172.21.15.169:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430c0cb450 con 0x7f430c1401b0 2024-08-17T02:29:08.698 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.694+0000 7f4311000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c0caa80 con 0x7f430c140580 2024-08-17T02:29:08.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.695+0000 7f430a800640 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f430c0b1270 0x7f430c0c9040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60730/0 (socket says 172.21.15.45:60730) 2024-08-17T02:29:08.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.695+0000 7f430a800640 1 -- 172.21.15.45:0/136570960 learned_addr learned my addr 172.21.15.45:0/136570960 (peer_addr_for_me v1:172.21.15.45:0/0) 2024-08-17T02:29:08.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.695+0000 7f4309e00640 1 --2- 172.21.15.45:0/136570960 >> v2:172.21.15.169:3300/0 conn(0x7f430c1401b0 0x7f430c0caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.699 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.695+0000 7f4303e00640 1 --2- 172.21.15.45:0/136570960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c140580 0x7f430c0b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.695+0000 7f4309400640 1 -- 172.21.15.45:0/136570960 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771452836 0 0) 0x7f4304001490 con 0x7f430c0b1270 2024-08-17T02:29:08.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.695+0000 7f4309400640 1 -- 172.21.15.45:0/136570960 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42f00034e0 con 0x7f430c0b1270 2024-08-17T02:29:08.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.696+0000 7f4309e00640 1 -- 172.21.15.45:0/136570960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c140580 msgr2=0x7f430c0b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-17T02:29:08.700 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.696+0000 7f4309e00640 1 --2- 172.21.15.45:0/136570960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c140580 0x7f430c0b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.696+0000 7f4309e00640 1 -- 172.21.15.45:0/136570960 >> v1:172.21.15.45:6789/0 conn(0x7f430c0b1270 legacy=0x7f430c0c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.696+0000 7f4309e00640 1 -- 172.21.15.45:0/136570960 --> v2:172.21.15.169:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0c9e70 con 0x7f430c1401b0 2024-08-17T02:29:08.701 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.697+0000 7f4309e00640 1 --2- 172.21.15.45:0/136570960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c1401b0 0x7f430c0caf10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009850 tx=0x7f42fc0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e2d8d09c857a5f8 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.697+0000 7f4309400640 1 -- 172.21.15.45:0/136570960 <== mon.1 v2:172.21.15.169:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc02ad00 con 0x7f430c1401b0 2024-08-17T02:29:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.697+0000 7f4309400640 1 -- 172.21.15.45:0/136570960 <== mon.1 v2:172.21.15.169:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f42fc02ae60 con 0x7f430c1401b0 2024-08-17T02:29:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.697+0000 7f4309400640 1 -- 172.21.15.45:0/136570960 <== mon.1 v2:172.21.15.169:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42fc032690 con 0x7f430c1401b0 2024-08-17T02:29:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.698+0000 7f4311000640 1 -- 172.21.15.45:0/136570960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c1401b0 msgr2=0x7f430c0caf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.698+0000 7f4311000640 1 --2- 172.21.15.45:0/136570960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c1401b0 0x7f430c0caf10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f42fc009850 tx=0x7f42fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.698+0000 7f4311000640 1 -- 172.21.15.45:0/136570960 shutdown_connections 2024-08-17T02:29:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.698+0000 7f4311000640 1 --2- 172.21.15.45:0/136570960 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c140580 0x7f430c0b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.698+0000 7f4311000640 1 --2- 172.21.15.45:0/136570960 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c1401b0 0x7f430c0caf10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.698+0000 7f4311000640 1 -- 172.21.15.45:0/136570960 >> 172.21.15.45:0/136570960 conn(0x7f430c0cb9b0 msgr2=0x7f430c0cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.698+0000 7f4311000640 1 -- 172.21.15.45:0/136570960 shutdown_connections 2024-08-17T02:29:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.698+0000 7f4311000640 1 -- 172.21.15.45:0/136570960 wait complete. 2024-08-17T02:29:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.699+0000 7f4311000640 1 Processor -- start 2024-08-17T02:29:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.699+0000 7f4311000640 1 -- start start 2024-08-17T02:29:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.700+0000 7f4311000640 1 --2- >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c0b1270 0x7f430c13e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.700+0000 7f4311000640 1 --2- >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c1401b0 0x7f430c0aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.700+0000 7f4311000640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f430c140580 0x7f430c1564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.700+0000 7f4311000640 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c16d080 con 0x7f430c140580 2024-08-17T02:29:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.700+0000 7f4311000640 1 -- --> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430c16c470 con 0x7f430c1401b0 2024-08-17T02:29:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.700+0000 7f4311000640 1 -- --> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430c16c750 con 0x7f430c0b1270 2024-08-17T02:29:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.700+0000 7f430a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f430c140580 0x7f430c1564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.700+0000 7f430a800640 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f430c140580 0x7f430c1564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50126/0 (socket says 172.21.15.45:50126) 2024-08-17T02:29:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.700+0000 7f430a800640 1 -- 172.21.15.45:0/1025809287 learned_addr learned my addr 172.21.15.45:0/1025809287 (peer_addr_for_me v2:172.21.15.45:0/0) 2024-08-17T02:29:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f4309e00640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c0b1270 0x7f430c13e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f4303e00640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c1401b0 0x7f430c0aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f430a800640 1 -- 172.21.15.45:0/1025809287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c0b1270 msgr2=0x7f430c13e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f430a800640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c0b1270 0x7f430c13e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f430a800640 1 -- 172.21.15.45:0/1025809287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c1401b0 msgr2=0x7f430c0aeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f430a800640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c1401b0 0x7f430c0aeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f430a800640 1 -- 172.21.15.45:0/1025809287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42fc009390 con 0x7f430c140580 2024-08-17T02:29:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f430a800640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f430c140580 0x7f430c1564e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f430400cc40 tx=0x7f4304001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f4301600640 1 -- 172.21.15.45:0/1025809287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400ce00 con 0x7f430c140580 2024-08-17T02:29:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f4301600640 1 -- 172.21.15.45:0/1025809287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f430400a850 con 0x7f430c140580 2024-08-17T02:29:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f4301600640 1 -- 172.21.15.45:0/1025809287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430400ac10 con 0x7f430c140580 2024-08-17T02:29:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.701+0000 7f4311000640 1 -- 172.21.15.45:0/1025809287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f430c16ca30 con 0x7f430c140580 2024-08-17T02:29:08.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.702+0000 7f4311000640 1 -- 172.21.15.45:0/1025809287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f430c156a20 con 0x7f430c140580 2024-08-17T02:29:08.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.703+0000 7f4311000640 1 -- 172.21.15.45:0/1025809287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430c064db0 con 0x7f430c140580 2024-08-17T02:29:08.709 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.703+0000 7f4301600640 1 -- 172.21.15.45:0/1025809287 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 83420+0+0 (secure 0 0 0) 0x7f4304007300 con 0x7f430c140580 2024-08-17T02:29:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.705+0000 7f4301600640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f42e8065150 0x7f42e8067600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-17T02:29:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.705+0000 7f4301600640 1 -- 172.21.15.45:0/1025809287 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f43040820f0 con 0x7f430c140580 2024-08-17T02:29:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.705+0000 7f4309e00640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f42e8065150 0x7f42e8067600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-17T02:29:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.706+0000 7f4309e00640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f42e8065150 0x7f42e8067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42fc034000 tx=0x7f42fc0090f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-17T02:29:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.709+0000 7f4301600640 1 -- 172.21.15.45:0/1025809287 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+175657 (secure 0 0 0) 0x7f43040504d0 con 0x7f430c140580 2024-08-17T02:29:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.937+0000 7f4311000640 1 -- 172.21.15.45:0/1025809287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f430c0b16d0 con 0x7f430c140580 2024-08-17T02:29:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.937+0000 7f4301600640 1 -- 172.21.15.45:0/1025809287 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f430c0b16d0 con 0x7f430c140580 2024-08-17T02:29:08.938 INFO:teuthology.orchestra.run.smithi045.stdout: 2024-08-17T02:29:08.939 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4667,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6834/2570743735","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6832","nonce":2570743735},{"type":"v1","addr":"172.21.15.169:6834","nonce":2570743735}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.169:6835/1704272549","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.169:6833","nonce":1704272549},{"type":"v1","addr":"172.21.15.169:6835","nonce":1704272549}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5265,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2899133229","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2899133229},{"type":"v1","addr":"172.21.15.45:6836","nonce":2899133229}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2398971308","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2398971308},{"type":"v1","addr":"172.21.15.45:6837","nonce":2398971308}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2024-08-17T02:29:08.939 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 24 2024-08-17T02:29:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 -- 172.21.15.45:0/1025809287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f42e8065150 msgr2=0x7f42e8067600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f42e8065150 0x7f42e8067600 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f42fc034000 tx=0x7f42fc0090f0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 -- 172.21.15.45:0/1025809287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f430c140580 msgr2=0x7f430c1564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-17T02:29:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f430c140580 0x7f430c1564e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f430400cc40 tx=0x7f4304001a30 comp rx=0 tx=0).stop 2024-08-17T02:29:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 -- 172.21.15.45:0/1025809287 shutdown_connections 2024-08-17T02:29:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f430c140580 0x7f430c1564e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.169:3300/0,v1:172.21.15.169:6789/0] conn(0x7f430c1401b0 0x7f430c0aeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.45:6832/37172,v1:172.21.15.45:6833/37172] conn(0x7f42e8065150 0x7f42e8067600 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 --2- 172.21.15.45:0/1025809287 >> [v2:172.21.15.169:3301/0,v1:172.21.15.169:6790/0] conn(0x7f430c0b1270 0x7f430c13e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-17T02:29:08.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 -- 172.21.15.45:0/1025809287 >> 172.21.15.45:0/1025809287 conn(0x7f430c0cb9b0 msgr2=0x7f430c06de60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-17T02:29:08.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 -- 172.21.15.45:0/1025809287 shutdown_connections 2024-08-17T02:29:08.942 INFO:teuthology.orchestra.run.smithi045.stderr:2024-08-17T02:29:08.940+0000 7f4311000640 1 -- 172.21.15.45:0/1025809287 wait complete. 2024-08-17T02:29:08.956 DEBUG:tasks.cephfs.filesystem:already dead... 2024-08-17T02:29:08.956 INFO:teuthology.misc:Shutting down mds daemons... 2024-08-17T02:29:08.956 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-08-17T02:29:08.957 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:08.970 INFO:tasks.ceph.mds.a:Stopped 2024-08-17T02:29:08.970 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-08-17T02:29:08.970 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.024 INFO:tasks.ceph.mds.c:Stopped 2024-08-17T02:29:09.025 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-08-17T02:29:09.025 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.041 INFO:tasks.ceph.mds.b:Stopped 2024-08-17T02:29:09.042 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-08-17T02:29:09.042 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.098 INFO:tasks.ceph.mds.d:Stopped 2024-08-17T02:29:09.098 INFO:teuthology.misc:Shutting down osd daemons... 2024-08-17T02:29:09.098 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-08-17T02:29:09.098 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.141 INFO:tasks.ceph.osd.0:Stopped 2024-08-17T02:29:09.141 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-08-17T02:29:09.141 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.195 INFO:tasks.ceph.osd.1:Stopped 2024-08-17T02:29:09.196 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-08-17T02:29:09.196 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.247 INFO:tasks.ceph.osd.2:Stopped 2024-08-17T02:29:09.248 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-08-17T02:29:09.248 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.299 INFO:tasks.ceph.osd.3:Stopped 2024-08-17T02:29:09.299 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-08-17T02:29:09.299 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.341 INFO:tasks.ceph.osd.4:Stopped 2024-08-17T02:29:09.341 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-08-17T02:29:09.341 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.399 INFO:tasks.ceph.osd.5:Stopped 2024-08-17T02:29:09.399 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-08-17T02:29:09.399 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.453 INFO:tasks.ceph.osd.6:Stopped 2024-08-17T02:29:09.454 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-08-17T02:29:09.454 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.499 INFO:tasks.ceph.osd.7:Stopped 2024-08-17T02:29:09.499 INFO:teuthology.misc:Shutting down mgr daemons... 2024-08-17T02:29:09.499 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-08-17T02:29:09.499 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.562 INFO:tasks.ceph.mgr.y:Stopped 2024-08-17T02:29:09.562 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-08-17T02:29:09.562 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.619 INFO:tasks.ceph.mgr.x:Stopped 2024-08-17T02:29:09.619 INFO:teuthology.misc:Shutting down mon daemons... 2024-08-17T02:29:09.620 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-08-17T02:29:09.620 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.639 INFO:tasks.ceph.mon.a:Stopped 2024-08-17T02:29:09.639 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-08-17T02:29:09.639 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.657 INFO:tasks.ceph.mon.b:Stopped 2024-08-17T02:29:09.657 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-08-17T02:29:09.657 INFO:teuthology.orchestra.run:waiting for 300 2024-08-17T02:29:09.716 INFO:tasks.ceph.mon.c:Stopped 2024-08-17T02:29:09.716 INFO:tasks.ceph:Checking cluster log for badness... 2024-08-17T02:29:09.716 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-08-17T02:29:09.795 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:29:09.795 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-08-17T02:29:10.005 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:29:10.005 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-08-17T02:29:10.117 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:29:10.117 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-08-17T02:29:10.226 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:29:10.226 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-08-17T02:29:10.325 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:29:10.325 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-08-17T02:29:10.522 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:29:10.522 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-08-17T02:29:10.623 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:29:10.623 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-08-17T02:29:10.717 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:29:10.717 DEBUG:teuthology.orchestra.run.smithi169:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-08-17T02:29:10.824 INFO:tasks.ceph:Archiving mon data... 2024-08-17T02:29:10.825 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268/data/mon.a.tgz 2024-08-17T02:29:10.825 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2024-08-17T02:29:10.862 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.HtZA60K9O3 2024-08-17T02:29:10.862 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.HtZA60K9O3 2024-08-17T02:29:11.036 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.HtZA60K9O3 2024-08-17T02:29:11.130 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.HtZA60K9O3 is 304KB 2024-08-17T02:29:11.221 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.HtZA60K9O3 2024-08-17T02:29:11.255 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268/data/mon.b.tgz 2024-08-17T02:29:11.256 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-08-17T02:29:11.291 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.dBn5xfDVFJ 2024-08-17T02:29:11.291 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.dBn5xfDVFJ 2024-08-17T02:29:11.503 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.dBn5xfDVFJ 2024-08-17T02:29:11.598 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.dBn5xfDVFJ is 405KB 2024-08-17T02:29:11.689 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.dBn5xfDVFJ 2024-08-17T02:29:11.723 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268/data/mon.c.tgz 2024-08-17T02:29:11.724 DEBUG:teuthology.orchestra.run.smithi169:> mktemp 2024-08-17T02:29:11.798 INFO:teuthology.orchestra.run.smithi169.stdout:/tmp/tmp.bzCO545484 2024-08-17T02:29:11.799 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.bzCO545484 2024-08-17T02:29:11.979 DEBUG:teuthology.orchestra.run.smithi169:> sudo chmod 0666 /tmp/tmp.bzCO545484 2024-08-17T02:29:12.073 DEBUG:teuthology.orchestra.remote:smithi169:/tmp/tmp.bzCO545484 is 405KB 2024-08-17T02:29:12.161 DEBUG:teuthology.orchestra.run.smithi169:> rm -fr /tmp/tmp.bzCO545484 2024-08-17T02:29:12.196 INFO:tasks.ceph:Cleaning ceph cluster... 2024-08-17T02:29:12.197 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:29:12.201 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-08-17T02:29:12.292 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-08-17T02:29:12.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:29:12.297 DEBUG:teuthology.orchestra.run.smithi169:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-08-17T02:29:12.358 INFO:teuthology.orchestra.run.smithi169.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:29:12.358 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-08-17T02:29:12.369 INFO:tasks.ceph:Archiving crash dumps... 2024-08-17T02:29:12.371 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268/remote/smithi045/crash 2024-08-17T02:29:12.371 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:29:12.428 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268/remote/smithi169/crash 2024-08-17T02:29:12.428 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-08-17T02:29:12.483 INFO:tasks.ceph:Shutting down logrotate 2024-08-17T02:29:12.483 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:12.487 DEBUG:teuthology.orchestra.run.smithi169:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:12.585 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:12.641 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-08-17T02:29:12.697 INFO:tasks.ceph:Compressing logs... 2024-08-17T02:29:12.697 DEBUG:teuthology.orchestra.run.smithi045:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:29:12.701 DEBUG:teuthology.orchestra.run.smithi169:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-17T02:29:12.751 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47115.log 2024-08-17T02:29:12.752 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46512.log 2024-08-17T02:29:12.753 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41592.log 2024-08-17T02:29:12.753 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47115.log.gz 2024-08-17T02:29:12.754 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42881.log 2024-08-17T02:29:12.754 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46512.log.gz 2024-08-17T02:29:12.755 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44633.log 2024-08-17T02:29:12.755 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37031.log 2024-08-17T02:29:12.756 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41592.log.gz 2024-08-17T02:29:12.756 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42881.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42881.log.gzgzip 2024-08-17T02:29:12.756 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49543.log 2024-08-17T02:29:12.758 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:29:12.758 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.42697.log 2024-08-17T02:29:12.758 INFO:teuthology.orchestra.run.smithi169.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37031.log.gz 2024-08-17T02:29:12.758 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43111.log 2024-08-17T02:29:12.759 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44184.log 2024-08-17T02:29:12.760 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44633.log.gz 2024-08-17T02:29:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2024-08-17T02:29:12.760 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49543.log.gz 2024-08-17T02:29:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.44184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50358.log 2024-08-17T02:29:12.760 INFO:teuthology.orchestra.run.smithi045.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.44184.log.gz 2024-08-17T02:29:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.44547.log 2024-08-17T02:29:12.760 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2024-08-17T02:29:12.760 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49785.log 2024-08-17T02:29:12.761 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50358.log.gz 2024-08-17T02:29:12.766 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.3.42697.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:29:12.766 INFO:teuthology.orchestra.run.smithi169.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.42697.log.gz 2024-08-17T02:29:12.766 INFO:teuthology.orchestra.run.smithi169.stderr: 91.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:29:12.766 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.1.43111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43111.log.gz 2024-08-17T02:29:12.766 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-08-17T02:29:12.766 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-08-17T02:29:12.767 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-08-17T02:29:12.767 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.b.log: 93.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:29:12.767 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-08-17T02:29:12.767 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37078.log 2024-08-17T02:29:12.767 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36907.log 2024-08-17T02:29:12.767 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37078.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-08-17T02:29:12.767 INFO:teuthology.orchestra.run.smithi169.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37078.log.gz 2024-08-17T02:29:12.769 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.36907.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-08-17T02:29:12.769 INFO:teuthology.orchestra.run.smithi169.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36907.log.gz 2024-08-17T02:29:12.770 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-08-17T02:29:12.770 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37198.log 2024-08-17T02:29:12.771 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.2.44547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.44547.log.gz 2024-08-17T02:29:12.771 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47325.log 2024-08-17T02:29:12.771 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49230.log 2024-08-17T02:29:12.772 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49785.log.gz 2024-08-17T02:29:12.772 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42546.log 2024-08-17T02:29:12.772 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47325.log.gz 2024-08-17T02:29:12.772 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41992.log 2024-08-17T02:29:12.772 INFO:teuthology.orchestra.run.smithi045.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.49230.log.gz 2024-08-17T02:29:12.772 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44987.log 2024-08-17T02:29:12.772 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42546.log.gz 2024-08-17T02:29:12.772 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43420.log 2024-08-17T02:29:12.773 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41992.log.gz 2024-08-17T02:29:12.773 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42888.log 2024-08-17T02:29:12.773 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44987.log.gz 2024-08-17T02:29:12.773 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48936.log 2024-08-17T02:29:12.773 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43420.log.gz 2024-08-17T02:29:12.773 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48455.log 2024-08-17T02:29:12.773 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42888.log.gz 2024-08-17T02:29:12.773 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48936.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.48936.log.gz -5 2024-08-17T02:29:12.774 INFO:teuthology.orchestra.run.smithi045.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48371.log 2024-08-17T02:29:12.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46007.log 2024-08-17T02:29:12.774 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48455.log.gz 2024-08-17T02:29:12.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50121.log 2024-08-17T02:29:12.774 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48371.log.gz 2024-08-17T02:29:12.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46056.log 2024-08-17T02:29:12.774 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46007.log.gz 2024-08-17T02:29:12.774 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42244.log 2024-08-17T02:29:12.775 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50121.log.gz 2024-08-17T02:29:12.781 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.37198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36987.log 2024-08-17T02:29:12.781 INFO:teuthology.orchestra.run.smithi169.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-08-17T02:29:12.781 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.36987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37158.log 2024-08-17T02:29:12.781 INFO:teuthology.orchestra.run.smithi169.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37198.log.gz 2024-08-17T02:29:12.781 INFO:teuthology.orchestra.run.smithi169.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.36987.log.gz 2024-08-17T02:29:12.781 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42376.log 2024-08-17T02:29:12.782 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37158.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37158.log.gz 2024-08-17T02:29:12.782 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.1.42376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42376.log.gz 2024-08-17T02:29:12.782 INFO:teuthology.orchestra.run.smithi169.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-08-17T02:29:12.782 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37118.log 2024-08-17T02:29:12.782 INFO:teuthology.orchestra.run.smithi169.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36947.log 2024-08-17T02:29:12.782 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.37118.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-08-17T02:29:12.782 INFO:teuthology.orchestra.run.smithi169.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37118.log.gz 2024-08-17T02:29:12.784 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-client.admin.36947.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-08-17T02:29:12.784 INFO:teuthology.orchestra.run.smithi169.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36947.log.gz 2024-08-17T02:29:12.785 INFO:teuthology.orchestra.run.smithi169.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.b.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-08-17T02:29:12.785 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41423.log 2024-08-17T02:29:12.785 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46056.log.gz 2024-08-17T02:29:12.785 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46597.log 2024-08-17T02:29:12.785 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42244.log.gz 2024-08-17T02:29:12.785 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41423.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41423.log.gz 2024-08-17T02:29:12.785 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-08-17T02:29:12.786 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45113.log 2024-08-17T02:29:12.786 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46597.log.gz 2024-08-17T02:29:12.786 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50211.log 2024-08-17T02:29:12.786 INFO:teuthology.orchestra.run.smithi045.stderr: 84.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-08-17T02:29:12.786 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37435.log 2024-08-17T02:29:12.786 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45113.log.gz 2024-08-17T02:29:12.786 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47725.log 88.5% 2024-08-17T02:29:12.786 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50211.log.gz 2024-08-17T02:29:12.787 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42550.log 2024-08-17T02:29:12.787 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37435.log.gz 2024-08-17T02:29:12.787 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41824.log 2024-08-17T02:29:12.787 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47725.log.gz 2024-08-17T02:29:12.787 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42874.log 2024-08-17T02:29:12.787 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42550.log.gz 2024-08-17T02:29:12.787 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49459.log 2024-08-17T02:29:12.787 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41824.log.gz 2024-08-17T02:29:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42874.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.42874.log.gz 2024-08-17T02:29:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49911.log 2024-08-17T02:29:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49459.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-08-17T02:29:12.788 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49459.log.gz 2024-08-17T02:29:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49188.log 2024-08-17T02:29:12.788 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49911.log.gz 2024-08-17T02:29:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46555.log 2024-08-17T02:29:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49188.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49188.log.gz 2024-08-17T02:29:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47893.log 2024-08-17T02:29:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42871.log 2024-08-17T02:29:12.791 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46555.log.gz 2024-08-17T02:29:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49374.log 2024-08-17T02:29:12.791 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47893.log.gz 2024-08-17T02:29:12.791 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42871.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42871.log.gz 2024-08-17T02:29:12.792 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43672.log 2024-08-17T02:29:12.792 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48852.log 2024-08-17T02:29:12.792 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49374.log.gz 2024-08-17T02:29:12.792 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42879.log 2024-08-17T02:29:12.792 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43672.log.gz 2024-08-17T02:29:12.794 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42551.log 2024-08-17T02:29:12.794 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48852.log.gz 2024-08-17T02:29:12.794 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50400.log 2024-08-17T02:29:12.798 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42879.log.gz 2024-08-17T02:29:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46987.log 2024-08-17T02:29:12.798 INFO:teuthology.orchestra.run.smithi045.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42551.log.gz 2024-08-17T02:29:12.798 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50529.log 2024-08-17T02:29:12.798 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50400.log.gz 2024-08-17T02:29:12.801 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46639.log 2024-08-17T02:29:12.801 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46987.log.gz 2024-08-17T02:29:12.801 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50529.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-08-17T02:29:12.801 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50529.log.gz 2024-08-17T02:29:12.801 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49062.log 2024-08-17T02:29:12.801 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46639.log.gz 2024-08-17T02:29:12.802 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47991.log 2024-08-17T02:29:12.802 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49062.log: 88.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-08-17T02:29:12.802 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47199.log 2024-08-17T02:29:12.802 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49062.log.gz 2024-08-17T02:29:12.802 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47991.log: gzip 87.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.47991.log.gz --verbose 2024-08-17T02:29:12.802 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.49701.log 2024-08-17T02:29:12.802 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47199.log: gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.47199.log.gz --verbose 2024-08-17T02:29:12.802 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.46141.log 2024-08-17T02:29:12.804 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48978.log 2024-08-17T02:29:12.804 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49701.log.gz 2024-08-17T02:29:12.804 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46141.log: gzip -5 88.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.46141.log.gz -- 2024-08-17T02:29:12.804 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.45155.log 2024-08-17T02:29:12.804 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48978.log: gzip -5 88.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.48978.log.gz 2024-08-17T02:29:12.804 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.49743.log 2024-08-17T02:29:12.805 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45155.log: gzip 88.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz --verbose 2024-08-17T02:29:12.805 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.45877.log 2024-08-17T02:29:12.805 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49743.log: gzip -5 --verbose 87.8% -- -- replaced with /var/log/ceph/ceph-client.admin.49743.log.gz 2024-08-17T02:29:12.805 INFO:teuthology.orchestra.run.smithi045.stderr: /var/log/ceph/ceph-client.admin.44801.log 2024-08-17T02:29:12.806 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45877.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45877.log.gz 2024-08-17T02:29:12.806 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47071.log 2024-08-17T02:29:12.807 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41634.log 2024-08-17T02:29:12.807 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44801.log.gz 2024-08-17T02:29:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47071.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47071.log.gz 2024-08-17T02:29:12.808 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50079.log 2024-08-17T02:29:12.809 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41634.log: gzip 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41634.log.gz 2024-08-17T02:29:12.809 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50444.log 2024-08-17T02:29:12.810 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48623.log 2024-08-17T02:29:12.810 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.50079.log.gz 2024-08-17T02:29:12.811 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47809.log 87.5% 2024-08-17T02:29:12.811 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50444.log.gz 2024-08-17T02:29:12.812 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43378.log 2024-08-17T02:29:12.812 INFO:teuthology.orchestra.run.smithi045.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48623.log.gz 2024-08-17T02:29:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47809.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-08-17T02:29:12.813 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47809.log.gz 2024-08-17T02:29:12.813 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41782.log 87.6% 2024-08-17T02:29:12.814 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43378.log.gz 2024-08-17T02:29:12.814 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45835.log 2024-08-17T02:29:12.815 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42118.log 2024-08-17T02:29:12.816 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41782.log.gz 2024-08-17T02:29:12.816 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45835.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45835.log.gz 2024-08-17T02:29:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50308.log 2024-08-17T02:29:12.817 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41678.log 2024-08-17T02:29:12.818 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42118.log.gz 2024-08-17T02:29:12.818 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50308.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.45449.log -- replaced with /var/log/ceph/ceph-client.admin.50308.log.gz 2024-08-17T02:29:12.819 INFO:teuthology.orchestra.run.smithi045.stderr: 2024-08-17T02:29:12.820 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41678.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41678.log.gz 2024-08-17T02:29:12.820 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41908.log 2024-08-17T02:29:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45449.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2024-08-17T02:29:12.821 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49417.log 2024-08-17T02:29:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47283.log 2024-08-17T02:29:12.822 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41908.log.gz 2024-08-17T02:29:12.823 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49417.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49417.log.gz 2024-08-17T02:29:12.823 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48665.log 2024-08-17T02:29:12.824 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48287.log 2024-08-17T02:29:12.824 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47283.log.gz 2024-08-17T02:29:12.825 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48665.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.48665.log.gz 2024-08-17T02:29:12.825 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.41246.log 2024-08-17T02:29:12.826 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46723.log 2024-08-17T02:29:12.826 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48287.log.gz 2024-08-17T02:29:12.827 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41246.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41246.log.gz 2024-08-17T02:29:12.827 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-08-17T02:29:12.827 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43462.log 2024-08-17T02:29:12.827 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46723.log.gz 2024-08-17T02:29:12.828 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50571.log 2024-08-17T02:29:12.829 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43462.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43462.log.gz 2024-08-17T02:29:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46807.log 2024-08-17T02:29:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42076.log 2024-08-17T02:29:12.831 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50571.log.gz 2024-08-17T02:29:12.832 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41342.log 2024-08-17T02:29:12.832 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46807.log.gz 2024-08-17T02:29:12.833 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42884.log 2024-08-17T02:29:12.833 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42076.log.gz 2024-08-17T02:29:12.834 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41342.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-08-17T02:29:12.834 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41342.log.gz 2024-08-17T02:29:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42884.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-08-17T02:29:12.835 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42884.log.gz 2024-08-17T02:29:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41465.log 2024-08-17T02:29:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44675.log 2024-08-17T02:29:12.839 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45575.log 2024-08-17T02:29:12.839 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41465.log.gz 2024-08-17T02:29:12.840 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42886.log 2024-08-17T02:29:12.840 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44675.log.gz 2024-08-17T02:29:12.841 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48245.log 2024-08-17T02:29:12.842 INFO:teuthology.orchestra.run.smithi045.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45575.log.gz 2024-08-17T02:29:12.843 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45533.log 2024-08-17T02:29:12.843 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42886.log.gz 2024-08-17T02:29:12.844 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48245.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-08-17T02:29:12.844 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48245.log.gz 2024-08-17T02:29:12.846 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45533.log: gzip 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45533.log.gz 2024-08-17T02:29:12.846 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46225.log 2024-08-17T02:29:12.847 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44717.log 2024-08-17T02:29:12.848 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46225.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46225.log.gz 2024-08-17T02:29:12.849 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48749.log 2024-08-17T02:29:12.851 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44717.log.gz 2024-08-17T02:29:12.851 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47947.log 2024-08-17T02:29:12.852 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48749.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48749.log.gz 2024-08-17T02:29:12.853 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47947.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47947.log.gz 2024-08-17T02:29:12.854 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43126.log 2024-08-17T02:29:12.856 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42286.log 2024-08-17T02:29:12.857 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43126.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43126.log.gz 2024-08-17T02:29:12.858 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42286.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42286.log.gz 2024-08-17T02:29:12.859 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50163.log 2024-08-17T02:29:12.860 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50737.log 2024-08-17T02:29:12.862 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50163.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50163.log.gz 2024-08-17T02:29:12.863 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50737.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50737.log.gz 2024-08-17T02:29:12.863 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48707.log 2024-08-17T02:29:12.865 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44903.log 2024-08-17T02:29:12.866 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48707.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48707.log.gz 2024-08-17T02:29:12.867 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44903.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44903.log.gz 2024-08-17T02:29:12.868 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49827.log 2024-08-17T02:29:12.869 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42202.log 2024-08-17T02:29:12.870 INFO:teuthology.orchestra.run.smithi169.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-08-17T02:29:12.871 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49827.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49827.log.gz 2024-08-17T02:29:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42202.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42202.log.gz 2024-08-17T02:29:12.873 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2024-08-17T02:29:12.873 INFO:teuthology.orchestra.run.smithi045.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-08-17T02:29:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43336.log 2024-08-17T02:29:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45323.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz 2024-08-17T02:29:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41866.log 2024-08-17T02:29:12.877 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48539.log 2024-08-17T02:29:12.877 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43336.log.gz 2024-08-17T02:29:12.878 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41866.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41866.log.gz 2024-08-17T02:29:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-08-17T02:29:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48539.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48539.log.gz 2024-08-17T02:29:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42370.log 2024-08-17T02:29:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2024-08-17T02:29:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42370.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42370.log.gz 2024-08-17T02:29:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45281.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2024-08-17T02:29:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31103.log 2024-08-17T02:29:12.885 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49869.log 2024-08-17T02:29:12.886 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph.tmp-client.admin.31103.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31103.log.gz 2024-08-17T02:29:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48329.log 2024-08-17T02:29:12.888 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49869.log.gz 2024-08-17T02:29:12.890 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45491.log 2024-08-17T02:29:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48329.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48329.log.gz 2024-08-17T02:29:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45491.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45491.log.gz 2024-08-17T02:29:12.893 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48581.log 2024-08-17T02:29:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49020.log 2024-08-17T02:29:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48581.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48581.log.gz 2024-08-17T02:29:12.896 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49020.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49020.log.gz 2024-08-17T02:29:12.897 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45962.log 2024-08-17T02:29:12.898 INFO:teuthology.orchestra.run.smithi169.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-08-17T02:29:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46347.log 2024-08-17T02:29:12.900 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45962.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45962.log.gz 2024-08-17T02:29:12.901 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46347.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46347.log.gz 2024-08-17T02:29:12.902 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47475.log 2024-08-17T02:29:12.902 INFO:teuthology.orchestra.run.smithi045.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-08-17T02:29:12.903 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44247.log 2024-08-17T02:29:12.904 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47475.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47475.log.gz 2024-08-17T02:29:12.905 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42034.log 2024-08-17T02:29:12.905 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44247.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44247.log.gz 2024-08-17T02:29:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45919.log 2024-08-17T02:29:12.907 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48497.log 2024-08-17T02:29:12.907 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42034.log.gz 2024-08-17T02:29:12.908 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43252.log 2024-08-17T02:29:12.909 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45919.log.gz 2024-08-17T02:29:12.910 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48497.log: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46470.log 2024-08-17T02:29:12.910 INFO:teuthology.orchestra.run.smithi045.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48497.log.gz 2024-08-17T02:29:12.911 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43588.log 2024-08-17T02:29:12.911 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43252.log.gz 2024-08-17T02:29:12.912 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46470.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46470.log.gz 2024-08-17T02:29:12.913 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49272.log 2024-08-17T02:29:12.913 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43588.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43588.log.gz 2024-08-17T02:29:12.914 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46849.log 2024-08-17T02:29:12.915 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41950.log 2024-08-17T02:29:12.916 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49272.log.gz 2024-08-17T02:29:12.917 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46849.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46849.log.gz 2024-08-17T02:29:12.918 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41950.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41950.log.gz 2024-08-17T02:29:12.918 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47680.log 2024-08-17T02:29:12.920 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41154.log 2024-08-17T02:29:12.921 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.0.47680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47680.log.gz 2024-08-17T02:29:12.921 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47029.log 2024-08-17T02:29:12.923 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44759.log 2024-08-17T02:29:12.923 INFO:teuthology.orchestra.run.smithi045.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41154.log.gz 2024-08-17T02:29:12.924 INFO:teuthology.orchestra.run.smithi169.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-08-17T02:29:12.924 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47029.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47029.log.gz 2024-08-17T02:29:12.925 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50695.log 2024-08-17T02:29:12.925 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44759.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44759.log.gz 2024-08-17T02:29:12.926 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45793.log 2024-08-17T02:29:12.927 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46098.log 2024-08-17T02:29:12.927 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50695.log.gz 2024-08-17T02:29:12.928 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45197.log 2024-08-17T02:29:12.928 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45793.log.gz 2024-08-17T02:29:12.930 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47367.log 2024-08-17T02:29:12.930 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46098.log.gz 2024-08-17T02:29:12.931 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45071.log 2024-08-17T02:29:12.931 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45197.log.gz 2024-08-17T02:29:12.932 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47367.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47367.log.gz 2024-08-17T02:29:12.933 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42160.log 2024-08-17T02:29:12.933 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45071.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45071.log.gz 2024-08-17T02:29:12.934 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42328.log 2024-08-17T02:29:12.935 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44591.log 2024-08-17T02:29:12.935 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42160.log.gz 2024-08-17T02:29:12.937 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42328.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42328.log.gz 2024-08-17T02:29:12.937 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47157.log 2024-08-17T02:29:12.938 INFO:teuthology.orchestra.run.smithi045.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44591.log.gz 2024-08-17T02:29:12.938 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43168.log 2024-08-17T02:29:12.940 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2024-08-17T02:29:12.940 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47157.log.gz 2024-08-17T02:29:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43168.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43168.log.gz 2024-08-17T02:29:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45709.log 2024-08-17T02:29:12.942 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45407.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gz 2024-08-17T02:29:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37554.log 2024-08-17T02:29:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46267.log 2024-08-17T02:29:12.944 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45709.log.gz 2024-08-17T02:29:12.946 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37554.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37554.log.gz 2024-08-17T02:29:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5/var/log/ceph/ceph-client.admin.46267.log: --verbose -- /var/log/ceph/ceph-client.admin.42552.log 2024-08-17T02:29:12.947 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46267.log.gz 2024-08-17T02:29:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47241.log 2024-08-17T02:29:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48894.log 2024-08-17T02:29:12.949 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42552.log.gz 2024-08-17T02:29:12.951 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47241.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47241.log.gz 2024-08-17T02:29:12.951 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37170.log 2024-08-17T02:29:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48894.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48894.log.gz 2024-08-17T02:29:12.952 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43546.log 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.37170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49995.log 2024-08-17T02:29:12.954 INFO:teuthology.orchestra.run.smithi045.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.37170.log.gz 2024-08-17T02:29:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43546.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43546.log.gz 2024-08-17T02:29:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46765.log 2024-08-17T02:29:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49995.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49995.log.gz 2024-08-17T02:29:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43630.log 2024-08-17T02:29:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44945.log 2024-08-17T02:29:12.958 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46765.log.gz 2024-08-17T02:29:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43630.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43630.log.gz 2024-08-17T02:29:12.961 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-08-17T02:29:12.961 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44945.log: --verbose -- /var/log/ceph/ceph-client.admin.50266.log 2024-08-17T02:29:12.961 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44945.log.gz 2024-08-17T02:29:12.961 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45751.log 2024-08-17T02:29:12.962 INFO:teuthology.orchestra.run.smithi169.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-08-17T02:29:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49146.log 2024-08-17T02:29:12.963 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50266.log.gz 2024-08-17T02:29:12.964 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50613.log 2024-08-17T02:29:12.964 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45751.log.gz 2024-08-17T02:29:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43294.log 2024-08-17T02:29:12.966 INFO:teuthology.orchestra.run.smithi045.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49146.log.gz 2024-08-17T02:29:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49953.log 2024-08-17T02:29:12.967 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50613.log.gz 2024-08-17T02:29:12.968 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41550.log 2024-08-17T02:29:12.968 INFO:teuthology.orchestra.run.smithi045.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43294.log.gz 2024-08-17T02:29:12.969 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44861.log 2024-08-17T02:29:12.969 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49953.log.gz 2024-08-17T02:29:12.970 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46681.log 2024-08-17T02:29:12.970 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41550.log.gz 2024-08-17T02:29:12.972 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.44861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42544.log 2024-08-17T02:29:12.972 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44861.log.gz 2024-08-17T02:29:12.973 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43084.log 2024-08-17T02:29:12.973 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46681.log.gz 2024-08-17T02:29:12.974 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42537.log 2024-08-17T02:29:12.974 INFO:teuthology.orchestra.run.smithi045.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42544.log.gz 2024-08-17T02:29:12.975 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47767.log 2024-08-17T02:29:12.975 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43084.log.gz 2024-08-17T02:29:12.977 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42537.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-08-17T02:29:12.977 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42537.log.gz 2024-08-17T02:29:12.977 INFO:teuthology.orchestra.run.smithi169.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-08-17T02:29:12.978 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45365.log 2024-08-17T02:29:12.978 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47767.log.gz 2024-08-17T02:29:12.979 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43714.log 2024-08-17T02:29:12.980 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49501.log 2024-08-17T02:29:12.980 INFO:teuthology.orchestra.run.smithi045.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45365.log.gz 2024-08-17T02:29:12.981 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48413.log 2024-08-17T02:29:12.982 INFO:teuthology.orchestra.run.smithi045.stderr: 91.2%/var/log/ceph/ceph-client.admin.49501.log: -- replaced with /var/log/ceph/ceph-client.admin.43714.log.gz 2024-08-17T02:29:12.983 INFO:teuthology.orchestra.run.smithi045.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49501.log.gz 2024-08-17T02:29:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50655.log 2024-08-17T02:29:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48413.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48413.log.gz 2024-08-17T02:29:12.985 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42543.log 2024-08-17T02:29:12.986 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46937.log 2024-08-17T02:29:12.986 INFO:teuthology.orchestra.run.smithi045.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50655.log.gz 2024-08-17T02:29:12.987 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42538.log 2024-08-17T02:29:12.987 INFO:teuthology.orchestra.run.smithi045.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42543.log.gz 2024-08-17T02:29:12.989 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47409.log 2024-08-17T02:29:12.989 INFO:teuthology.orchestra.run.smithi045.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46937.log.gz 2024-08-17T02:29:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42538.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42538.log.gz 2024-08-17T02:29:12.991 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5/var/log/ceph/ceph-client.admin.47409.log: --verbose -- /var/log/ceph/ceph-client.admin.49104.log 2024-08-17T02:29:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:gzip 91.4% -- replaced with /var/log/ceph/ceph-client.admin.47409.log.gz 2024-08-17T02:29:12.992 INFO:teuthology.orchestra.run.smithi045.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45239.log 2024-08-17T02:29:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49104.log: gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.49104.log.gz --verbose 2024-08-17T02:29:12.994 INFO:teuthology.orchestra.run.smithi045.stderr: -- /var/log/ceph/ceph-client.admin.50037.log 2024-08-17T02:29:12.995 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47851.log 2024-08-17T02:29:12.995 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45239.log.gz 2024-08-17T02:29:12.996 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43210.log 2024-08-17T02:29:12.996 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50037.log.gz 2024-08-17T02:29:12.997 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.47851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50486.log 2024-08-17T02:29:12.998 INFO:teuthology.orchestra.run.smithi045.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47851.log.gz 2024-08-17T02:29:12.998 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43210.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-08-17T02:29:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49314.log 2024-08-17T02:29:13.005 INFO:teuthology.orchestra.run.smithi045.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43210.log.gz 2024-08-17T02:29:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.50486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46893.log 2024-08-17T02:29:13.005 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50486.log.gz 2024-08-17T02:29:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.49314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41722.log 2024-08-17T02:29:13.005 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49314.log.gz 2024-08-17T02:29:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43504.log 2024-08-17T02:29:13.005 INFO:teuthology.orchestra.run.smithi045.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46893.log.gz 2024-08-17T02:29:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42887.log 2024-08-17T02:29:13.005 INFO:teuthology.orchestra.run.smithi045.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41722.log.gz 2024-08-17T02:29:13.006 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41508.log 2024-08-17T02:29:13.006 INFO:teuthology.orchestra.run.smithi045.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43504.log.gz 2024-08-17T02:29:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.42887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46428.log 2024-08-17T02:29:13.007 INFO:teuthology.orchestra.run.smithi045.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42887.log.gz 2024-08-17T02:29:13.008 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.41508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45029.log 2024-08-17T02:29:13.008 INFO:teuthology.orchestra.run.smithi045.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41508.log.gz 2024-08-17T02:29:13.008 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46183.log 2024-08-17T02:29:13.009 INFO:teuthology.orchestra.run.smithi045.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46428.log.gz 2024-08-17T02:29:13.010 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.45029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48075.log 2024-08-17T02:29:13.010 INFO:teuthology.orchestra.run.smithi045.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45029.log.gz 2024-08-17T02:29:13.011 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.46183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48809.log 2024-08-17T02:29:13.011 INFO:teuthology.orchestra.run.smithi045.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46183.log.gz 2024-08-17T02:29:13.012 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43852.log 2024-08-17T02:29:13.012 INFO:teuthology.orchestra.run.smithi045.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48075.log.gz 2024-08-17T02:29:13.014 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.48809.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48809.log.gz 2024-08-17T02:29:13.015 INFO:teuthology.orchestra.run.smithi045.stderr:/var/log/ceph/ceph-client.admin.43852.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43852.log.gz 2024-08-17T02:29:13.018 INFO:teuthology.orchestra.run.smithi169.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-08-17T02:29:13.021 INFO:teuthology.orchestra.run.smithi169.stderr: 2024-08-17T02:29:13.021 INFO:teuthology.orchestra.run.smithi169.stderr:real 0m0.288s 2024-08-17T02:29:13.021 INFO:teuthology.orchestra.run.smithi169.stderr:user 0m0.999s 2024-08-17T02:29:13.021 INFO:teuthology.orchestra.run.smithi169.stderr:sys 0m0.167s 2024-08-17T02:29:13.041 INFO:teuthology.orchestra.run.smithi045.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-08-17T02:29:13.049 INFO:teuthology.orchestra.run.smithi045.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-08-17T02:29:13.059 INFO:teuthology.orchestra.run.smithi045.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-08-17T02:29:13.142 INFO:teuthology.orchestra.run.smithi045.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-08-17T02:29:13.145 INFO:teuthology.orchestra.run.smithi045.stderr: 2024-08-17T02:29:13.145 INFO:teuthology.orchestra.run.smithi045.stderr:real 0m0.415s 2024-08-17T02:29:13.145 INFO:teuthology.orchestra.run.smithi045.stderr:user 0m1.187s 2024-08-17T02:29:13.145 INFO:teuthology.orchestra.run.smithi045.stderr:sys 0m0.634s 2024-08-17T02:29:13.146 INFO:tasks.ceph:Archiving logs... 2024-08-17T02:29:13.146 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268/remote/smithi045/log 2024-08-17T02:29:13.147 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:29:13.483 DEBUG:teuthology.misc:Transferring archived files from smithi169:/var/log/ceph to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268/remote/smithi169/log 2024-08-17T02:29:13.484 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-17T02:29:13.671 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-17T02:29:13.681 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-17T02:29:13.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:29:13.685 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-17T02:29:13.801 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-17T02:29:13.810 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-17T02:29:13.810 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:29:13.815 DEBUG:teuthology.orchestra.run.smithi169:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-17T02:29:13.844 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:29:13.849 INFO:teuthology.orchestra.run.smithi169.stderr:bash: line 1: ntpq: command not found 2024-08-17T02:29:13.851 INFO:teuthology.orchestra.run.smithi045.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:29:13.851 INFO:teuthology.orchestra.run.smithi045.stdout:=============================================================================== 2024-08-17T02:29:13.852 INFO:teuthology.orchestra.run.smithi045.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 -44us[-3340ns] +/- 58ms 2024-08-17T02:29:13.852 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 -74us[ -74us] +/- 61ms 2024-08-17T02:29:13.852 INFO:teuthology.orchestra.run.smithi045.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 +192us[ +233us] +/- 60ms 2024-08-17T02:29:13.852 INFO:teuthology.orchestra.run.smithi045.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:29:13.856 INFO:teuthology.orchestra.run.smithi169.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-17T02:29:13.856 INFO:teuthology.orchestra.run.smithi169.stdout:=============================================================================== 2024-08-17T02:29:13.856 INFO:teuthology.orchestra.run.smithi169.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 -6546ns[ +19us] +/- 58ms 2024-08-17T02:29:13.856 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 12 -22us[ -22us] +/- 61ms 2024-08-17T02:29:13.856 INFO:teuthology.orchestra.run.smithi169.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +229us[ +229us] +/- 60ms 2024-08-17T02:29:13.857 INFO:teuthology.orchestra.run.smithi169.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-08-17T02:29:13.857 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-17T02:29:13.868 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-17T02:29:13.868 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-17T02:29:13.878 DEBUG:teuthology.orchestra.run.smithi045:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:29:14.014 DEBUG:teuthology.orchestra.run.smithi169:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-17T02:29:14.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:29:14.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:14.188 DEBUG:teuthology.orchestra.run.smithi169:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-08-17T02:29:14.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:14.248 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-17T02:29:14.257 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-17T02:29:14.266 INFO:teuthology.task.internal:Duration was 756.026051 seconds 2024-08-17T02:29:14.267 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-17T02:29:14.277 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-17T02:29:14.278 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:29:14.282 DEBUG:teuthology.orchestra.run.smithi169:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-17T02:29:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:29:14.369 INFO:teuthology.orchestra.run.smithi169.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-17T02:29:14.738 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-17T02:29:14.738 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2024-08-17T02:29:14.738 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:29:14.789 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi169.front.sepia.ceph.com 2024-08-17T02:29:14.789 DEBUG:teuthology.orchestra.run.smithi169:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-17T02:29:14.839 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-17T02:29:14.839 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:29:14.843 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-17T02:29:14.902 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-17T02:29:14.903 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:29:14.906 DEBUG:teuthology.orchestra.run.smithi169:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-17T02:29:15.051 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-17T02:29:15.068 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-17T02:29:15.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:29:15.124 DEBUG:teuthology.orchestra.run.smithi169:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-17T02:29:15.179 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-17T02:29:15.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:15.193 DEBUG:teuthology.orchestra.run.smithi169:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:15.260 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2024-08-17T02:29:15.264 INFO:teuthology.orchestra.run.smithi169.stdout:kernel.core_pattern = core 2024-08-17T02:29:15.293 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:15.327 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:15.327 DEBUG:teuthology.orchestra.run.smithi169:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-17T02:29:15.361 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-17T02:29:15.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-17T02:29:15.373 INFO:teuthology.task.internal:Transferring archived files... 2024-08-17T02:29:15.374 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268/remote/smithi045 2024-08-17T02:29:15.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:29:15.437 DEBUG:teuthology.misc:Transferring archived files from smithi169:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2024-08-17_01:02:08-fs-wip-mchangir-mgr-volumes-print-thread-name-quincy-distro-default-smithi/7858268/remote/smithi169 2024-08-17T02:29:15.438 DEBUG:teuthology.orchestra.run.smithi169:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-17T02:29:15.501 INFO:teuthology.task.internal:Removing archive directory... 2024-08-17T02:29:15.501 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:29:15.506 DEBUG:teuthology.orchestra.run.smithi169:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-17T02:29:15.541 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-17T02:29:15.559 INFO:teuthology.task.internal:Not uploading archives. 2024-08-17T02:29:15.559 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-17T02:29:15.576 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-17T02:29:15.576 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:29:15.582 DEBUG:teuthology.orchestra.run.smithi169:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-17T02:29:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: 393613 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:29 /home/ubuntu/cephtest 2024-08-17T02:29:15.617 INFO:teuthology.orchestra.run.smithi169.stdout: 393241 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 17 02:29 /home/ubuntu/cephtest 2024-08-17T02:29:15.620 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-17T02:29:15.632 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-17T02:29:15.670 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 client.1-kernel-sha1: 7503b862ff5bc4e556b3daee1c7881aa3e90ed62 description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/basic}} duration: 756.0260512828827 failure_reason: 'Test failure: test_volume_create (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_mchangir@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8de90f8382064856b0cb6ff492b71d76 status: fail success: false 2024-08-17T02:29:15.670 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-17T02:29:15.750 INFO:teuthology.run:FAIL